Miriam Baglioni
|
50fbebf186
|
[NOAMI] removed entry for Health and Social Care Board from the list of funders. Modified IRC putting 1596 and 1597 as synonyms, as required in ticket 9635
|
2024-04-03 11:45:40 +02:00 |
Sandro La Bruzzo
|
ece56f0178
|
update crossref mapping to be transformed together with UnpayWall
|
2024-03-25 18:18:10 +01:00 |
Sandro La Bruzzo
|
58dbe71d39
|
update crossref mapping to be runnable separately as a single datasource outside doiboost
|
2024-03-20 17:04:52 +01:00 |
Sandro La Bruzzo
|
cbd4e5e4bb
|
update mag mapping
|
2024-03-08 16:31:40 +01:00 |
Sandro La Bruzzo
|
d34cef3f8d
|
Merge remote-tracking branch 'origin/beta' into doidoost_dismiss
|
2024-03-05 11:45:31 +01:00 |
Sandro La Bruzzo
|
3b837d38ce
|
added oozie workflow
|
2024-03-05 11:44:59 +01:00 |
Sandro La Bruzzo
|
b32a9d1994
|
Implemented workflow for updating table , added step to check if the new generated table is valid
|
2024-02-23 10:04:28 +01:00 |
Sandro La Bruzzo
|
0386f36385
|
Added workflow to update ORCID and replaced some parsing, because the update works and employments xml differs from the dump one.
|
2024-01-25 19:40:59 +01:00 |
sandro.labruzzo
|
e328bc0ade
|
fixed missing parameter on download update
|
2024-01-12 16:18:20 +01:00 |
Sandro La Bruzzo
|
8f61063201
|
Added workflow
|
2024-01-10 19:42:22 +01:00 |
Sandro La Bruzzo
|
1a42a5c10d
|
Implemented Download update of ORCID
|
2024-01-10 18:03:20 +01:00 |
Sandro La Bruzzo
|
6ce36b3e41
|
Implemented ORCID Workflow on DHP-Aggregation for retrieving ORCID DUMP and generating tables
|
2023-11-14 12:04:29 +01:00 |
Claudio Atzori
|
1abe6d1ad7
|
WIP: collectorWorker error reporting, added report messages
|
2021-02-15 15:08:59 +01:00 |
Claudio Atzori
|
29c6f7e255
|
classes related to the collection workflow moved into common package; implemented MongoDB collection plugins
|
2021-02-12 12:31:02 +01:00 |
Claudio Atzori
|
bae029f828
|
collection_java_xmx allows to declare the heap size allocated for the java actions involved in the metadata collectionw workflow
|
2021-02-08 18:07:23 +01:00 |
Claudio Atzori
|
50add4c61b
|
added requestDelay to HttpConnector2 configuration; Aggregation workflow constants moved in dhp-common
|
2021-02-08 12:19:38 +01:00 |
Claudio Atzori
|
a8a758925e
|
better logging, WIP: collectorWorker error reporting
|
2021-02-05 19:18:05 +01:00 |
Sandro La Bruzzo
|
4dae5e605d
|
implemented messaging btween collection worker and Dnet
|
2021-02-04 15:51:15 +01:00 |
Claudio Atzori
|
e04045089f
|
better logging, WIP: collectorWorker error reporting
|
2021-02-03 17:58:22 +01:00 |
Claudio Atzori
|
53884d12c2
|
code formatting
|
2021-02-02 14:38:03 +01:00 |
Sandro La Bruzzo
|
6ff234d81b
|
Implemented a first prototype of incremental harvesting and trasformation using readlock
|
2021-02-01 13:56:05 +01:00 |
Sandro La Bruzzo
|
e423634cb6
|
RollBack in case of error WORKS!!!
|
2021-01-29 17:21:42 +01:00 |
Sandro La Bruzzo
|
0276180039
|
WIP mdstore
transaction implemented on hadoop side
|
2021-01-29 16:42:41 +01:00 |
Sandro La Bruzzo
|
98b9498b57
|
Removed old messaging system not quite used from collection and Transformation workflow
code refactor
|
2021-01-28 09:51:17 +01:00 |
Claudio Atzori
|
0825321d0b
|
improved unit tests in dhp-aggregation
|
2020-05-05 12:39:04 +02:00 |
Sandro La Bruzzo
|
5a8a323f2a
|
dhp-collection-worker integrated in dhp-workflows
|
2019-10-24 11:36:59 +02:00 |
Claudio Atzori
|
c7654b6fe3
|
renamed collection & transformation oozie workflow files
|
2019-10-18 09:42:20 +02:00 |
Claudio Atzori
|
27db5afdad
|
integrating the oozie workflow build/deploy/run mechanism, took inspiration from iis
|
2019-10-17 18:38:30 +02:00 |
Sandro La Bruzzo
|
4b8c7c279d
|
Added documentation on a class, and reused ArgumetApplicationParser on dhp-aggregation
|
2019-10-07 17:02:53 +02:00 |