 Michele Artini
|
cb29b9773c
|
xslt rules
|
2024-03-18 15:31:34 +01:00 |
|
Michele Artini
|
85b844d57e
|
updated BASE filter param
|
2024-03-15 15:03:27 +01:00 |
|
Michele Artini
|
455f2e1e07
|
apply commits from master
|
2024-03-15 14:56:39 +01:00 |
|
Michele Artini
|
88fef367b9
|
new plugin to collect from a dump of BASE
|
2024-03-15 10:47:52 +01:00 |
Sandro La Bruzzo
|
b32a9d1994
|
Implemented workflow for updating table , added step to check if the new generated table is valid
|
2024-02-23 10:04:28 +01:00 |
 Sandro La Bruzzo
|
0386f36385
|
Added workflow to update ORCID and replaced some parsing, because the update works and employments xml differs from the dump one.
|
2024-01-25 19:40:59 +01:00 |
sandro.labruzzo
|
e328bc0ade
|
fixed missing parameter on download update
|
2024-01-12 16:18:20 +01:00 |
|
Sandro La Bruzzo
|
8f61063201
|
Added workflow
|
2024-01-10 19:42:22 +01:00 |
|
Sandro La Bruzzo
|
1a42a5c10d
|
Implemented Download update of ORCID
|
2024-01-10 18:03:20 +01:00 |
|
Sandro La Bruzzo
|
6ce36b3e41
|
Implemented ORCID Workflow on DHP-Aggregation for retrieving ORCID DUMP and generating tables
|
2023-11-14 12:04:29 +01:00 |
 Claudio Atzori
|
1abe6d1ad7
|
WIP: collectorWorker error reporting, added report messages
|
2021-02-15 15:08:59 +01:00 |
|
Claudio Atzori
|
29c6f7e255
|
classes related to the collection workflow moved into common package; implemented MongoDB collection plugins
|
2021-02-12 12:31:02 +01:00 |
|
Claudio Atzori
|
bae029f828
|
collection_java_xmx allows to declare the heap size allocated for the java actions involved in the metadata collectionw workflow
|
2021-02-08 18:07:23 +01:00 |
|
Claudio Atzori
|
50add4c61b
|
added requestDelay to HttpConnector2 configuration; Aggregation workflow constants moved in dhp-common
|
2021-02-08 12:19:38 +01:00 |
|
Claudio Atzori
|
a8a758925e
|
better logging, WIP: collectorWorker error reporting
|
2021-02-05 19:18:05 +01:00 |
|
Sandro La Bruzzo
|
4dae5e605d
|
implemented messaging btween collection worker and Dnet
|
2021-02-04 15:51:15 +01:00 |
|
Claudio Atzori
|
e04045089f
|
better logging, WIP: collectorWorker error reporting
|
2021-02-03 17:58:22 +01:00 |
|
Claudio Atzori
|
53884d12c2
|
code formatting
|
2021-02-02 14:38:03 +01:00 |
|
Sandro La Bruzzo
|
6ff234d81b
|
Implemented a first prototype of incremental harvesting and trasformation using readlock
|
2021-02-01 13:56:05 +01:00 |
|
Sandro La Bruzzo
|
e423634cb6
|
RollBack in case of error WORKS!!!
|
2021-01-29 17:21:42 +01:00 |
|
Sandro La Bruzzo
|
0276180039
|
WIP mdstore
transaction implemented on hadoop side
|
2021-01-29 16:42:41 +01:00 |
|
Sandro La Bruzzo
|
98b9498b57
|
Removed old messaging system not quite used from collection and Transformation workflow
code refactor
|
2021-01-28 09:51:17 +01:00 |
|
Claudio Atzori
|
0825321d0b
|
improved unit tests in dhp-aggregation
|
2020-05-05 12:39:04 +02:00 |
|
Sandro La Bruzzo
|
5a8a323f2a
|
dhp-collection-worker integrated in dhp-workflows
|
2019-10-24 11:36:59 +02:00 |
|
Claudio Atzori
|
c7654b6fe3
|
renamed collection & transformation oozie workflow files
|
2019-10-18 09:42:20 +02:00 |
|
Claudio Atzori
|
27db5afdad
|
integrating the oozie workflow build/deploy/run mechanism, took inspiration from iis
|
2019-10-17 18:38:30 +02:00 |
|
Sandro La Bruzzo
|
4b8c7c279d
|
Added documentation on a class, and reused ArgumetApplicationParser on dhp-aggregation
|
2019-10-07 17:02:53 +02:00 |