 Michele Artini
|
3e56b88a5f
|
base transformation rule test
|
2024-03-11 14:48:37 +01:00 |
|
Michele Artini
|
341c3f798e
|
xslt
|
2024-03-11 10:50:17 +01:00 |
|
Michele Artini
|
4145065481
|
mapping for ODF
|
2024-03-08 15:31:08 +01:00 |
|
Michele Artini
|
5e9102d404
|
xslt
|
2024-03-08 14:41:25 +01:00 |
|
Michele Artini
|
dc9d642e66
|
xslt
|
2024-03-08 12:37:54 +01:00 |
|
Michele Artini
|
932173287a
|
added a base vocabulary
|
2024-03-08 11:52:58 +01:00 |
|
Michele Artini
|
6648d710a3
|
xslt
|
2024-03-07 13:06:41 +01:00 |
|
Michele Artini
|
a059747f16
|
xslt
|
2024-03-07 10:57:41 +01:00 |
|
Michele Artini
|
1e34585213
|
file renaming
|
2024-03-07 09:52:49 +01:00 |
|
Michele Artini
|
108478b778
|
xslt
|
2024-03-07 09:34:16 +01:00 |
|
Michele Artini
|
6500151c90
|
initial version of the BASE Transformation rule
|
2024-03-05 14:18:57 +01:00 |
|
Michele Artini
|
af58cd726e
|
initial version of the BASE Transformation rule
|
2024-03-05 11:48:36 +01:00 |
|
Michele Artini
|
efbb6c37d6
|
updated sql for base
|
2024-03-05 09:37:04 +01:00 |
|
Michele Artini
|
b206e9a30b
|
sql to create the BASE datasource
|
2024-03-04 15:13:34 +01:00 |
|
Michele Artini
|
9506d80ddc
|
changed sql to select accepted datasources
|
2024-03-04 08:25:40 +01:00 |
|
Michele Artini
|
be7f327e88
|
opendoar datasource filter
|
2024-03-01 13:38:36 +01:00 |
|
Michele Artini
|
32f4d6f691
|
reports for types
|
2024-03-01 11:43:37 +01:00 |
|
Michele Artini
|
5ddbef3a5b
|
new stats
|
2024-02-28 14:34:09 +01:00 |
|
Michele Artini
|
04dd31139b
|
separator in sql query
|
2024-02-28 11:12:25 +01:00 |
|
Michele Artini
|
3d14bef381
|
OpenDoar reports
|
2024-02-28 10:51:13 +01:00 |
|
Michele Artini
|
da65728afe
|
produce a parquet file
|
2024-02-15 14:04:17 +01:00 |
|
Michele Artini
|
773346f638
|
increased memory
|
2024-02-14 14:40:27 +01:00 |
|
Michele Artini
|
963a2500be
|
new reports in hadoop job
|
2024-02-14 10:37:39 +01:00 |
|
Michele Artini
|
4b1ecad4e2
|
prepared a job to analyze the BASE records
|
2024-02-13 13:48:26 +01:00 |
Sandro La Bruzzo
|
6ce36b3e41
|
Implemented ORCID Workflow on DHP-Aggregation for retrieving ORCID DUMP and generating tables
|
2023-11-14 12:04:29 +01:00 |
 Claudio Atzori
|
1abe6d1ad7
|
WIP: collectorWorker error reporting, added report messages
|
2021-02-15 15:08:59 +01:00 |
|
Claudio Atzori
|
29c6f7e255
|
classes related to the collection workflow moved into common package; implemented MongoDB collection plugins
|
2021-02-12 12:31:02 +01:00 |
|
Claudio Atzori
|
bae029f828
|
collection_java_xmx allows to declare the heap size allocated for the java actions involved in the metadata collectionw workflow
|
2021-02-08 18:07:23 +01:00 |
|
Claudio Atzori
|
50add4c61b
|
added requestDelay to HttpConnector2 configuration; Aggregation workflow constants moved in dhp-common
|
2021-02-08 12:19:38 +01:00 |
|
Claudio Atzori
|
a8a758925e
|
better logging, WIP: collectorWorker error reporting
|
2021-02-05 19:18:05 +01:00 |
 Sandro La Bruzzo
|
4dae5e605d
|
implemented messaging btween collection worker and Dnet
|
2021-02-04 15:51:15 +01:00 |
|
Claudio Atzori
|
e04045089f
|
better logging, WIP: collectorWorker error reporting
|
2021-02-03 17:58:22 +01:00 |
|
Claudio Atzori
|
53884d12c2
|
code formatting
|
2021-02-02 14:38:03 +01:00 |
|
Sandro La Bruzzo
|
6ff234d81b
|
Implemented a first prototype of incremental harvesting and trasformation using readlock
|
2021-02-01 13:56:05 +01:00 |
|
Sandro La Bruzzo
|
e423634cb6
|
RollBack in case of error WORKS!!!
|
2021-01-29 17:21:42 +01:00 |
|
Sandro La Bruzzo
|
0276180039
|
WIP mdstore
transaction implemented on hadoop side
|
2021-01-29 16:42:41 +01:00 |
|
Sandro La Bruzzo
|
98b9498b57
|
Removed old messaging system not quite used from collection and Transformation workflow
code refactor
|
2021-01-28 09:51:17 +01:00 |
|
Claudio Atzori
|
0825321d0b
|
improved unit tests in dhp-aggregation
|
2020-05-05 12:39:04 +02:00 |
|
Sandro La Bruzzo
|
5a8a323f2a
|
dhp-collection-worker integrated in dhp-workflows
|
2019-10-24 11:36:59 +02:00 |
|
Claudio Atzori
|
c7654b6fe3
|
renamed collection & transformation oozie workflow files
|
2019-10-18 09:42:20 +02:00 |
|
Claudio Atzori
|
27db5afdad
|
integrating the oozie workflow build/deploy/run mechanism, took inspiration from iis
|
2019-10-17 18:38:30 +02:00 |
|
Sandro La Bruzzo
|
4b8c7c279d
|
Added documentation on a class, and reused ArgumetApplicationParser on dhp-aggregation
|
2019-10-07 17:02:53 +02:00 |