 Michele Artini
|
da65728afe
|
produce a parquet file
|
2024-02-15 14:04:17 +01:00 |
|
Michele Artini
|
e254720377
|
fixed path reports
|
2024-02-15 08:52:28 +01:00 |
|
Michele Artini
|
8d85c1e97e
|
used a parser STAX
|
2024-02-15 08:21:52 +01:00 |
|
Michele Artini
|
b42e2b4d61
|
fixed log class
|
2024-02-14 15:52:31 +01:00 |
|
Michele Artini
|
773346f638
|
increased memory
|
2024-02-14 14:40:27 +01:00 |
|
Michele Artini
|
2e11197142
|
removed invalid deletion
|
2024-02-14 11:59:30 +01:00 |
|
Michele Artini
|
ddd6a7ceb3
|
minor fixes
|
2024-02-14 11:39:37 +01:00 |
|
Michele Artini
|
963a2500be
|
new reports in hadoop job
|
2024-02-14 10:37:39 +01:00 |
|
Michele Artini
|
4b1ecad4e2
|
prepared a job to analyze the BASE records
|
2024-02-13 13:48:26 +01:00 |
|
Michele Artini
|
dd7350ecf2
|
fixed a problem with xpaths
|
2024-02-13 08:36:42 +01:00 |
|
Michele Artini
|
265bfd364d
|
refactoing
|
2024-02-12 15:35:36 +01:00 |
|
Michele Artini
|
16766c514e
|
refactoring
|
2024-02-12 12:19:57 +01:00 |
|
Michele Artini
|
5add433b74
|
partial refactoring
|
2024-02-09 14:33:04 +01:00 |
|
Michele Artini
|
c974c75f83
|
partial refactoring
|
2024-02-09 12:36:20 +01:00 |
|
Michele Artini
|
c6db6335b9
|
prepare filtering for base import
|
2024-02-06 15:10:29 +01:00 |
|
Michele Artini
|
abcd81bba0
|
first implementation of the collection plugin for BASE
|
2024-02-05 15:19:41 +01:00 |
 Claudio Atzori
|
f28c63d5ef
|
[orcid enrichment] fixed directory cleanup before distcp
|
2024-02-05 09:44:56 +02:00 |
|
Claudio Atzori
|
1a8b609ed2
|
code formatting
|
2024-01-30 11:34:16 +01:00 |
 Miriam Baglioni
|
4c8706efee
|
[orcid-enrichment] change the value of parameters.
|
2024-01-29 18:21:36 +01:00 |
|
Claudio Atzori
|
4d0c59669b
|
merged changes from beta
|
2024-01-26 16:08:54 +01:00 |
|
Claudio Atzori
|
bf99c424fa
|
Merge pull request 'Fixed problem on missing author in crossref Mapping' (#383) from crossref_missing_author_fix into beta
Reviewed-on: #383
|
2024-01-26 15:57:23 +01:00 |
|
Claudio Atzori
|
ce3200263e
|
Merge branch 'beta' into crossref_missing_author_fix
|
2024-01-26 15:57:04 +01:00 |
Sandro La Bruzzo
|
e889808daa
|
Fixed problem on missing author in crossref Mapping
|
2024-01-26 12:19:04 +01:00 |
|
Claudio Atzori
|
9e8fc6aa88
|
[collection] increased logging from the oai-pmh metadata collection process
|
2024-01-26 09:17:20 +01:00 |
 Antonis Lempesis
|
a7115cfa9e
|
max mem of joins (hive.mapjoin.followby.gby.localtask.max.memory.usage) now 80%, up from 55%.
|
2024-01-25 15:13:16 +01:00 |
|
Claudio Atzori
|
2838a9b630
|
Update 'CONTRIBUTING.md'
|
2024-01-24 16:07:05 +01:00 |
|
Claudio Atzori
|
da944a5c55
|
Merge pull request 'code of conduct and contributing' (#382) from contributing into beta
Reviewed-on: #382
|
2024-01-24 15:40:26 +01:00 |
|
Claudio Atzori
|
0c97a3a81a
|
minor
|
2024-01-24 10:56:33 +01:00 |
|
Claudio Atzori
|
2c1e6849f0
|
added code of conduct and contributing files
|
2024-01-24 10:36:41 +01:00 |
|
Claudio Atzori
|
9b13c22e5d
|
[graph provision] retrieve all the context information by adding all=true to the requests issued to thr API
|
2024-01-23 15:36:08 +01:00 |
|
Claudio Atzori
|
3e96777cc4
|
[collection] increased logging from the oai-pmh metadata collection process
|
2024-01-23 15:21:03 +01:00 |
|
Claudio Atzori
|
9812406589
|
Merge pull request '[graph provision] updated param specification for the XML converter job' (#380) from provision_community_api into beta
Reviewed-on: #380
|
2024-01-23 08:55:59 +01:00 |
|
Claudio Atzori
|
f87f3a6483
|
[graph provision] updated param specification for the XML converter job
|
2024-01-23 08:54:37 +01:00 |
|
Claudio Atzori
|
6fd25cf549
|
code formatting
|
2024-01-23 08:47:12 +01:00 |
|
Claudio Atzori
|
bd187ec6e7
|
Merge pull request 'Implements pivots table update oozie workflow' (#376) from update_pivots_table into beta
Reviewed-on: #376
|
2024-01-22 16:37:30 +01:00 |
|
Claudio Atzori
|
f76852f385
|
Merge branch 'beta' into update_pivots_table
|
2024-01-22 16:37:22 +01:00 |
|
Claudio Atzori
|
b9fcc5ad5e
|
Merge pull request 'Context API update' (#379) from provision_community_api into beta
Reviewed-on: #379
|
2024-01-22 15:55:33 +01:00 |
|
Claudio Atzori
|
1c6db320f4
|
[graph provision] obtain context info from the context API instead from the ISLookUp service
|
2024-01-22 15:53:17 +01:00 |
|
Claudio Atzori
|
2655eea5bc
|
[orcid enrichment] drop paths before copying the non-modifyed contents
|
2024-01-19 16:28:05 +01:00 |
|
Claudio Atzori
|
c6b3401596
|
increased shuffle partitions for publications in the country propagation workflow
|
2024-01-19 10:15:39 +01:00 |
|
Miriam Baglioni
|
bcc0a13981
|
[enrichment single step] adding <end> element in wf definition
|
2024-01-18 17:39:14 +01:00 |
|
Miriam Baglioni
|
6af536541d
|
[enrichment single step] moving parameter file in correct location
|
2024-01-18 15:35:40 +01:00 |
|
Miriam Baglioni
|
a12a3eb143
|
-
|
2024-01-18 15:18:10 +01:00 |
|
Claudio Atzori
|
628fdfb5eb
|
Merge pull request '[enrichment single step]' (#378) from enrichmentSingleStepFixed into beta
Reviewed-on: #378
|
2024-01-18 09:41:09 +01:00 |
|
Miriam Baglioni
|
82e9e262ee
|
[enrichment single step] remove parameter from execution
|
2024-01-17 17:38:03 +01:00 |
|
Miriam Baglioni
|
67ce2d54be
|
[enrichment single step] refactoring to fix issues in disappeared result type
|
2024-01-17 16:50:00 +01:00 |
|
Miriam Baglioni
|
59eaccbd87
|
[enrichment single step] refactoring to fix issue in disappeared result type
|
2024-01-15 17:49:54 +01:00 |
 Giambattista Bloisi
|
21a14fcd80
|
Reusable RunSQLSparkJob for executing SQL in Spark through Oozie Spark Actions
Implements pivots table update oozie workflow
|
2024-01-15 10:18:14 +01:00 |
|
Claudio Atzori
|
2d302e6827
|
Merge pull request '[FoS integration]fix issue on FoS integration. Removing the null values from FoS' (#375) from fosPreparationBeta into beta
Reviewed-on: #375
|
2024-01-12 10:27:28 +01:00 |
|
Miriam Baglioni
|
f612125939
|
fix issue on FoS integration. Removing the null values from FoS
|
2024-01-12 10:20:28 +01:00 |