Miriam Baglioni
|
3afd4aa57b
|
adjustments for country propagation
|
2023-12-22 11:27:30 +01:00 |
Miriam Baglioni
|
4740c808f7
|
-
|
2023-12-20 14:26:54 +01:00 |
Miriam Baglioni
|
d4eedada71
|
adjusting workflow definition
|
2023-12-09 15:20:11 +01:00 |
Miriam Baglioni
|
616622d2bb
|
first version of the workflow single step
|
2023-12-07 09:59:52 +01:00 |
Claudio Atzori
|
b0fed1725e
|
avoid NPEs
|
2023-10-19 12:13:45 +02:00 |
Miriam Baglioni
|
fae681fea1
|
[Country Propagation] add check to avoid NPE on datasource.getDatasourceType().getClassis()
|
2022-07-03 17:39:58 +02:00 |
Miriam Baglioni
|
5e0b8f9b5f
|
[CountryPropagation] refactoring
|
2022-05-20 09:15:53 +02:00 |
Miriam Baglioni
|
c298c148cb
|
[CountryPropagation] fix NPE issue
|
2022-05-20 09:11:46 +02:00 |
Claudio Atzori
|
f430029596
|
cleanup
|
2022-03-11 14:28:28 +01:00 |
Miriam Baglioni
|
12de9acb0d
|
[Country Propagation] left out from previous commit
|
2022-03-11 14:17:02 +01:00 |
Miriam Baglioni
|
2b643059fa
|
[Country Propagation] changed the logic to get the collectedfrom at the result level. To fix issue when no instance is created for a result that should have the country associated. Change the code to use spark instead of hive to prepare the data needed for the propagation step. Added new tests for the intermediate steps and new verification for the propagation itself
|
2022-03-11 13:56:48 +01:00 |
Claudio Atzori
|
2ee21da43b
|
suggestions from SonarLint
|
2021-08-11 12:13:22 +02:00 |
Claudio Atzori
|
23b8883ab1
|
applied intellij code cleanup
|
2021-05-14 10:58:12 +02:00 |
Miriam Baglioni
|
55e24c2547
|
relclass for relation and corresponding values have been put to lower case (isSupplementedBy wrote as IsSupplementedBy - orcid propagation)
|
2020-08-18 16:42:08 +02:00 |
Miriam Baglioni
|
b258f99ece
|
fix for issue that duplicated result
|
2020-05-25 10:26:48 +02:00 |
Claudio Atzori
|
a832658296
|
code formatting
|
2020-05-15 10:21:09 +02:00 |
Miriam Baglioni
|
f25db01664
|
changed in the constant from propagationconstants to modelconstants
|
2020-05-14 18:29:24 +02:00 |
Claudio Atzori
|
ab37953332
|
added global properties in wf definitions to avoid repeating name-node and job-tracker in the (many) distcp actions; reintroduced output directory removal at the beginning of each spark action
|
2020-05-14 10:25:41 +02:00 |
Claudio Atzori
|
6d0b11252e
|
bulktagging wfs moved into common dhp-enrichment module
|
2020-05-11 17:32:06 +02:00 |