14 Commits

Author	SHA1	Message	Date
Claudio Atzori	4d0c59669b	merged changes from beta	2024-01-26 16:08:54 +01:00
Miriam Baglioni	67ce2d54be	[enrichment single step] refactoring to fix issues in disappeared result type	2024-01-17 16:50:00 +01:00
Miriam Baglioni	3afd4aa57b	adjustments for country propagation	2023-12-22 11:27:30 +01:00
Miriam Baglioni	d4eedada71	adjusting workflow definition	2023-12-09 15:20:11 +01:00
Miriam Baglioni	616622d2bb	first version of the workflow single step	2023-12-07 09:59:52 +01:00
Claudio Atzori	3800361033	[country propagation] fixes error 'cannot resolve countrySet given input columns: []' when there is no prepared information driving the propagation process for a given result type	2023-01-19 15:57:43 +01:00
Miriam Baglioni	5e0b8f9b5f	[CountryPropagation] refactoring	2022-05-20 09:15:53 +02:00
Miriam Baglioni	c298c148cb	[CountryPropagation] fix NPE issue	2022-05-20 09:11:46 +02:00
Miriam Baglioni	12de9acb0d	[Country Propagation] left out from previous commit	2022-03-11 14:17:02 +01:00
Miriam Baglioni	2b643059fa	[Country Propagation] changed the logic to get the collectedfrom at the result level. To fix issue when no instance is created for a result that should have the country associated. Change the code to use spark instead of hive to prepare the data needed for the propagation step. Added new tests for the intermediate steps and new verification for the propagation itself	2022-03-11 13:56:48 +01:00
Claudio Atzori	2ee21da43b	suggestions from SonarLint	2021-08-11 12:13:22 +02:00
Claudio Atzori	23b8883ab1	applied intellij code cleanup	2021-05-14 10:58:12 +02:00
Claudio Atzori	ab37953332	added global properties in wf definitions to avoid repeating name-node and job-tracker in the (many) distcp actions; reintroduced output directory removal at the beginning of each spark action	2020-05-14 10:25:41 +02:00
Claudio Atzori	6d0b11252e	bulktagging wfs moved into common dhp-enrichment module	2020-05-11 17:32:06 +02:00