Support for the PromoteAction strategy [master]
#391
Merged
claudio.atzori
merged 2 commits from promote_actions_join_type_master
into master
3 months ago
Loading…
Reference in New Issue
There is no content yet.
Delete Branch 'promote_actions_join_type_master'
Deleting a branch is permanent. It CANNOT be undone. Continue?
This PR introduces support for two strategies the workflow can use to promote the actionset contents in the graph.
So far the only strategy assumed to upsert each record against the corresponding entity table, merging with the records matched by OpenAIRE id and inserting those that do not match. This turned out to be introducing noisy or stable records often contained in the actionset, which pollute the graph and may cause failures along the graph processing pipeline.
The upsert strategy continues to be the default one, but this modification allows the workflow caller to speficy a different one, named
ENRICH
, which only updates the matching records, while discarding the non-matching ones.Hence, the oozie workflow definition now suppoerts a new optional parameter named
promoteActionStrategy
that can assume two valuesUPSERT
(default)ENRICH
f21133229a
into master 3 months agof21133229a
.Step 1:
From your project repository, check out a new branch and test the changes.Step 2:
Merge the changes and update on Gitea.