Support for the PromoteAction strategy
#389
Merged
claudio.atzori
merged 2 commits from promote_actions_join_type
into beta
3 months ago
Loading…
Reference in New Issue
There is no content yet.
Delete Branch 'promote_actions_join_type'
Deleting a branch is permanent. It CANNOT be undone. Continue?
This PR introduces support for two strategies the workflow can use to promote the actionset contents in the graph.
So far the only strategy assumed to upsert each record against the corresponding entity table, merging with the records matched by OpenAIRE id and inserting those that do not match. This turned out to be introducing noisy or stable records often contained in the actionset, which pollute the graph and may cause failures along the graph processing pipeline.
The upsert strategy continues to be the default one, but this modification allows the workflow caller to speficy a different one, named
ENRICH
, which only updates the matching records, while discarding the non-matching ones.Hence, the oozie workflow definition now suppoerts a new optional parameter named
promoteActionStrategy
that can assume two valuesUPSERT
(default)ENRICH
@giambattista.bloisi @miriam.baglioni can you review these changes? Thanks!
e6bdee86d1
into beta 3 months agoReviewers
e6bdee86d1
.Step 1:
From your project repository, check out a new branch and test the changes.Step 2:
Merge the changes and update on Gitea.