implementation of the whitelist for similarity relations #144

michele.debonis · 2021-09-20T16:27:21+02:00

michele.debonis commented

2021-09-20 16:27:21 +02:00

Implementation of a new Job for the Scan WF (de-duplication).
The job takes the whitelist file path to add whitelisted similarity relations to the relations calculated by the dedup algorithm.
File format: source_id####target_id (1 per line)

Implementation of a new Job for the Scan WF (de-duplication). The job takes the whitelist file path to add whitelisted similarity relations to the relations calculated by the dedup algorithm. File format: source_id####target_id (1 per line)

michele.debonis added 1 commit 2021-09-20 16:27:22 +02:00

853333bdde implementation of the whitelist for similarity relations

claudio.atzori added 1 commit 2021-09-22 11:31:20 +02:00

7fa60e166e Merge branch 'beta' into dedup_whitelist

claudio.atzori added 1 commit 2021-09-27 16:41:26 +02:00

474117c2e8 Merge branch 'beta' into dedup_whitelist

claudio.atzori merged commit 35619b93ee into beta

2021-09-27 16:47:41 +02:00

claudio.atzori referenced this issue from a commit

2021-09-27 16:47:41 +02:00

Merge pull request 'implementation of the whitelist for similarity relations' (#144) from dedup_whitelist into beta

claudio.atzori commented

2021-09-27 16:53:36 +02:00

Note for updating the dnet workflow: the only parameter we need to introduce is the whiteListPath pointing to the HDFS location of the whitelist file.

Note for updating the dnet workflow: the only parameter we need to introduce is the `whiteListPath` pointing to the HDFS location of the whitelist file.

claudio.atzori referenced this pull request

2021-10-11 17:29:24 +02:00

promoting beta branch to master - October 2021 #149

Sign in to join this conversation.

No reviewers