Remove Relation From AS #466

miriam.baglioni · 2024-07-25T15:47:17+02:00

miriam.baglioni commented

2024-07-25 15:47:17 +02:00

This PR is to modify the webcrawl actionset to remove some of the relations that are found to be wrong.
We need to include a new parameter

resumeFrom=remove

the others set be the user should be

sourcePath = /var/lib/dnet/actionManager_PROD/webcrawl/rawset_28247629-468b-478e-9a42-bc540877125d_1718121542061/
blackListPath=/user/miriam.baglioni/oalexBlackListNormalized

This PR is to modify the webcrawl actionset to remove some of the relations that are found to be wrong. We need to include a new parameter resumeFrom=remove the others set be the user should be sourcePath = /var/lib/dnet/actionManager_PROD/webcrawl/rawset_28247629-468b-478e-9a42-bc540877125d_1718121542061/ blackListPath=/user/miriam.baglioni/oalexBlackListNormalized

claudio.atzori was assigned by miriam.baglioni

2024-07-25 15:47:17 +02:00

miriam.baglioni added 4 commits 2024-07-25 15:47:17 +02:00

6f1801d7d1 [webcrawl]-

fc60661ac5 [webcrawl] added code and test (code/resource) to verify the deletion of the relations related to results put in blacklist

7cff281d3e [webcrawl] the blacklist is now in json and no more in csv after the normalization process

c7f6669f1a [webcrawl] the blacklist is now in json and no more in csv after the normalization process

miriam.baglioni added 1 commit 2024-07-25 15:48:14 +02:00

1af6571474 merging with branch beta

claudio.atzori merged commit 8f551afa52 into beta

2024-07-25 15:50:20 +02:00

claudio.atzori referenced this issue from a commit