H2020Classification fix and possibility to add datasources in blacklist for propagation of result to organization #108

miriam.baglioni · 2021-05-20T15:01:00+02:00

miriam.baglioni commented

2021-05-20 15:01:00 +02:00

This PR fixes an issue while building the h2020classification action set. The name of two of the files changed as well as the name of the sheet to be red while getting topic information. THe sheet name is now a parameter and when missing an exception is fired.

miriam.baglioni added 11 commits 2021-05-20 15:01:01 +02:00

fe36895c53 added datasource blacklist for the organization to result propagation through institutional repositories

6190465851 merge upstream

2f5e6647c6 merge upstream

896919e735 merge upstream

4b6e514f02 merge upstream

70e391d427 merge upstream

7d1b8b7f64 merge upstream

4ae6fba01d refactoring

72e5aa3b42 refactoring

02b80cf24f resolved conflicts

dc0ad8d2e0 fixed issue related to change in the file name downloaded. Added sheet name as parameter and also a check if the name should change

claudio.atzori was assigned by miriam.baglioni

2021-05-20 15:01:25 +02:00

miriam.baglioni added the

enhancement

label 2021-05-20 15:01:35 +02:00

claudio.atzori added 1 commit 2021-05-20 15:22:37 +02:00

b572f56763 Merge branch 'master' into master

claudio.atzori merged commit 2e70aa43f0 into master

2021-05-20 15:25:05 +02:00

claudio.atzori referenced this issue from a commit

2021-05-20 15:25:05 +02:00

Merge pull request 'H2020Classification fix and possibility to add datasources in blacklist for propagation of result to organization' (#108) from miriam.baglioni/dnet-hadoop:master into master

claudio.atzori commented

2021-05-20 15:25:30 +02:00

The changes look ok, but please drop a comment to describe how the parameters should be changed from the workflow caller for both workflows

H2020Classification
propagation of result to organization

The changes look ok, but please drop a comment to describe how the parameters should be changed from the workflow caller for both workflows * H2020Classification * propagation of result to organization

miriam.baglioni commented

2021-05-20 16:49:23 +02:00

for the h2020classification the parameters are four:

The URL to download the project file
param name : projectFileURL
param value : https://cordis.europa.eu/data/cordis-h2020projects.csv

The URL to download the programme file
param name : programmeFileURL
param value : https://cordis.europa.eu/data/reference/cordisref-h2020programmes.csvt

The URL to download the topics file
param name : topicFileURL
param value : https://cordis.europa.eu/data/reference/cordisref-h2020topics.xlsx

The name of the sheet in the topic file to be read
param name. : sheetName
param value : Topics

for the propagation workflow, the added parameter is optional.
It allows to specify a set of institutional repository for which not to apply the propagation strategy

param name : blacklist
param value : the list of datasource id we want to add to the blacklist split by ;

for the h2020classification the parameters are four: The URL to download the project file param name : projectFileURL param value : https://cordis.europa.eu/data/cordis-h2020projects.csv The URL to download the programme file param name : programmeFileURL param value : https://cordis.europa.eu/data/reference/cordisref-h2020programmes.csvt The URL to download the topics file param name : topicFileURL param value : https://cordis.europa.eu/data/reference/cordisref-h2020topics.xlsx The name of the sheet in the topic file to be read param name. : sheetName param value : Topics for the propagation workflow, the added parameter is optional. It allows to specify a set of institutional repository for which not to apply the propagation strategy param name : blacklist param value : the list of datasource id we want to add to the blacklist split by ;

Sign in to join this conversation.

No reviewers