FOS ActionSet for the classification of results without a doi #397

miriam.baglioni · 2024-03-07T10:42:26+01:00

miriam.baglioni commented

2024-03-07 10:42:26 +01:00

This PR extends the integration of the FOS classification by creating an action set to include also the classification for results without a DOI.
The code slishtly changes the implementation for the integration of FOS with the unresolved entity workflow (no need to chenage the parameters in this case)

This PR extends the integration of the FOS classification by creating an action set to include also the classification for results without a DOI. The code slishtly changes the implementation for the integration of FOS with the unresolved entity workflow (no need to chenage the parameters in this case)

claudio.atzori was assigned by miriam.baglioni

2024-03-07 10:42:26 +01:00

miriam.baglioni added 38 commits 2024-03-07 10:42:27 +01:00

1a42a5c10d Implemented Download update of ORCID

8f61063201 Added workflow

9d5a7c3b22 code refactor

39ebb60b38 Merge remote-tracking branch 'origin/beta' into orcid_update

859babf722 added some useful comment

e328bc0ade fixed missing parameter on download update

e0753f19da Fixed error of connection timeout

43e0bba7ed logg added during download

0386f36385 Added workflow to update ORCID and replaced some parsing, because the update works and employments xml differs from the dump one.

078df0b4d1 Use SparkSQL in place of Hive for executing step16-createIndicatorsTables.sql of stats update wf

926903b06b Merge branch 'beta' into stats_with_spark_sql

f804c58bc7 Merge pull request 'Use SparkSQL in place of Hive for executing step16-createIndicatorsTables.sql of stats update wf' (#386 ) from stats_with_spark_sql into beta

Reviewed-on: #386

a5995ab557 [orcid-enrichment] change the value of parameters.

f2a08d8cc2 test for Italian records from IRS repositories

42f5506306 [orcid enrichment] fixed directory cleanup before distcp

bb82052c40 [graph cleaning] rule out datasources without an officialname

009dcf6aea [actiosets] introduced support for the PromoteAction strategy

fd17c1f17c [actiosets] fixed join type

38c9001147 fixed import of ORPs stored on HDFS in the internal graph format (e.g. Datacite)

e6bdee86d1 Merge pull request 'Support for the PromoteAction strategy' (#389 ) from promote_actions_join_type into beta

Reviewed-on: #389

b19643f6eb Dedup aliases, created when a dedup in a previous build has been merged in a new dedup, need to be marked as "deletedbyinference", since they are "merged" in the new dedup

d85d2df6ad [graph raw] fixed mapping of the original resource type from the Datacite format

29194472a7 Promote "Research" to a jolly instanceType in dedup comparisons

Compare Part of book or chapter of book with Article

d65285da7f Promote "Research" to a jolly instanceType in dedup comparisons

Compare "Journal" and "Part of book or chapter of book" with "Article"

85aeff72f1 Merge pull request 'Revised instance type comparisons in dedup phase' (#393 ) from revisedInstanceType into beta

Reviewed-on: #393

a63b091bae Merge branch 'beta' into import_orps_fix

753c2a72bd Merge pull request 'fix import of ORPs' (#390 ) from import_orps_fix into beta

Reviewed-on: #390

3268570b2c mapping of project PIDs

b32a9d1994 Implemented workflow for updating table , added step to check if the new generated table is valid

a712df1e1d Merge remote-tracking branch 'origin/beta' into orcid_update

773e856550 Revised procedure when converting json data into xml:

- json object keys are renamed to be conformant to xml tag elements, special characters are substituted or removed
- json string values are no longer post-processed as they are already escaped by the org.json.XML.toString method

915a76a796 following the comment on the pull requests:

- Added #NUM_OF_THREADS complete job in the queue at the end of  the main loop to avoid deadlock

b63994dcc4 Merge remote-tracking branch 'origin/beta' into orcid_update

e468e99100 Merge pull request 'Orcid Update Procedure' (#394 ) from orcid_update into beta

Reviewed-on: #394

7d806a434c formatted code

56dd05f85c Merge pull request 'Revised procedure when converting json data into xml' (#395 ) from restiterator_xmlcleanup into beta

Reviewed-on: #395

3cd5590f3b When converting json to XML, remove characters that are not allowed in the XML 1.0 specs, as they will cause xpath failures even if escaped

7827a2d66b [OCNEW] added creation of the actionset for the results classified with FoS based ont he OpenAIRE identifier

miriam.baglioni changed target branch from master to beta

2024-03-07 10:42:48 +01:00

miriam.baglioni added 1 commit 2024-03-07 10:47:19 +01:00

5180b6ec8a [FOSNEW] removed test class

miriam.baglioni commented

2024-03-13 14:29:57 +01:00

We need to extend the deployment workflow for the creation of the AS for FOS no doi

claudio.atzori added 1 commit 2024-03-25 16:07:39 +01:00

9a5b134ddf Merge branch 'beta' into FOSNew

claudio.atzori merged commit e9eb590f87 into beta

2024-03-25 16:07:48 +01:00

claudio.atzori referenced this issue from a commit

2024-03-25 16:07:48 +01:00

Merge pull request 'FOS ActionSet for the classification of results without a doi' (#397) from FOSNew into beta

claudio.atzori referenced this pull request

2024-05-21 14:10:55 +02:00

beta to master May 2024 #437

Sign in to join this conversation.

No reviewers

No Label

No Milestone

No project

No Assignees

2 Participants

Notifications

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#397