eosc_services #217

claudio.atzori · 2022-05-02T10:26:30+02:00

claudio.atzori commented

2022-05-02 10:26:30 +02:00

This PR integrates the dhp-schema module updated to host the datasource/eosc model. Consequent updates includes:

datasource/service graph mapping
serialization of the updated graph datasource entity in the XML format used for the indexing
unit tests

This PR integrates the `dhp-schema` module updated to host the datasource/eosc model. Consequent updates includes: - datasource/service graph mapping - serialization of the updated graph datasource entity in the XML format used for the indexing - unit tests

alessia.bardi was assigned by claudio.atzori

2022-05-02 10:26:30 +02:00

miriam.baglioni was assigned by claudio.atzori

2022-05-02 10:26:30 +02:00

michele.artini was assigned by claudio.atzori

2022-05-02 10:26:30 +02:00

claudio.atzori added 8 commits 2022-05-02 10:26:31 +02:00

21f32b83c6 [graph enrichment] fixed country_propagation oozie workflow definition, parameter saveGraph is not needed anymore by the SparkCountryPropagationJob

b93a141d6c [Doiboost] fixed fundingReference extraction from the Crossref records

d5b29d96a7 fix merging in crossrefAggregator which creates dataInfo null

4314db55c8 migration to services: update sql queries

c96a8613f8 update SQL queries

5ffc24d1ba EOSC Services - ongoing update

f5f532d134 EOSC Services - ongoing update

05c1ea92e9 EOSC Services - added Service-specific fields in the XML record serialization

claudio.atzori added 1 commit 2022-05-02 11:09:09 +02:00

a8c51f6f16 EOSC Services - fixed query and testing preparation

claudio.atzori added 1 commit 2022-05-02 15:52:37 +02:00

b6a7ff3a99 EOSC Services - removed fields from mapping, testing preparation

claudio.atzori added 1 commit 2022-05-02 17:03:36 +02:00

2ade69dea6 EOSC Services - minor

miriam.baglioni commented

2022-05-02 17:38:56 +02:00

To me it is OK to be merged

claudio.atzori commented

2022-05-02 17:41:32 +02:00

The updated mapping was applied to the beta contents available today (2022/05/02) to build a partial graph, materialised as Hive DB claudio_beta_aggregator.datasource

In order to verify its content I prepared a Zeppelin note available at https://iis-cdh5-test-gw.ocean.icm.edu.pl/zeppelin/#/notebook/2H4GM1F85

The updated mapping was applied to the beta contents available today (2022/05/02) to build a partial graph, materialised as Hive DB ```claudio_beta_aggregator.datasource``` In order to verify its content I prepared a Zeppelin note available at https://iis-cdh5-test-gw.ocean.icm.edu.pl/zeppelin/#/notebook/2H4GM1F85

alessia.bardi approved these changes 2022-05-02 18:05:57 +02:00

alessia.bardi left a comment

Looks ok to me

dhp-workflows/dhp-graph-mapper/src/main/resources/eu/dnetlib/dhp/oa/graph/sql/queryServices.sql

						
				@ -0,0 +162,4 @@

					d.lissn,

					d.jurisdiction,

					d.thematic,

					-- REMOVED ???: de.knowledge_graph,

alessia.bardi commented

2022-05-02 18:04:42 +02:00

Yes, removed upon request from Paolo see https://support.openaire.eu/issues/6897#note-9

claudio.atzori added 1 commit 2022-05-03 11:55:50 +02:00

9e12cb3c92 EOSC Services - removed field knowledgegraph; depending on the released schema module

claudio.atzori added 1 commit 2022-05-03 15:33:03 +02:00

bd01df8cd5 Merge branch 'beta' into eosc_services

claudio.atzori manually merged commit da611cfbbd into beta

2022-05-03 15:33:18 +02:00

claudio.atzori deleted branch eosc_services

2022-05-03 15:33:26 +02:00

claudio.atzori referenced this pull request

2022-07-13 17:05:13 +02:00

promoting beta branch to master - July 2022 #227

Sign in to join this conversation.

No reviewers

No Label

No Milestone

No project

No Assignees

3 Participants

Notifications

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#217