Michele De Bonis

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-04-14 18:07:17 +02:00

176a5e493d Merge branch 'stable_ids' of code-repo.d4science.org:D-Net/dnet-hadoop into stable_ids

3525a8f504 id generation of representative record moved to the SparkCreateMergeRel job

Compare 2 commits »

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-04-13 10:15:52 +02:00

1542196a33 bug fix: starting node of duplicate scan wf changed

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-04-13 09:08:10 +02:00

369ed1cd8a bug fix: lookupurl parameter added to dedup record job

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-04-12 15:56:28 +02:00

d442e25cbc bug fix: ids in self mergerels are not marked deletedbyinference=true

michele.debonis pushed to master at D-Net/dnet-hadoop

2021-04-12 15:55:32 +02:00

dcff9cecdf bug fix: ids in self mergerels are not marked deletedbyinference=true

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-04-08 11:51:53 +02:00

11b22b2d23 bug fix in the query, it now exports only relations with non-hidden organizations

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-04-07 18:42:23 +02:00

0857100fb8 implementation of the tests for the openorgs integration in the openaire provision

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-04-07 14:27:50 +02:00

bf685d849f addition of pids in the query for the export of openorgs for the provision, addition of ec_fields in the openorgs model

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-04-06 14:35:58 +02:00

eaaefb8b4c implementation of the procedure to reuse content of different dbs when creating the raw graph

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-04-06 14:31:12 +02:00

c39c82dfe9 modification of the jobs for the integration of openorgs in the provision, dedup records are no more created by merging but simply taking results of openorgs portal

michele.debonis pushed to openorgswf at D-Net/dnet-hadoop

2021-03-29 16:39:41 +02:00

2709d08fc2 Merge branch 'stable_ids' into openorgswf

3becaa5539 [Cleaning] drop alternate identifiers with empty values

a0837ac357 [Stats update] integrating PR#100 for testing #100

48f2b6127e [Cleaning] drop alternate identifiers with empty values

1dfda3624e improved workflow importing datacite

Compare 100 commits »

michele.debonis created pull request D-Net/dnet-hadoop#102

2021-03-29 16:27:36 +02:00

OpenOrgs dedup and Integration with OpenAIRE Provision

michele.debonis pushed to openorgswf at D-Net/dnet-hadoop

2021-03-29 16:10:53 +02:00

f446580e9f code refactoring (useless classes and wf removed), implementation of the test for the openorgs dedup

michele.debonis pushed to openorgswf at D-Net/dnet-hadoop

2021-03-29 10:07:19 +02:00

2355cc4e9b minor changes and bug fix

michele.debonis pushed to openorgswf at D-Net/dnet-hadoop

2021-03-25 10:44:56 +01:00

28c1cdd132 merged stable_ids into openorgswf

0fe40b08e4 addition of deduplication profiles for the results, double check on pids and the title with a lower threshold

5a043e95ea code formatting

a4e82a65aa integrated filter applied when merging BETA & PROD graphs to rule our records from Datacite

3256b9c836 code formatting

Compare 250 commits »

michele.debonis pushed to openorgswf at D-Net/dnet-hadoop

2021-03-25 10:29:39 +01:00

5dfb66b0fa minor changes

michele.debonis pushed to openorgswf at D-Net/dnet-hadoop

2021-03-24 15:51:32 +01:00

348b0ef921 bug fix, implementation of the workflow for the creation of raw_organizations (openorgs dedup), addition of the pid lists to the openorgs postgres db

michele.debonis pushed to stable_ids at D-Net/dnet-hadoop

2021-03-19 17:12:11 +01:00

0fe40b08e4 addition of deduplication profiles for the results, double check on pids and the title with a lower threshold

michele.debonis pushed to openorgswf at D-Net/dnet-hadoop

2021-03-19 16:57:49 +01:00

98854b0124 minor changes

michele.debonis pushed to openorgswf at D-Net/dnet-hadoop

2021-02-26 10:19:35 +01:00

1a85020572 bug fix in graph-mapper, changes in the implementation of the openorgs wf to create relations and populate openorgs db