463 Commits

Author	SHA1	Message	Date
Miriam Baglioni	1e952cccf6	Hosted By Map - refactoring and deletion of not needed methods	2021-08-04 10:15:43 +02:00
Miriam Baglioni	8ba8c77f92	Hosted By Map - refactoring	2021-08-04 10:14:57 +02:00
Miriam Baglioni	8f7623e77a	Hosted By Map - refactoring and application of the new aggregator	2021-08-04 10:14:20 +02:00
Miriam Baglioni	a7bf314fd2	Hosted By Map - added new aggregator to get just one result per datasource id	2021-08-04 10:13:30 +02:00
Miriam Baglioni	461b8a29a0	removed not needed class	2021-08-03 10:46:51 +02:00
Miriam Baglioni	327cddde33	Hosted By Map - refactoring	2021-08-03 10:44:13 +02:00
Miriam Baglioni	1e859706a3	Hosted By Map - Classes to apply the HBM to results and datasources	2021-08-02 19:35:23 +02:00
Miriam Baglioni	72df8f9232	Hosted By Map - removed the aggregator for the datasource (it is no more needed) and added a new aggregator for the results. Changed also the hostedBYMap aggregator	2021-08-02 19:34:44 +02:00
Miriam Baglioni	ff1ce75e33	Hosted By Map - modification in the code to prepare the info needed to apply the HostedByMap. There is no need to join datasources with the hbm: all the information needed is in the hosted by map already	2021-08-02 19:32:59 +02:00
Miriam Baglioni	7c6ea2f4c7	Hosted By Map - first attempt for the creation of intermedia information to be used to applu the hosted by map on the graph entities	2021-07-30 17:56:27 +02:00
Miriam Baglioni	d8b9b0553b	Hosted By Map - model classes to store the intermediate information to be used to apply the hosted by map	2021-07-30 17:55:39 +02:00
Miriam Baglioni	613bd3bde0	Hosted By Map - refactor of the first attemp to prepare a new hosted by map dependent on the datasource in the graph and on two external sources: the gold list from unibi ad the doaj list of open access journal. Both the lists are downloaded from provided url parameter	2021-07-30 17:54:45 +02:00
Miriam Baglioni	d1807781c0	mergin with branch beta	2021-07-30 14:34:07 +02:00
Miriam Baglioni	1d6ac3715b	merge branch with beta	2021-07-30 11:58:29 +02:00
Claudio Atzori	19620eed46	applying PR#131, Patch the identifiers (source/target) in the relations, refinements	2021-07-30 11:09:32 +02:00
Miriam Baglioni	baad01cadc	hostedbymap	2021-07-29 13:04:39 +02:00
Claudio Atzori	e87e1805c4	[raw_all] added extra workflow step for patching the identifiers in the relations, given an id mapping dataset	2021-07-29 12:13:06 +02:00
Miriam Baglioni	0424f47494	HostedByMap fixing issues	2021-07-28 10:24:13 +02:00
Miriam Baglioni	eb07f7f40f	Hosted By Map	2021-07-27 12:27:26 +02:00
Claudio Atzori	65934888a1	adding record identifier among the originalIds regardless of what IdentifierFactory produces	2021-07-19 17:52:52 +02:00
Claudio Atzori	0977baf41d	contents mapped from the stores with 'claim' interpretation will not change their identifier along their way towards the graph	2021-07-19 17:43:52 +02:00
Sandro La Bruzzo	bbe8193930	merged stable ids	2021-07-12 17:00:43 +02:00
Claudio Atzori	b7b8e0986e	[raw_all] The claim merge procedure includes the claimed contexts in the merged result	2021-07-08 10:42:31 +02:00
Claudio Atzori	fdcff42e46	[raw_all] Aggregator graph creation merges claims (updates) with the corresponding entity	2021-07-07 19:01:59 +02:00
Claudio Atzori	32bdfdccbc	[raw_all] Aggregator graph creation merges claims (updates) with the corresponding entity	2021-07-07 11:08:27 +02:00
Claudio Atzori	f580cb77e1	added mapping for claim relation 'resultResult_publicationDataset_isRelatedTo' (present on BETA)	2021-07-06 21:11:11 +02:00
Sandro La Bruzzo	ad50415167	Merge remote-tracking branch 'origin/stable_ids' into stable_id_scholexplorer	2021-06-24 17:20:50 +02:00
Claudio Atzori	50fc5a64a0	[raw_all] Aggregator graph creation merges claims (updates) with the corresponding entity	2021-06-23 11:49:42 +02:00
Sandro La Bruzzo	3100166d29	Merge remote-tracking branch 'origin/stable_ids' into stable_id_scholexplorer	2021-06-16 16:22:16 +02:00
Claudio Atzori	7243a40c88	code formatting	2021-06-16 15:03:03 +02:00
Michele Artini	ada063ce70	fixed a problem with empty mdstore list (2)	2021-06-14 12:04:47 +02:00
Michele Artini	83132ee99a	fixed a problem with empty mdstore list	2021-06-14 11:57:00 +02:00
Sandro La Bruzzo	aeb8132627	Merged branch stable_ids	2021-06-14 10:07:29 +02:00
Claudio Atzori	2039bb9f5f	orcid / orcid_pending cleaning backported from master branch	2021-06-14 09:40:50 +02:00
Sandro La Bruzzo	5b724d9972	added relations to datacite mapping	2021-06-04 10:14:22 +02:00
Michele Artini	ede2749822	orcid pid type	2021-06-01 12:42:43 +02:00
Michele Artini	f0fbfdcfae	Merge branch 'stable_ids' into import_new_mdstores	2021-06-01 12:03:00 +02:00
Michele Artini	03a510859a	removed coalesce(1)	2021-05-31 14:10:51 +02:00
Michele Artini	e9f2b6037c	patch of mdstore records	2021-05-31 11:36:26 +02:00
Michele Artini	ad56a44fda	save as gzipped sequence file	2021-05-28 14:45:39 +02:00
Michele Artini	4fa5671d16	first implementation of Hdfs Mdstores Importer	2021-05-27 16:22:07 +02:00
Claudio Atzori	5e4b91d9ef	more pervasive use of constants from ModelConstants, especially for ORCID	2021-05-26 18:20:23 +02:00
Claudio Atzori	9d725efdc1	reverted implementation of the mdstore client	2021-05-20 18:26:09 +02:00
Claudio Atzori	ae5c28e54f	code formatting	2021-05-20 16:13:06 +02:00
Claudio Atzori	232dce83db	fixes #6701: xpath for titles to support both datacite and Guidelines v4 mapping	2021-05-20 14:41:15 +02:00
Claudio Atzori	23b8883ab1	applied intellij code cleanup	2021-05-14 10:58:12 +02:00
Claudio Atzori	d4c3476152	mapping datasource.journal only when an issn is available, null otherwhise	2021-05-11 11:08:54 +02:00
Claudio Atzori	d1cbee8413	imported methods from CleaningFunctions, defined in GraphCleaningFunctions	2021-05-10 16:43:39 +02:00
Claudio Atzori	dccaf173cf	fixed mapping applied to ODF records. Added unit test to verify the mapping for OpenTrials	2021-05-05 16:36:15 +02:00
Claudio Atzori	923d19ea8e	mdstore read lock/unlock when bulk copying records from mongodb to hdfs	2021-05-04 18:06:21 +02:00