314 Commits

Author	SHA1	Message	Date
Miriam Baglioni	071cc95afb	[orcipPropagation] test to verify the merge for multiple enrichment from multiple sources. It covers also the check for persistency of other identifiers types	2024-12-20 14:41:09 +01:00
Miriam Baglioni	29611b2091	[orcipPropagation]rewritten in scala. generategraph again not abstract	2024-12-20 12:40:33 +01:00
Miriam Baglioni	1853da1e2c	[orcipPropagation] moved from joinWith to join not lo loose the schema, and removed the field matched.col(id) since there is no more Seq(id)	2024-12-20 11:35:11 +01:00
Miriam Baglioni	7752d47776	[orcipPropagation]changes for merge for propagation	2024-12-20 10:20:32 +01:00
Miriam Baglioni	a9ccd00483	[orcidPropagatio] -	2024-12-20 08:35:17 +01:00
Miriam Baglioni	ec4a90f669	[orcidPropagatio] added specific classid and classname for pid qualifier	2024-12-19 11:03:09 +01:00
Miriam Baglioni	345d69d11b	[orcidPropagatio] changed the test to include parameter and changed the values for the new resources	2024-12-19 11:02:42 +01:00
Miriam Baglioni	d9be4a36d4	[orcidPropagatio] chenaged resources since the code assumes to have bidirectionality in the relations	2024-12-19 11:01:25 +01:00
Miriam Baglioni	668706a2e3	[orcidPropagatio] changed to avoid searching relations only within the same type of results	2024-12-19 11:00:55 +01:00
Giambattista Bloisi	71fe0374dc	Revise propagation tests	2024-12-17 16:01:03 +01:00
Giambattista Bloisi	6260526fa1	[orcidenrichment] Fix imports and formatting	2024-12-17 15:17:11 +01:00
Miriam Baglioni	fbc19ce4a8	[orcidenrichment] fixing issue	2024-12-17 15:17:11 +01:00
Miriam Baglioni	0a0f820dc7	[orcidenrichment] fixing issue	2024-12-17 15:17:11 +01:00
Miriam Baglioni	f9531e0406	[orcidenrichment] refactoring	2024-12-17 15:17:11 +01:00
Miriam Baglioni	1b4bbb2691	[orcidenrichment] refactoring	2024-12-17 15:17:11 +01:00
Miriam Baglioni	da9bbdede4	[orcidenrichment] refactoring	2024-12-17 15:17:11 +01:00
Miriam Baglioni	eb83a34f64	[OrcidPropagation] alignemnt of property file with new parameters	2024-12-17 15:17:11 +01:00
Miriam Baglioni	0cae085786	[OrcidPropagation] new preparation step to use the authornamedisambiguation employed for orcid enrichment.	2024-12-17 15:17:11 +01:00
Claudio Atzori	e4b814b3f1	code formatting	2024-12-06 13:58:39 +01:00
Claudio Atzori	9e6b1f2f24	Merge pull request 'Communities_patents' (#514) from Communities_patents into beta ... Reviewed-on: #514	2024-12-06 13:50:43 +01:00
Miriam Baglioni	666155bafa	[communityfromsemrelpropagation] changed resource to have deletedbyinference = false.	2024-12-06 12:26:41 +01:00
Miriam Baglioni	ee84db7a6a	[communityfromsemrelpropagation] added filtering to remove the deletedbyinference and invisible results	2024-12-06 12:20:13 +01:00
Giambattista Bloisi	fed13e083e	Fix: do not import joda ... formatting	2024-12-05 15:21:32 +01:00
Miriam Baglioni	ca2d480df3	[BulkTagging] added fix to consider when the set of constraints for the datasource is empty. Added check for remove constraints and advanced constraints to verify if the constraints list is empty and in that case do nothing	2024-11-26 15:56:52 +01:00
Miriam Baglioni	189a7c255a	[patents] added test and resources	2024-11-25 16:52:13 +01:00
Miriam Baglioni	821700299a	[patents] added test and resources	2024-11-22 17:21:58 +01:00
Miriam Baglioni	e5b04e61ff	[CommunityPatents] extends the community propagation considering also the results of type patents linked with a isrelatedto semantcis	2024-11-21 10:20:12 +01:00
Miriam Baglioni	69aee609ef	[bulktag] align type to community api	2024-10-29 15:53:04 +01:00
Claudio Atzori	e4abe55988	merged person_through_the_graph & code formatting	2024-10-28 11:01:49 +01:00
Miriam Baglioni	1fce7d5a0f	[Person] remove the isolated nodes from the person set	2024-10-25 10:05:17 +02:00
Miriam Baglioni	32f444984e	[person] -	2024-10-24 17:51:42 +02:00
Miriam Baglioni	a7699558ed	[person] -	2024-10-24 16:15:12 +02:00
Miriam Baglioni	01679c935a	[person] added test class to be implemented	2024-10-24 15:27:06 +02:00
Miriam Baglioni	c773421cc7	[person] added new substep in propagation worflow main	2024-10-24 14:44:13 +02:00
Miriam Baglioni	cf07ed9058	[person] refactoring	2024-10-24 14:35:14 +02:00
Miriam Baglioni	c921cf7ee0	[personEntity] removed the deletedbyinference results (not indexed, but still in the graph). Changed the writing mode: append instead of overwrite	2024-10-24 09:57:20 +02:00
Giambattista Bloisi	0e34b0ece1	Fix imports: point them from the main distribution packages	2024-10-23 14:01:52 +02:00
Claudio Atzori	9486e21a44	copy or process the person records throughout the graph pipeline	2024-07-30 14:25:31 +02:00
Miriam Baglioni	9d27910144	[BulkTag]added tagging for the organization relevant for the community. Added test. Changed the tagging variables.	2024-07-16 13:48:48 +02:00
Miriam Baglioni	1477406ecc	[bulkTag] fixed issue that made project disappear in graph_10_enriched	2024-06-06 10:45:41 +02:00
Claudio Atzori	11bd89e132	[enrichment] use sparkExecutorMemory to define also the memoryOverhead	2024-05-01 08:32:59 +02:00
Giambattista Bloisi	1878199dae	Miscellaneous fixes: ... - in Merge By ID pick by preference those records coming from delegated Authorities - fix various tests - close spark session in SparkCreateSimRels	2024-04-24 08:12:45 +02:00
Sandro La Bruzzo	b72c3139e2	updated Ignore annotation that is deprecated to Disabled	2024-04-19 14:52:40 +02:00
Claudio Atzori	75551ad4ec	code formatting	2024-03-26 14:53:16 +01:00
Miriam Baglioni	94b931f7bd	[BulkTagging - tag datasource and projects]merging with branch beta	2024-03-26 14:25:19 +01:00
Miriam Baglioni	3b209261f2	[BulkTagging - tag datasource and projects]merging with branch beta	2024-03-26 14:21:27 +01:00
Claudio Atzori	ef52128c55	included new stats* workflows in parent pom list of modules, code formatting	2024-03-26 10:42:10 +01:00
Claudio Atzori	91b61687fa	Merge branch 'beta' into bulkTaggingPathMapExtention	2024-03-25 15:50:18 +01:00
Giambattista Bloisi	664a381d31	Unify merge logic of entities in MergeUtils.class	2024-03-18 16:04:49 +01:00
Sandro La Bruzzo	7d806a434c	formatted code	2024-02-28 09:31:58 +01:00