40 Commits

Author	SHA1	Message	Date
Claudio Atzori	08795cbd30	using helper method from ModelSupport to find the inverse relation descriptor	2021-12-06 10:39:56 +01:00
Claudio Atzori	4fe7888817	code formatting	2021-12-01 15:48:15 +01:00
Claudio Atzori	01e5e0142a	added test to verify the relation inverse lookup operation	2021-12-01 09:46:26 +01:00
Sandro La Bruzzo	f8329bc110	since dhp-schemas changed, introducing new Relation inverse model, this class has been updated	2021-10-19 15:24:22 +02:00
Claudio Atzori	2ee21da43b	suggestions from SonarLint	2021-08-11 12:13:22 +02:00
Miriam Baglioni	eea07f4c42	refactoring	2020-05-26 09:21:49 +02:00
Miriam Baglioni	76f3f73caa	merge upstream	2020-05-20 10:31:40 +02:00
Miriam Baglioni	e26a67c3eb	merge with upstream	2020-05-15 15:53:05 +02:00
Miriam Baglioni	5ec8c49ad5	removed serialization points	2020-05-15 12:49:58 +02:00
Claudio Atzori	a832658296	code formatting	2020-05-15 10:21:09 +02:00
Claudio Atzori	50d6a2ad3c	added output directory removal in the blacklist spark actions; included common global properties in blacklist's workflow.xml	2020-05-15 09:53:37 +02:00
Claudio Atzori	85f3c55992	fixed node names in blacklist workflow	2020-05-13 09:04:33 +02:00
Miriam Baglioni	7687519f00	merged conflicts with upstream branch	2020-05-12 10:03:44 +02:00
Claudio Atzori	f9a62ba63b	added wf nodes to copy entities to the output path	2020-05-11 18:16:39 +02:00
Miriam Baglioni	ad63effb4e	removed deletion of working dir	2020-05-11 17:48:22 +02:00
Claudio Atzori	c6b028f2af	code formatting	2020-05-11 17:38:08 +02:00
Claudio Atzori	6d0b11252e	bulktagging wfs moved into common dhp-enrichment module	2020-05-11 17:32:06 +02:00
Miriam Baglioni	50659011eb	refactoring	2020-05-11 16:14:26 +02:00
Miriam Baglioni	e883daf87e	added the outputPath parameter and the reset path to remove the outputath directory	2020-05-11 16:10:24 +02:00
Miriam Baglioni	bbc9b4f329	removed unused imports	2020-05-11 14:28:55 +02:00
Miriam Baglioni	757bae53ea	removed unusefule serialization points	2020-05-11 14:28:37 +02:00
Miriam Baglioni	b35d57a1ac	added resources for test	2020-05-11 14:15:30 +02:00
Miriam Baglioni	e563e65335	moved check from join to method	2020-05-11 14:11:44 +02:00
Miriam Baglioni	112b2cb3c3	added the test class	2020-05-11 13:58:58 +02:00
Miriam Baglioni	9a7ae523c9	update to version 1.2.1-SNAPSHOT	2020-05-11 13:57:47 +02:00
Miriam Baglioni	7e66bc2527	fix a typo in the compression keyword and added some logging info in the spark job	2020-05-11 09:40:58 +02:00
Miriam Baglioni	28556507e7	-	2020-05-08 12:54:52 +02:00
Miriam Baglioni	f95d288681	fixed swithch of parameters	2020-05-07 18:22:32 +02:00
Miriam Baglioni	e218360f8a	changed code for the mode of DbClient and also removed the dependency to graph-mapper	2020-05-04 12:26:17 +02:00
Miriam Baglioni	dbf3ba051a	minor	2020-04-30 20:22:07 +02:00
Miriam Baglioni	38ecfd5785	the wf with all the three steps for blacklisting relations	2020-04-30 18:28:46 +02:00
Miriam Baglioni	95433e1087	parameters for the preparation phase and blacklist phase	2020-04-30 18:28:13 +02:00
Miriam Baglioni	1070790c19	minor	2020-04-30 18:26:58 +02:00
Miriam Baglioni	b9d56b3ced	applies the actual removal of the relations	2020-04-30 18:26:25 +02:00
Miriam Baglioni	d6d6ebeae5	preparation step: creates the subset of the merges relations	2020-04-30 18:25:33 +02:00
Miriam Baglioni	276b95b7b3	add create file instruction	2020-04-30 15:05:17 +02:00
Miriam Baglioni	354f0162be	changes in the blacklist and workflow definition	2020-04-30 10:26:50 +02:00
Miriam Baglioni	6a47e6191d	read from blacklist and write the result as relations on hdfs	2020-04-29 18:16:01 +02:00
Miriam Baglioni	869f576273	added hash map for relationship entityType id prefix, and relation inverse	2020-04-29 18:14:52 +02:00
Miriam Baglioni	b85ad7012a	reads the blacklist from the blacklist db and writes it as a set of relations on hdfs	2020-04-29 17:29:49 +02:00