 Miriam Baglioni
|
e623f12bef
|
refactoring
|
2020-07-30 16:32:59 +02:00 |
|
Miriam Baglioni
|
ff7d05abb4
|
added support class to store the couple organizationId representativeId gaot from sql query on hive
|
2020-07-30 16:32:04 +02:00 |
|
Miriam Baglioni
|
cf6d80b2ab
|
added command to close the writer
|
2020-07-30 16:31:22 +02:00 |
|
Miriam Baglioni
|
f985bca37b
|
added USER_CLAIM constant value
|
2020-07-30 16:25:26 +02:00 |
 Claudio Atzori
|
4bbfcf1ac6
|
Merge branch 'master' of https://code-repo.d4science.org/D-Net/dnet-hadoop
|
2020-07-30 16:25:06 +02:00 |
|
Claudio Atzori
|
4ff8007518
|
added function to set the missing vocabulary names, used in the cleaning workflow as a pre-cleaning step
|
2020-07-30 16:24:39 +02:00 |
|
Miriam Baglioni
|
6f1c40a933
|
-
|
2020-07-30 16:24:28 +02:00 |
|
Miriam Baglioni
|
2b66a93f9e
|
added property file that was missing
|
2020-07-30 16:24:17 +02:00 |
 Michele Artini
|
bdece15ca0
|
blacklist of nsprefix
|
2020-07-30 16:13:38 +02:00 |
Sandro La Bruzzo
|
c97c8f0c44
|
implemented new oozie job to extract entities in a separate dataset
|
2020-07-30 12:13:58 +02:00 |
 Sandro La Bruzzo
|
3010a362bc
|
updated changing in the workflow of provision in the phase of aggregation. Removed serialization in JSON RDD and used spark Dataset
|
2020-07-30 09:25:56 +02:00 |
|
Sandro La Bruzzo
|
487226f669
|
Merge branch 'master' of code-repo.d4science.org:D-Net/dnet-hadoop
|
2020-07-30 09:25:39 +02:00 |
|
Sandro La Bruzzo
|
16ae3c9ccf
|
updated changing in the workflow of provision in the phase of aggregation. Removed serialization in JSON RDD and used spark Dataset
|
2020-07-30 09:25:32 +02:00 |
|
Miriam Baglioni
|
ee8420c6b3
|
added resource for datasource test
|
2020-07-29 18:28:43 +02:00 |
|
Miriam Baglioni
|
76bcab98ce
|
added code to filter out null originalId from the dump
|
2020-07-29 18:28:21 +02:00 |
|
Miriam Baglioni
|
ef1d8aef17
|
added one test to verify the dump for the datasources
|
2020-07-29 18:27:46 +02:00 |
|
Miriam Baglioni
|
86bab79512
|
-
|
2020-07-29 18:20:22 +02:00 |
|
Miriam Baglioni
|
31791dcf3d
|
fixed wrong property file path name
|
2020-07-29 18:20:08 +02:00 |
|
Miriam Baglioni
|
0f60436e52
|
-
|
2020-07-29 18:00:18 +02:00 |
|
Miriam Baglioni
|
9e722aa1ef
|
-
|
2020-07-29 18:00:08 +02:00 |
|
Miriam Baglioni
|
d22f106f27
|
added constant to identify datasource associated to funders
|
2020-07-29 17:56:55 +02:00 |
|
Miriam Baglioni
|
40e194fe2f
|
added check to not dump datasources related to funders
|
2020-07-29 17:56:18 +02:00 |
|
Miriam Baglioni
|
b48934f6df
|
changed the workflow name
|
2020-07-29 17:43:43 +02:00 |
|
Miriam Baglioni
|
1433db825d
|
refactorign
|
2020-07-29 17:43:24 +02:00 |
|
Miriam Baglioni
|
074e9ab75e
|
refactoring
|
2020-07-29 17:42:50 +02:00 |
|
Miriam Baglioni
|
8ad8dac7d4
|
merge branch with fork master
|
2020-07-29 17:38:28 +02:00 |
|
Miriam Baglioni
|
9e997e63a2
|
merge upstream
|
2020-07-29 17:38:14 +02:00 |
|
Miriam Baglioni
|
9fa82dc93b
|
fixed issue
|
2020-07-29 17:36:16 +02:00 |
|
Miriam Baglioni
|
8907648d6a
|
-
|
2020-07-29 17:35:47 +02:00 |
|
Miriam Baglioni
|
536e7f6352
|
added and changed resources for testing of the whole graph dump and of community related products dumps
|
2020-07-29 17:33:34 +02:00 |
|
Miriam Baglioni
|
4d7f590493
|
testings for the whole graph dump
|
2020-07-29 17:32:37 +02:00 |
|
Miriam Baglioni
|
a2f73ec2c7
|
changed due to changes in the model
|
2020-07-29 17:32:02 +02:00 |
|
Miriam Baglioni
|
481585e9d3
|
-
|
2020-07-29 17:31:41 +02:00 |
|
Miriam Baglioni
|
40a8dafbdc
|
-
|
2020-07-29 17:30:44 +02:00 |
|
Miriam Baglioni
|
de2ebb467e
|
changed due to changes in the model
|
2020-07-29 17:08:02 +02:00 |
|
Miriam Baglioni
|
d0ff2a56fb
|
-
|
2020-07-29 17:06:53 +02:00 |
|
Miriam Baglioni
|
b96dedb56b
|
changed due to changes in the model
|
2020-07-29 17:05:31 +02:00 |
|
Miriam Baglioni
|
6d0f08277b
|
classes to implement the dump of the whole graph.
|
2020-07-29 17:03:19 +02:00 |
|
Miriam Baglioni
|
8d4327b292
|
input parameters and workflow definition for the dump of the whole graph
|
2020-07-29 17:00:34 +02:00 |
|
Miriam Baglioni
|
b5f995ab12
|
refactoring
|
2020-07-29 16:59:48 +02:00 |
|
Miriam Baglioni
|
f7a87cc447
|
added new constants value
|
2020-07-29 16:58:40 +02:00 |
|
Miriam Baglioni
|
6b63668d3f
|
-
|
2020-07-29 16:57:45 +02:00 |
|
Miriam Baglioni
|
dac9f7cc10
|
refactorin
|
2020-07-29 16:56:46 +02:00 |
|
Miriam Baglioni
|
770b71b14a
|
Added new model class to dumop Datasources
|
2020-07-29 16:55:39 +02:00 |
|
Miriam Baglioni
|
c760d16936
|
removed the collected from element from the entities
|
2020-07-29 16:55:08 +02:00 |
|
Miriam Baglioni
|
6a499c6b7a
|
added hashCode to relation to avoid to produce multiple identical relations
|
2020-07-29 16:54:16 +02:00 |
|
Miriam Baglioni
|
b71d12cf26
|
refactoring
|
2020-07-29 16:52:44 +02:00 |
|
Miriam Baglioni
|
a8d65b68cb
|
changed to delete the part to check if it was a test or a real execution
|
2020-07-29 16:47:57 +02:00 |
|
Miriam Baglioni
|
3ec2392904
|
Added new class to move the place the split is effectively run
|
2020-07-29 16:46:50 +02:00 |
|
Michele Artini
|
8ba94833bd
|
added an es prop
|
2020-07-29 14:16:08 +02:00 |