dnet-hadoop

Commit Graph

Select branches

Hide Pull Requests

datepicker

deduptesting

dhp_oaf_model

graph_cleaning

graph_db

import_new_mdstores

master

openorgswf

organization_pids

prepare_ror_actionset

scholexplorer_model_update

scholexplorer_resolve_on_hadoop

stable_id_scholexplorer

stable_ids

unique_field_in_lists

1.0.1

archive/bipFinder_master_test

archive/dedupTest

archive/islookup_timeout

archive/junit5

archive/master_pre_stable_ids

dhp-1.0.2

dhp-1.0.3

dhp-1.0.4

dhp-1.1.5

dhp-1.1.6

dhp-1.1.7

dhp-1.2.0

dhp-1.2.1

dhp-1.2.2

dhp-1.2.3

dhp-1.2.4

bf3a9505e0 Merge pull request 'FOS' (#175) from FOS into beta Miriam Baglioni 2021-12-23 09:06:56 +0100
10579c0dd0 [FOS]fixed doi value in test Miriam Baglioni 2021-12-22 23:10:16 +0100
6116fc5d40 [FOS]added logic to include only different subjects. Test refactoring and extention Miriam Baglioni 2021-12-22 23:04:22 +0100
b81efb6a9d [FOS]changed the mapping between the csv and the model. Changed Test classes and resources Miriam Baglioni 2021-12-22 21:40:35 +0100
73175ba086 mergin with branch beta Miriam Baglioni 2021-12-22 16:45:15 +0100
de6c4c8968 [FOS]creation of the unresolved entities: remove the split for the doi: no more needed since each row is related to one doi Miriam Baglioni 2021-12-22 16:44:44 +0100
b352fbe453 Merge pull request 'bipFinder: unresolved entities' (#174) from bipFinder into beta Miriam Baglioni 2021-12-22 16:42:30 +0100
34ac56565d refactoring Miriam Baglioni 2021-12-22 16:28:11 +0100
20ef1d657f refactoring Miriam Baglioni 2021-12-22 16:26:36 +0100
813f856d3f [BipFinder] removing left over parameter in wf Miriam Baglioni 2021-12-22 16:11:12 +0100
2c126ed014 [BipFinder] create unresolved entities with measures at the level of the instance Miriam Baglioni 2021-12-22 16:03:41 +0100
bf52a1847b Merge pull request 'bipFinder at the level of the result' (#173) from bipFinder into beta Miriam Baglioni 2021-12-22 15:48:03 +0100
0807fdb65a [BipFinder] remove not needed resources Miriam Baglioni 2021-12-22 15:37:00 +0100
b5e11a3a0a [BipFinder] put in common package BipFinder model Miriam Baglioni 2021-12-22 15:33:05 +0100
c5739c4266 [BipFinder] create action set for the measures at the level of the result Miriam Baglioni 2021-12-22 15:08:33 +0100
da5f6260aa mergin with branch beta Miriam Baglioni 2021-12-22 13:12:02 +0100
4849270c55 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2021-12-22 13:07:37 +0100
8d18500069 using dhp-schema:2.9.24 Claudio Atzori 2021-12-22 12:47:21 +0100
9d19b057b8 Merge pull request '[GRAPH DUMP]Moving Measures' (#159) from dump into beta Miriam Baglioni 2021-12-22 12:40:35 +0100
be0acccf42 Merge branch 'beta' into dump Miriam Baglioni 2021-12-22 12:39:57 +0100
89ea9fa0e1 Merge branch 'dump' of https://code-repo.d4science.org/D-Net/dnet-hadoop into dump Miriam Baglioni 2021-12-22 12:36:32 +0100
16539d7360 added usage stats Antonis Lempesis 2021-12-22 02:54:42 +0200
3edd661608 fixed column names Antonis Lempesis 2021-12-21 22:55:04 +0200
a4c0cbb98c fixed typos in indicators. Added extra views in monitor Antonis Lempesis 2021-12-21 15:54:38 +0200
e24a7f3496 mergin with branch beta Miriam Baglioni 2021-12-21 13:57:19 +0100
d1ae219cb4 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2021-12-21 13:55:53 +0100
460e6b95d6 [Graph Dump] - Miriam Baglioni 2021-12-21 13:48:03 +0100
3920d68992 Fixed workflow generation of delta in datacite Sandro La Bruzzo 2021-12-21 11:41:49 +0100
58996972d9 added first indicator of sprint 5 Antonis Lempesis 2021-12-21 03:35:04 +0200
c1cdec09a9 Sprint 5 and other changes dimitrispie 2021-12-20 19:23:57 +0200
3cc1b7b153 mergin with branch beta Miriam Baglioni 2021-12-15 17:25:02 +0100
5e5dfd619c Merge branch 'beta' into dump Miriam Baglioni 2021-12-15 17:21:55 +0100
63b648b0dd Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2021-12-15 12:41:15 +0100
f0b523cfa7 removed the too restrctive clause. will discuss again Antonis Lempesis 2021-11-11 12:57:19 +0200
b881ee5ef8 [scholexplorer] - implemented generation of scholix of delta update of datacite Sandro La Bruzzo 2021-12-15 11:25:23 +0100
63952018c0 [scholexplorer] -moved SparkRetrieveDataciteDelta in scala folder Sandro La Bruzzo 2021-12-14 09:58:50 +0100
e5bff64f2e [scholexplorer] - Minor fix on SparkConvertRDDtoDataset -first implementation of retrieve datacite dump Sandro La Bruzzo 2021-12-14 09:56:55 +0100
e30e5ac8a8 Merge pull request '[Affiliation Propagation]' (#162) from affiliationPropagation into beta Claudio Atzori 2021-12-14 15:28:23 +0100
1790fa2d44 Merge branch 'beta' into affiliationPropagation Claudio Atzori 2021-12-14 15:26:56 +0100
56409d1281 [Dump] resolved conflicts with beta and merging Miriam Baglioni 2021-12-14 15:03:45 +0100
a3592b463a Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2021-12-14 14:58:26 +0100
22d4b5619b [BipFinder Result] last changes to test and resources files Miriam Baglioni 2021-12-14 14:54:13 +0100
6fb6236cd4 changed the way to produce the AS for bipFinder. Miriam Baglioni 2021-12-14 14:51:14 +0100
aff3ddc8d2 added cleaning for the format field, removing carrige return and tab characters Claudio Atzori 2021-12-14 11:41:46 +0100
573bd17cbb Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2021-12-14 11:12:25 +0100
4eb8276493 - Miriam Baglioni 2021-12-14 11:12:17 +0100
936578aaf1 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2021-12-13 15:01:47 +0100
8d755cca80 - Miriam Baglioni 2021-12-13 15:01:40 +0100
98eb292c59 avoid NPEs merging XMLInstance(s) Claudio Atzori 2021-12-13 13:27:20 +0100
5e17247bb6 avoid NPEs merging XMLInstance(s) Claudio Atzori 2021-12-13 11:48:40 +0100
b70ecccea0 avoid NPEs merging XMLInstance(s) Claudio Atzori 2021-12-12 12:37:38 +0100
c1b6ae47cd cleaning workflow assigns the proper default instance type when a value could not be cleaned using the vocabularies Claudio Atzori 2021-12-09 16:44:28 +0100
25dc7929a9 Merge pull request '[graph cleaning] improved instance type defaults' (#172) from graph_cleaning into beta Claudio Atzori 2021-12-09 16:47:06 +0100
eb43eda42a Merge branch 'beta' into graph_cleaning Claudio Atzori 2021-12-09 16:46:48 +0100
41c70c607d cleaning workflow assigns the proper default instance type when a value could not be cleaned using the vocabularies Claudio Atzori 2021-12-09 16:44:28 +0100
8f1e018ceb Merge pull request 'Serialization of fields in XML records for Sygma (and not only)' (#171) from sygma_indexing into beta Alessia Bardi 2021-12-09 15:53:27 +0100
cba63e9f82 Merge branch 'beta' into sygma_indexing Alessia Bardi 2021-12-09 15:52:16 +0100
e53228401b style Alessia Bardi 2021-12-09 15:46:22 +0100
cd9c51fd7a vocabulary based cleaning considers also the term label when looking up for a synonym Claudio Atzori 2021-12-09 13:57:53 +0100
adf17452b0 Merge pull request '[graph cleaning] consider terms as synonyms in the vocabulary lookup' (#170) from graph_cleaning into beta Claudio Atzori 2021-12-09 14:45:14 +0100
e6e177dda0 vocabulary based cleaning considers also the term label when looking up for a synonym Claudio Atzori 2021-12-09 13:57:53 +0100
6b5d7688a4 #7275 serialize license information in XML records Alessia Bardi 2021-12-09 13:46:48 +0100
b113586207 resolved conflicts Miriam Baglioni 2021-12-07 10:16:14 +0100
5d51b3dd4a Merge pull request 'scala_refactor' (#169) from scala_refactor into beta Sandro La Bruzzo 2021-12-06 15:33:44 +0100
d9836f0cf3 [OpenCitations] fixed test when executed one after the other Miriam Baglioni 2021-12-06 15:27:09 +0100
d1df01ff1e [Graph Dump] fixed resource for test Miriam Baglioni 2021-12-06 15:15:48 +0100
ed0c352799 [test-fixing] fixed wrong test Sandro La Bruzzo 2021-12-06 15:07:41 +0100
96a7d46278 [Graph Dump] fixed tests Miriam Baglioni 2021-12-06 15:06:32 +0100
e9f285ec4d [scala-refactor] Module dhp-doiboost: Moved all scala source into src/main/scala and src/test/scala Sandro La Bruzzo 2021-12-06 14:24:03 +0100
bf880e2508 [scala-refactor] Module dhp-graph-mapper: Moved all scala source into src/main/scala and src/test/scala Sandro La Bruzzo 2021-12-06 13:57:41 +0100
81bf604059 [scala-refactor] Module dhp-common: Moved all scala source into src/main/scala and src/test/scala Sandro La Bruzzo 2021-12-06 11:29:24 +0100
7af0bbd0b1 [scala-refactor] Module dhp-aggregation: Moved all scala source into src/main/scala and src/test/scala Sandro La Bruzzo 2021-12-06 11:26:36 +0100
9132727793 fixed date cleaning test Claudio Atzori 2021-12-06 10:54:05 +0100
08795cbd30 using helper method from ModelSupport to find the inverse relation descriptor Claudio Atzori 2021-12-06 10:39:56 +0100
f430688ff7 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2021-12-03 12:36:08 +0100
4bb1d43afc - Miriam Baglioni 2021-12-03 12:35:51 +0100
0fa0ce33d6 removed duplicated on gitignore Sandro La Bruzzo 2021-12-03 11:47:35 +0100
f7011b90d8 format code Sandro La Bruzzo 2021-12-03 11:15:09 +0100
372633880f Merge pull request 'XML serialisation of instances with the same URLs' (#167) from instance_group_by_url into beta Claudio Atzori 2021-12-03 09:28:06 +0100
dd0b2e5244 Merge branch 'beta' into instance_group_by_url Claudio Atzori 2021-12-03 09:27:58 +0100
c4c705aa46 Merge pull request 'Cleaning of invisible records' (#168) from clean_invisible_records into beta Claudio Atzori 2021-12-03 09:27:41 +0100
863a2f9db3 avoid to filter OAF records defined as invisible = true Claudio Atzori 2021-12-03 09:08:12 +0100
9cac283bec implemented Instance serialization features requested in https://support.openaire.eu/issues/7156 Claudio Atzori 2021-12-02 17:20:33 +0100
d9f80488cc [GRAPH DUMP] Add one more test to check the filtering of the relations Miriam Baglioni 2021-12-02 14:15:19 +0100
58bc3f223a [GRAPH DUMP] Add filtering for relation we do not want to dump. It is based on the relclass Miriam Baglioni 2021-12-02 14:09:46 +0100
8905a39bf3 mergin with branch beta Miriam Baglioni 2021-12-02 13:17:29 +0100
87eedad898 - Miriam Baglioni 2021-12-02 13:17:19 +0100
3b19821f3c added stats computation on the graph hive DB tables Claudio Atzori 2021-12-02 10:44:10 +0100
cfa4560769 minor: fixed hive action name Claudio Atzori 2021-12-02 10:43:36 +0100
d85af6fc25 [cleaning wf] fixed OAF record navigation, a mapping defined on a container object would have prevented the natvigation to continue on its properties Claudio Atzori 2021-12-01 15:49:15 +0100
4fe7888817 code formatting Claudio Atzori 2021-12-01 15:48:15 +0100
01e5e0142a added test to verify the relation inverse lookup operation Claudio Atzori 2021-12-01 09:46:26 +0100
0df9574a6f Merge pull request '[stats wf] Added sprint 3&4 of indicators' (#166) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2021-11-29 10:40:26 +0100
1de881b796 resolved conflicts for #165 Claudio Atzori 2021-11-26 16:15:11 +0100
014e872ae1 [resolution wf] added optional parameter to skip the entity resolution Claudio Atzori 2021-11-26 15:38:56 +0100
5c6d328537 code formatting Claudio Atzori 2021-11-26 15:38:16 +0100
09fc2afdca Added indi_funder_country_collab Kept only indi_pub_has_cc_licence dimitrispie 2021-11-26 16:13:10 +0200
8750a71502 Merge remote-tracking branch 'origin/beta' into beta dimitrispie 2021-11-26 16:11:26 +0200
25fc8abf77 Sprint 4 dimitrispie 2021-11-26 15:22:04 +0200
0b4163ee0b added sprint3,4, removed 2, chaos Antonis Lempesis 2021-11-26 15:58:01 +0200