dnet-hadoop

Commit Graph

Select branches

Hide Pull Requests

datepicker

deduptesting

dhp_oaf_model

graph_cleaning

graph_db

import_new_mdstores

master

openorgswf

organization_pids

prepare_ror_actionset

scholexplorer_model_update

scholexplorer_resolve_on_hadoop

stable_id_scholexplorer

stable_ids

unique_field_in_lists

1.0.1

archive/bipFinder_master_test

archive/dedupTest

archive/islookup_timeout

archive/junit5

archive/master_pre_stable_ids

dhp-1.0.2

dhp-1.0.3

dhp-1.0.4

dhp-1.1.5

dhp-1.1.6

dhp-1.1.7

dhp-1.2.0

dhp-1.2.1

dhp-1.2.2

dhp-1.2.3

dhp-1.2.4

fbc28ee8c3 [OpenCitation] change the integration logic to consider dois with commas inside Miriam Baglioni 2022-02-07 18:32:08 +0100
78be2975f0 [stats-wf]fixed another typo related to PR#193 Miriam Baglioni 2022-02-07 11:22:08 +0100
1f8302dc37 Merge pull request '[stats-wf]fixed yet another typo' (#193) from antonis.lempesis/dnet-hadoop:beta into beta Miriam Baglioni 2022-02-07 11:19:26 +0100
5f762cbd09 fixed yet another typo Antonis Lempesis 2022-02-07 12:09:12 +0200
b04ecfcf13 Merge pull request 'extendResult' (#192) from extendResult into beta Alessia Bardi 2022-02-04 16:43:58 +0100
ac8b8f224f Merge branch 'beta' into extendResult Alessia Bardi 2022-02-04 16:43:27 +0100
9fd2ef468e [APC at the result level] changed dependecy in external pom Miriam Baglioni 2022-02-04 16:40:32 +0100
493caef358 [stats-wf]fixed the result_result table related to PR#191 Miriam Baglioni 2022-02-04 14:51:25 +0100
0547fd6ee7 Merge pull request '[stats-wf]fixed the result_result table' (#191) from antonis.lempesis/dnet-hadoop:beta into beta Miriam Baglioni 2022-02-04 14:47:31 +0100
ae633c566b fixed the result_result table Antonis Lempesis 2022-02-04 15:04:19 +0200
aae667e6b6 [APC at the result level] added the APC at the level of the result and modified test class Miriam Baglioni 2022-02-04 12:34:25 +0100
bcfdf9a0d7 iis repository with https Sandro La Bruzzo 2022-02-03 16:49:31 +0100
3c60e53a96 [stats-wf]fixed the result_result creation for monitor PR#190 on beta Miriam Baglioni 2022-02-03 14:47:08 +0100
89922156c9 Merge pull request '[stats-wf]fixed the result_result creation for monitor' (#190) from antonis.lempesis/dnet-hadoop:beta into beta Miriam Baglioni 2022-02-03 13:00:56 +0100
c2b44530a3 typo... Antonis Lempesis 2022-02-03 13:44:07 +0200
dbd2646d59 fixed the result_result creation for monitor Antonis Lempesis 2022-02-03 12:37:10 +0200
2e215abfa8 test for instances with URLs for OpenAPC Alessia Bardi 2022-02-02 17:27:44 +0100
37784209c9 [dhp-schemas-] updated the version of dhp-schema to 2.10.27 for APC name and id modification Miriam Baglioni 2022-02-02 12:46:31 +0100
73eba34d42 [UnresolvedEntities] Changed the way to merge the unresolved because the new merge removed the dataInfo from the merged result. Added also data info for subjects Miriam Baglioni 2022-02-01 08:38:41 +0100
dce7f5fea8 [BULK TAGGING] changed to fix issue that should have been fixed already Miriam Baglioni 2022-01-31 08:20:28 +0100
8eb75ca169 adapted GenerateEntitiesApplicationTest behaviour Claudio Atzori 2022-01-27 16:24:37 +0100
db299dd8ab fixed typo Claudio Atzori 2022-01-27 16:24:06 +0100
af61e44acc ported changes to the GraphCleaningFunctionsTest from 8de9788308 Claudio Atzori 2022-01-27 16:19:14 +0100
4fc44edb71 depending on dhp-schemas:2.10.26 Claudio Atzori 2022-01-27 16:03:57 +0100
a70b0990c9 Merge pull request 'Priority to records from delegated authorities' (#187) from delegated_authorities into beta Miriam Baglioni 2022-01-26 16:02:49 +0100
1322379741 Merge branch 'beta' into delegated_authorities Claudio Atzori 2022-01-25 14:28:25 +0100
59a250337c [graph resolution] drop output path at the beginning Claudio Atzori 2022-01-24 18:02:07 +0100
97ad94d7d9 [graph resolution] drop output path at the beginning Claudio Atzori 2022-01-24 18:02:07 +0100
8de9788308 applied fix for avoiding ruling out the invisible (APC) records during the graph cleaning Claudio Atzori 2022-01-24 11:29:22 +0100
c42623f006 added NPE checks Claudio Atzori 2022-01-21 14:30:09 +0100
2f385b3ac6 updated dnet workflow profile definitions Claudio Atzori 2022-01-21 13:59:46 +0100
dd52bf1bb8 copy relations to the graphOutputPath Claudio Atzori 2022-01-21 13:59:29 +0100
4983d6536d Merge branch 'beta' into delegated_authorities Claudio Atzori 2022-01-21 13:02:48 +0100
7a3819144d Merge pull request 'title types from datacite records' (#188) from datacite_title_mapping into beta Sandro La Bruzzo 2022-01-21 11:05:25 +0100
f0ea2410e5 improved mapping titles from datacite records to consider title types Claudio Atzori 2022-01-21 10:50:34 +0100
b37bc277c4 reintroduced the hostedby patching to the datacite records Claudio Atzori 2022-01-21 09:15:13 +0100
f2fde5566b using helper method from ModelSupport to find the inverse relation descriptor Claudio Atzori 2022-01-20 09:19:07 +0100
3b9020c1b7 added unit test for the DispatchEntitiesJob Claudio Atzori 2022-01-19 18:15:55 +0100
abfa9c6045 code formatting Claudio Atzori 2022-01-19 17:17:11 +0100
391aa1373b added unit test Claudio Atzori 2022-01-19 17:13:21 +0100
62f135262e code formatting Claudio Atzori 2022-01-19 12:30:52 +0100
44a937f4ed factored out entity grouping implementation, extended to consider results from delegated authorities rather than identical records from other sources Claudio Atzori 2022-01-19 12:24:52 +0100
42e8f76778 [GraphCleaning] change the return value in the filtering function to avoid to lose the APC entities Miriam Baglioni 2022-01-13 16:06:43 +0100
a7c4d0d16d [DoiBoost Organizations] added parameter to specify the action in the wf raw_organizations to be able to load the openorgs organization as in the loading step for the construction of the graph Miriam Baglioni 2022-01-13 13:52:00 +0100
7bf12ad24a Merge pull request 'BipInstance' (#185) from BipInstance into beta Miriam Baglioni 2022-01-12 18:15:38 +0100
a75fb8c47a [BipFinderInstanceLevel] change pom to align to the dhp-schema release 2.10.24 and refactoring Miriam Baglioni 2022-01-12 18:06:26 +0100
4d517ed9ec mergin with branch beta Miriam Baglioni 2022-01-12 17:29:37 +0100
e7d5a39c03 [BipFinderInstanceLevel] added tests in test class Miriam Baglioni 2022-01-12 17:25:04 +0100
dbd6fa1d65 scalafmt: remote referencing the common definition files makes it work compiling the entire project as well as the individual submodules Claudio Atzori 2022-01-12 17:19:38 +0100
4993666d73 [BipFinderInstanceLevel] changed creation of the instance to allow to enrich existing instances with same pid Miriam Baglioni 2022-01-12 16:53:47 +0100
9acc32faa6 [stats wf] final touches for the integration of PRs #166, #179 in the master branch Claudio Atzori 2022-01-12 12:04:31 +0100
b053b0178e Sprint 5 and other changes dimitrispie 2021-12-20 19:23:57 +0200
b6b4bc0df9 added first indicator of sprint 5 Antonis Lempesis 2021-12-21 03:35:04 +0200
e91f06f39b fixed typos in indicators. Added extra views in monitor Antonis Lempesis 2021-12-21 15:54:38 +0200
3ce1976627 fixed column names Antonis Lempesis 2021-12-21 22:55:04 +0200
4878d7485c added usage stats Antonis Lempesis 2021-12-22 02:54:42 +0200
a4316bafed fixed a typo Antonis Lempesis 2021-12-23 15:33:53 +0200
bb17e070d8 added result_result relations Antonis Lempesis 2021-12-23 15:46:17 +0200
a30a98a716 Applying PR#166 in the master branch (Added sprint 3&4 of indicators). Merge commit '0df9574a6f5d9d75bc840decb023561ae941f9d6' Claudio Atzori 2022-01-12 10:57:19 +0100
1b9e8378b3 Merge pull request 'scalafmt: code style for scala' (#184) from scalafmt into beta Sandro La Bruzzo 2022-01-12 09:58:39 +0100
57e2c4b749 formatted code Sandro La Bruzzo 2022-01-12 09:40:28 +0100
b78d2b71f0 updated scala format configuration Sandro La Bruzzo 2022-01-12 09:38:34 +0100
0f2144b5e0 scalafmt: code formatting Claudio Atzori 2022-01-11 17:03:44 +0100
dcd282977c pulled from beta Claudio Atzori 2022-01-11 16:59:41 +0100
4f212652ca scalafmt: code formatting Claudio Atzori 2022-01-11 16:57:48 +0100
0163dadb7f [doiboost] - update MAG schema, new filed added on version dec-2021 Sandro La Bruzzo 2022-01-11 11:05:44 +0100
904e1c2667 Merge pull request 'Affiliation Propagation through semantic relation' (#183) from enrichment into beta Miriam Baglioni 2022-01-07 19:18:16 +0100
064f9bbd87 [AFFPropSR] added new paprameter for the number of iterations and new code for just one iteration Miriam Baglioni 2022-01-07 18:58:51 +0100
93f26fb742 Merge pull request '[SDG-FOS] to import SDG file not considering the header' (#182) from SDG into beta Miriam Baglioni 2022-01-07 16:28:55 +0100
b7e450070b [SDG-FOS] to import SDG file not considering the header Miriam Baglioni 2022-01-07 12:13:26 +0100
af8a33638d Merge pull request 'SDG - FOS' (#181) from SDG into beta Miriam Baglioni 2022-01-07 11:31:19 +0100
639190370a mergin with branch beta Miriam Baglioni 2022-01-07 11:29:25 +0100
adccc2346a [SDG-FOS] to lower case for the doi Miriam Baglioni 2022-01-07 11:28:50 +0100
8ae46ca789 OAF-store-graph mdstores: firther fix for PR#180 Claudio Atzori 2022-01-05 15:49:05 +0100
908294d86e OAF-store-graph mdstores: firther fix for PR#180 Claudio Atzori 2022-01-05 15:49:05 +0100
3bd3653be9 OAF-store-graph mdstores: save them in text format Claudio Atzori 2022-01-04 15:02:09 +0100
3dc48c7ab5 OAF-store-graph mdstores: save them in text format Claudio Atzori 2022-01-04 14:40:16 +0100
f82db765db OAF-store-graph mdstores: save them in text format Claudio Atzori 2022-01-04 14:23:01 +0100
8d13effa31 test for the tolerant deserialisation utility method Claudio Atzori 2022-01-04 11:26:56 +0100
9458ee7938 serialise records in the OAF-store-graph mdstores in json format. Read them again in the graph construction phase using a tolerant parser to support backward compatible changes in the evolution of the schema Claudio Atzori 2022-01-03 17:25:26 +0100
58f8998e3d OAF-store-graph mdstores: save them in text format Claudio Atzori 2022-01-04 15:02:09 +0100
174c3037e1 OAF-store-graph mdstores: save them in text format Claudio Atzori 2022-01-04 14:40:16 +0100
045d767013 OAF-store-graph mdstores: save them in text format Claudio Atzori 2022-01-04 14:23:01 +0100
cb30770a0b Merge pull request 'tolerant parsing of OAF-store-graph mdstores' (#180) from graph_interpretation_mdstores into beta Claudio Atzori 2022-01-04 11:32:29 +0100
bd59b58efb test for the tolerant deserialisation utility method Claudio Atzori 2022-01-04 11:26:56 +0100
a6977197b3 serialise records in the OAF-store-graph mdstores in json format. Read them again in the graph construction phase using a tolerant parser to support backward compatible changes in the evolution of the schema Claudio Atzori 2022-01-03 17:25:26 +0100
4c60ee1718 mergin with branch beta Miriam Baglioni 2022-01-03 15:24:02 +0100
92fd69e25d [SDG-FOS] alternative way to get input data to avoid OOM error while getting csv Miriam Baglioni 2022-01-03 15:23:06 +0100
fe7e5f4748 Merge pull request '[stats wf] result_result relations, usage stats, monitor views, indicator for sprint 5' (#179) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2022-01-03 14:52:11 +0100
bcea4e3a9b added dnet workflow profile for the orchestration of the simplified and complete graph construction and processing pipeline, where the IIS works on the non-deduplicated graph Claudio Atzori 2022-01-03 14:33:00 +0100
a706ba0c08 Merge pull request 'SDG Integration' (#178) from SDG into beta Miriam Baglioni 2021-12-23 14:50:00 +0100
81ee654271 added result_result relations Antonis Lempesis 2021-12-23 15:46:17 +0200
7551e52e95 fixed a typo Antonis Lempesis 2021-12-23 15:33:53 +0200
7a1b440413 [SDG] logic to create unresolved entities out of SDG input. This changes also some classes related to FOS to reuse the same code. The code under createunresolvedentities create results with the merged update of the the inputs provided (bip at the level of the isntance, fos and sdg for subjects) Miriam Baglioni 2021-12-23 13:24:28 +0100
278cf08421 Merge pull request 'Normalising DOI urls' (#177) from instance_group_by_url into beta Claudio Atzori 2021-12-23 12:40:17 +0100
cccb16900c https://support.openaire.eu/issues/7330 normalising DOI urls Claudio Atzori 2021-12-23 12:33:53 +0100
2a67ee13ec [SDG] added model class Miriam Baglioni 2021-12-23 10:37:52 +0100
5c4fee3533 Merge pull request '[Graph Dump] fixed issue on extraction of relation between entities and contexts: the relationship name and type were swapped' (#176) from dump into beta Miriam Baglioni 2021-12-23 10:16:20 +0100
69e9ea9eeb [Graph Dump] Test for extraction of rels from entities extended Miriam Baglioni 2021-12-23 10:15:30 +0100
31b26d48ac [Graph Dump] fixed issue on extraction of relation between entities and contexts: the relationship name and type were swapped Miriam Baglioni 2021-12-23 10:09:47 +0100