dnet-hadoop

Commit Graph

Select branches

Hide Pull Requests

datepicker

deduptesting

dhp_oaf_model

graph_cleaning

graph_db

import_new_mdstores

master

openorgswf

organization_pids

prepare_ror_actionset

scholexplorer_model_update

scholexplorer_resolve_on_hadoop

stable_id_scholexplorer

stable_ids

unique_field_in_lists

1.0.1

archive/bipFinder_master_test

archive/dedupTest

archive/islookup_timeout

archive/junit5

archive/master_pre_stable_ids

dhp-1.0.2

dhp-1.0.3

dhp-1.0.4

dhp-1.1.5

dhp-1.1.6

dhp-1.1.7

dhp-1.2.0

dhp-1.2.1

dhp-1.2.2

dhp-1.2.3

dhp-1.2.4

29f69f2f89 Sprint 4 dimitrispie 2021-11-26 15:22:04 +0200
bb7f556eff Merge remote-tracking branch 'origin/beta' into beta Sandro La Bruzzo 2021-11-25 13:03:25 +0100
1e1f5e4fe0 minor fix Sandro La Bruzzo 2021-11-25 13:03:17 +0100
ac07ed8251 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2021-11-25 12:32:58 +0100
5fd0e610bf [DOIBOOST Process] fix filtering to filter results with non null id Miriam Baglioni 2021-11-25 12:10:45 +0100
feea154e89 remove working dir after test Sandro La Bruzzo 2021-11-25 11:02:38 +0100
028a8acad8 add test resources Sandro La Bruzzo 2021-11-25 10:54:47 +0100
2164a2a889 Datacite: Code Refactor generated a general SparkApplication Scala where all the spark scala have to inherit Commented a little the Datacite transformation code Sandro La Bruzzo 2021-11-25 10:54:13 +0100
3f9b2ba8ce [Hosted By Map] fix issue in test Miriam Baglioni 2021-11-22 16:59:43 +0100
a7cf277d98 Datacite: Removed HostedBy Patch as described on ticket #7219, Now all the records will have hosted by Unknown Repository Sandro La Bruzzo 2021-11-22 16:03:17 +0100
483d3039d1 entity resolution: added distcpt of missing entities in graph materialization Sandro La Bruzzo 2021-11-22 15:55:24 +0100
93fe8ce8b2 entity resolution: fix test Sandro La Bruzzo 2021-11-22 15:50:43 +0100
35e20b0647 updated resolution wf: - generate a new version of the graph - changed merge from union to join Sandro La Bruzzo 2021-11-22 11:48:55 +0100
fdb75b180e [Cleaning] added couple of tests for DOIBOOST publications Miriam Baglioni 2021-11-21 16:35:22 +0100
0506fa2654 [Graph Dump] changed to mirror the changes in the model Miriam Baglioni 2021-11-19 15:56:25 +0100
6110a2b984 reverted version Sandro La Bruzzo 2021-11-19 15:31:45 +0100
65ebe1019b updated wagon-ssh version Sandro La Bruzzo 2021-11-19 14:59:04 +0100
155d8bf83f updated maven site plugin on dhp-code-style Sandro La Bruzzo 2021-11-19 14:51:08 +0100
3426451d3f Merge remote-tracking branch 'origin/beta' into beta Sandro La Bruzzo 2021-11-19 14:49:04 +0100
75298ec442 added site.xml to code style Sandro La Bruzzo 2021-11-19 14:48:44 +0100
4542a2338b updated site configuration to deploy on website Sandro La Bruzzo 2021-11-19 13:44:08 +0100
90c2a4987e Merge pull request '[fix] preserve parent/child relations from OpenOrgs' (#164) from preserve_openorg_parent_child_relations into beta Claudio Atzori 2021-11-19 11:35:55 +0100
e5a2c596b2 Merge branch 'beta' into preserve_openorg_parent_child_relations Claudio Atzori 2021-11-19 11:35:46 +0100
f4538f3c4c cleanup Claudio Atzori 2021-11-19 11:33:10 +0100
2b46b87f56 fixed filtering criteria applied in SparkCopyRelationsNoOpenorgs to keep the parent/child relations from OpenOrgs Claudio Atzori 2021-11-19 11:30:29 +0100
9fae872181 [Graph Dump] changed to mirror the changes in the model Miriam Baglioni 2021-11-19 11:25:50 +0100
fc03c99805 fixed javadocs url after deploying site Sandro La Bruzzo 2021-11-19 10:46:33 +0100
8a7c7d36db Merge pull request 'mvn_site_documentation' (#161) from mvn_site_documentation into beta Sandro La Bruzzo 2021-11-19 09:54:53 +0100
0c0d561bc4 added public class into tests to create correct javadoc Sandro La Bruzzo 2021-11-19 09:54:22 +0100
62fa61f3cf merge from beta Claudio Atzori 2021-11-19 09:23:42 +0100
bd9a43cefd Revert to 4094f2bb9a Claudio Atzori 2021-11-19 09:20:43 +0100
3a4d925386 Merge branch 'beta' into hierarchical_orgs_relations Claudio Atzori 2021-11-18 18:07:08 +0100
3974fa7dc1 Merge branch 'beta' into affiliationPropagation Claudio Atzori 2021-11-18 18:06:26 +0100
a24b9f8268 [dedup] trivial refactoring Claudio Atzori 2021-11-18 17:12:02 +0100
c0750fb17c avoid non necessary count operations over large spark datasets Claudio Atzori 2021-11-18 17:11:31 +0100
bb5dca7979 cleanup Claudio Atzori 2021-11-18 17:10:46 +0100
793b5a8e5f Aggiornare 'dhp-workflows/dhp-graph-mapper/src/main/java/eu/dnetlib/dhp/oa/graph/dump/ResultMapper.java' Miriam Baglioni 2021-11-18 14:49:38 +0100
5dc5792722 [Graph Dump] Change test resource to mirror the movement of the measure element Miriam Baglioni 2021-11-18 14:39:12 +0100
0136a8c266 [Graph Dump] Change test to mirror that measure is at the level of the isntance Miriam Baglioni 2021-11-18 14:38:33 +0100
1b79c0ee79 mergin with branch beta Miriam Baglioni 2021-11-18 11:01:00 +0100
10a32f287f Merge pull request '[stats wf] RIs, affiliations, parquet' (#156) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2021-11-17 15:02:25 +0100
cb3adb90f4 Merge branch 'beta' into beta Antonis Lempesis 2021-11-17 14:33:45 +0100
c283406829 added Universidad Polytecnica de Madrid Antonis Lempesis 2021-11-17 15:33:00 +0200
e0395719d7 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Claudio Atzori 2021-11-17 14:17:27 +0100
82a4e4efae [cleaning wf] fixed methodology to rule out invalid result titles, based on https://support.openaire.eu/issues/7206 Claudio Atzori 2021-11-17 14:17:22 +0100
6d4a1c57ee [Resolve Entities] Change test dataset to mirror the modification in the creation of the map between the pids and the unresolved Miriam Baglioni 2021-11-17 12:41:52 +0100
9c82d670b8 make class public in order to create javadoc Sandro La Bruzzo 2021-11-17 12:31:02 +0100
1f5ee116ed code refactor, created and moved scala code on the correct maven folder under src/main/scala and src/test/scala Sandro La Bruzzo 2021-11-17 12:23:52 +0100
2fd9ceac13 code refactor, created and moved scala code on the correct maven folder under src/main/scala and src/test/scala Sandro La Bruzzo 2021-11-17 11:35:22 +0100
60ae874dcb Merge branch 'beta' of code-repo.d4science.org:D-Net/dnet-hadoop into mvn_site_documentation Sandro La Bruzzo 2021-11-17 11:08:34 +0100
2506d7a679 Merge branch 'mvn_site_documentation' of code-repo.d4science.org:D-Net/dnet-hadoop into mvn_site_documentation Sandro La Bruzzo 2021-11-17 11:07:24 +0100
cded363b55 code refactor, created and moved scala code on the correct maven folder under src/main/scala and src/test/scala Sandro La Bruzzo 2021-11-17 11:06:35 +0100
4094f2bb9a added integration md file Miriam Baglioni 2021-11-17 10:04:52 +0100
ec8b0219ff [Documentation] Added first page for Integration via unresolved entities generation Miriam Baglioni 2021-11-16 17:41:34 +0100
2bbece2ca5 mergin with branch beta Miriam Baglioni 2021-11-16 16:35:40 +0100
2d67020c59 added dhp-enrichment maven site template Sandro La Bruzzo 2021-11-16 16:01:08 +0100
49f897ef29 [cleaning wf] fixed regex used to spot garbage in result titles; adjusted threshold for filtering titles Claudio Atzori 2021-11-16 15:24:23 +0100
28ea532ece [Affilaition Propagation] moved the selection of graph relation as a preparation step Miriam Baglioni 2021-11-16 15:24:19 +0100
18c1d70ef4 Merge branch 'beta' of code-repo.d4science.org:D-Net/dnet-hadoop into mvn_site_documentation Sandro La Bruzzo 2021-11-16 15:16:49 +0100
a1cafaf2e3 added mvn site for dnet-hadoop project Sandro La Bruzzo 2021-11-16 15:16:28 +0100
7c96e3fd46 removed not useful dir Miriam Baglioni 2021-11-16 13:57:26 +0100
c7c0c3187b [AFFILIATION PROPAGATION] Applied some SonarLint suggestions Miriam Baglioni 2021-11-16 13:56:32 +0100
c6a9f0a1a8 mergin with branch beta Miriam Baglioni 2021-11-16 12:04:40 +0100
99d86134f5 [Graph Dump] changed the dump since the measures have been moded at the level of the instance Miriam Baglioni 2021-11-16 12:04:21 +0100
0a727d325d [dedup] increased number of partitions in the consistency phase Claudio Atzori 2021-11-16 08:43:41 +0100
bafa2990f3 code formatting Claudio Atzori 2021-11-15 17:07:16 +0100
668ac25224 [graph resolution] using existing argument parser file name Claudio Atzori 2021-11-15 17:02:45 +0100
7d0a03f607 [graph resolution] minor Claudio Atzori 2021-11-15 14:45:54 +0100
941a50a2fc Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Claudio Atzori 2021-11-15 14:42:49 +0100
7c804acda8 [graph resolution] minor Claudio Atzori 2021-11-15 14:42:43 +0100
efa09057db Merge branch 'beta' of code-repo.d4science.org:D-Net/dnet-hadoop into beta Sandro La Bruzzo 2021-11-15 14:32:09 +0100
48923e46a1 added documentation to Pubmed Class and also added mvn site for dhp-aggregations Sandro La Bruzzo 2021-11-15 14:32:01 +0100
d2c787d416 [graph resolution] fixed sequence of the workflow steps Claudio Atzori 2021-11-15 14:31:15 +0100
975b10b711 [actionmanager] increased spark.sql.shuffle.partitions to 5000 Claudio Atzori 2021-11-15 12:31:45 +0100
1ecceea788 Merge pull request 'Open Citations' (#158) from openCitations into beta Claudio Atzori 2021-11-15 10:59:19 +0100
4ec88c718c merge with beta - resolved conflict in pom Miriam Baglioni 2021-11-15 10:52:16 +0100
6f1a434e90 [Bypass Action Set] Fixed test to consider the new identifier utils Miriam Baglioni 2021-11-15 09:59:23 +0100
157d33ebf9 [Bypass Action Set] Refactoring Miriam Baglioni 2021-11-15 09:58:48 +0100
7b81607035 Merge pull request 'PR: Bypass Action Set' (#157) from bypass_acstionset into beta Claudio Atzori 2021-11-12 12:01:05 +0100
6595135a1a [Dump Schemas] changed the schema of the dumped result according to the modifications in the bestAccessRight type Miriam Baglioni 2021-11-12 11:45:38 +0100
43cae4ad88 Merge branch 'dump' of https://code-repo.d4science.org/D-Net/dnet-hadoop into dump Miriam Baglioni 2021-11-12 11:36:54 +0100
b3f9370125 merge with beta - resolved conflict in pom Miriam Baglioni 2021-11-12 11:25:26 +0100
92d0e18b55 [Bypass Action Set] used constant DOI instead of "doi" Miriam Baglioni 2021-11-12 10:56:58 +0100
881113743f [Bypass Action Set] refactoring Miriam Baglioni 2021-11-12 10:55:50 +0100
47ccb53c4f [Bypass Action Set] modification for comment D-Net/dnet-hadoop#157 (comment) Miriam Baglioni 2021-11-12 10:54:09 +0100
ffb0ce1d59 merge with beta - resolved conflict in pom Miriam Baglioni 2021-11-12 10:19:59 +0100
716021546e [Bypass Action Set] minor fix Miriam Baglioni 2021-11-12 10:18:01 +0100
1f2a3d1af0 depending on dhp-schemas:2.8.22 (release) Claudio Atzori 2021-11-12 10:15:11 +0100
3469cc2b1d Merge branch 'beta' of code-repo.d4science.org:D-Net/dnet-hadoop into beta Sandro La Bruzzo 2021-11-12 09:56:52 +0100
a7763d2492 removed alternate identifier in resolutionMap Sandro La Bruzzo 2021-11-12 09:56:45 +0100
b8bdabfae9 [Graph DUmp] removed OpenAccessRoute from test in best access right Miriam Baglioni 2021-11-11 16:16:48 +0100
e5498052e8 [Graph DUmp] removed OpenAccessRoute from test in best access right Miriam Baglioni 2021-11-11 16:14:10 +0100
935062edec [Bypass Action Set] creation of unresolved entities Miriam Baglioni 2021-11-11 16:11:25 +0100
26f086dd64 removed the too restrctive clause. will discuss again Antonis Lempesis 2021-11-11 12:57:19 +0200
8bdca3413f Merge pull request 'DOIBoost Mapping: change the creation of the instance in the DOIBoost result' (#155) from doiboost_url into beta Claudio Atzori 2021-11-11 10:40:32 +0100
148289150f Merge branch 'beta' into doiboost_url Claudio Atzori 2021-11-11 10:40:19 +0100
2ca0a436ad added SparkResolveEntities node to the oozie wf Sandro La Bruzzo 2021-11-11 10:25:42 +0100
9cb195314f implemented and tested resolution of entities Sandro La Bruzzo 2021-11-11 10:17:40 +0100
6d3c4c4abe mergin with branch beta Miriam Baglioni 2021-11-11 08:59:53 +0100
8cc50ecee0 [Graph Dump] changed AccessRight with BestAccessRight in the dump and modified the dependency to the schema to the SNAPSHOT Miriam Baglioni 2021-11-11 08:59:20 +0100