dnet-hadoop

Commit Graph

Select branches

Hide Pull Requests

deduptesting

dhp_oaf_model

doiboost

enrichment_wfs

graph_cleaning

graph_db

import_openorgs

islookup_timeout

master

merge_graph

oaf-store-interpretation

provision_indexing

przemyslawjacewicz_jenkins_deployment

scholexplorer

trunc_trust

unique_field_in_lists

1.0.1

archive/bipFinder_master_test

archive/dedupTest

archive/islookup_timeout

archive/junit5

dhp-1.0.2

dhp-1.0.3

dhp-1.0.4

dhp-1.1.5

dhp-1.1.6

dhp-1.1.7

dhp-1.2.0

dhp-1.2.1

dhp-1.2.2

dhp-1.2.3

dhp-1.2.4

c8bb81cd9a align dependencies with IIS cluster Claudio Atzori 2019-10-29 18:10:20 +0100
30a873265f put the last modification of the master branch into the tree2. Addition of the configuration as parameter of the comparator. This is to allow the comparator to access it miconis 2019-10-29 16:38:42 +0100
1beb776691 minor changes miconis 2019-10-29 15:58:21 +0100
5e32a4066a depending on dnet-openaire-data-protos:3.9.5-proto250 Claudio Atzori 2019-10-28 18:17:32 +0100
fe62ccd6dd implemented oozie wf Sandro La Bruzzo 2019-10-28 12:12:50 +0100
06912fd0d3 fixed test Sandro La Bruzzo 2019-10-28 12:06:30 +0100
9ee4e5a196 remove a bit of syntactic sugar on the object inheritance :( Sandro La Bruzzo 2019-10-25 18:10:30 +0200
c74335ebc7 resolved conflict Sandro La Bruzzo 2019-10-25 14:34:50 +0200
8c902c500a minor fix Sandro La Bruzzo 2019-10-25 14:33:54 +0200
9fa5aebe9c minor changes miconis 2019-10-25 12:52:28 +0200
551eda1600 dataset, orp and software mapping implemented. addition of test resources for results. implementation of tests to check the result of the mapping miconis 2019-10-25 12:48:25 +0200
eef14fade3 fixed conflict Sandro La Bruzzo 2019-10-25 11:58:20 +0200
0ea7e861ab added organizations test Sandro La Bruzzo 2019-10-25 11:56:28 +0200
4908165e05 implementation of the createPublication method to map publications miconis 2019-10-25 11:54:14 +0200
df37bd6aaf placeholders for setters in createpublication miconis 2019-10-25 10:57:19 +0200
331b853ad6 Merge branch 'master' of https://code-repo.d3science.org/D-Net/dnet-hadoop Claudio Atzori 2019-10-25 10:55:43 +0200
4eaff36ea6 a bit of syntactic sugar on the object inheritance Claudio Atzori 2019-10-25 10:55:35 +0200
c8d6d6bbd1 implemented organization mapping Sandro La Bruzzo 2019-10-25 10:23:51 +0200
b525b54130 starting implementing the createPublication class miconis 2019-10-25 09:55:31 +0200
b0aa7cd7fb fluent setters Claudio Atzori 2019-10-25 09:53:08 +0200
4b331790e7 resolved conflicts Claudio Atzori 2019-10-25 09:45:12 +0200
c929c1dfac more proto 2 graph model mappings Claudio Atzori 2019-10-25 09:25:36 +0200
09ffda03a2 removed circular dependencies Sandro La Bruzzo 2019-10-25 09:24:18 +0200
a10d071cf4 Merge branch 'master' of code-repo.d4science.org:D-Net/dnet-hadoop Sandro La Bruzzo 2019-10-24 17:55:44 +0200
3a8bb11695 mapped first part Sandro La Bruzzo 2019-10-24 17:55:40 +0200
d46371ceab Merge branch 'master' of https://code-repo.d2science.org/D-Net/dnet-hadoop Claudio Atzori 2019-10-24 17:43:55 +0200
0d88f9a6a4 added mapping for projects Claudio Atzori 2019-10-24 17:43:42 +0200
2dd9572f41 added Mapping of OriginalDescription Sandro La Bruzzo 2019-10-24 17:36:44 +0200
351d850ad3 Merge branch 'master' of code-repo.d4science.org:D-Net/dnet-hadoop miconis 2019-10-24 17:29:07 +0200
b66a7e3030 publication test added miconis 2019-10-24 17:29:01 +0200
6c32d418ac added conversion of ExtraInfo Sandro La Bruzzo 2019-10-24 17:26:55 +0200
5f339a2c24 added mappings for basic types Claudio Atzori 2019-10-24 17:21:45 +0200
52abfcfac7 Field<T> is an actual class, fluent setters Claudio Atzori 2019-10-24 17:17:12 +0200
9d04111391 Merge branch 'master' of code-repo.d4science.org:D-Net/dnet-hadoop Sandro La Bruzzo 2019-10-24 17:05:52 +0200
0902bac7dd fixed conflict Sandro La Bruzzo 2019-10-24 17:05:42 +0200
d8bfaa3687 added mapping for relations Claudio Atzori 2019-10-24 17:04:13 +0200
d2965636e0 created test for convert json into new OAF data model Sandro La Bruzzo 2019-10-24 17:02:35 +0200
79c4f1bbd8 Protobuf to internal graph model, early steps Claudio Atzori 2019-10-24 16:56:13 +0200
d38aeb8c6e DataInfo.provenanceaction not repeatable, fluent setters Claudio Atzori 2019-10-24 16:55:38 +0200
5744a64478 added module dhp=graph-mapper Sandro La Bruzzo 2019-10-24 16:00:28 +0200
ed14a40890 removed unuesd directory Sandro La Bruzzo 2019-10-24 11:40:47 +0200
25a62b79e5 added new model for information space dataframes Sandro La Bruzzo 2019-10-24 11:39:41 +0200
5a8a323f2a dhp-collection-worker integrated in dhp-workflows Sandro La Bruzzo 2019-10-24 11:36:59 +0200
075f741d28 [maven-release-plugin] prepare for next development iteration miconis 2019-10-24 11:34:19 +0200
ced4bcdd59 [maven-release-plugin] prepare release dnet-dedup-3.0.15 miconis 2019-10-24 11:34:12 +0200
13f93e6055 Revert "[maven-release-plugin] prepare release dnet-dedup-3.0.15" miconis 2019-10-24 11:23:01 +0200
cf93515d94 [maven-release-plugin] prepare release dnet-dedup-3.0.15 miconis 2019-10-24 11:17:07 +0200
285ec3ca17 release rollback miconis 2019-10-24 11:11:07 +0200
c8e3e4d7c3 Refactoring dependencies versions Sandro La Bruzzo 2019-10-24 10:20:31 +0200
5f249fd56c minor changes miconis 2019-10-23 16:37:20 +0200
c9863debfa minor changes and configuration updates (synonym field added) miconis 2019-10-23 16:31:45 +0200
dd1d6fcb01 moved libs in main pom file Claudio Atzori 2019-10-18 10:50:55 +0200
176a13601b commented out maven plugin for integration tests Claudio Atzori 2019-10-18 10:50:32 +0200
3f08ed94e3 replacing iis references with dhp Claudio Atzori 2019-10-18 10:49:34 +0200
e97656e915 fixed sandbox directory assignment Claudio Atzori 2019-10-18 10:48:02 +0200
0c284e0a51 doc Claudio Atzori 2019-10-18 09:42:41 +0200
c7654b6fe3 renamed collection & transformation oozie workflow files Claudio Atzori 2019-10-18 09:42:20 +0200
44d7e85797 imported oozie-installer.markdown docs from https://github.com/openaire/iis/blob/master/iis-wf/docs/oozie-installer.markdown Claudio Atzori 2019-10-17 18:43:43 +0200
27db5afdad integrating the oozie workflow build/deploy/run mechanism, took inspiration from iis Claudio Atzori 2019-10-17 18:38:30 +0200
bbb87d0e3d implemented saxonHE on transformation spark job Sandro La Bruzzo 2019-10-10 11:33:51 +0200
5499ca17c3 minor changes miconis 2019-10-08 16:49:07 +0200
50b7a12b3f normalization of the term in the translation map added miconis 2019-10-08 15:13:45 +0200
26b383fea2 translation map moved in json configuration, support for synonyms added in the configuration, now the configuration is argument of conditions, distancealgos and clusteringfunctions miconis 2019-10-08 14:53:52 +0200
4b8c7c279d Added documentation on a class, and reused ArgumetApplicationParser on dhp-aggregation Sandro La Bruzzo 2019-10-07 17:02:53 +0200
a423a6ebfd Created a generic Argument parser to be used in all modules Sandro La Bruzzo 2019-10-03 12:22:44 +0200
b259cd0bd8 changed wrong version Sandro La Bruzzo 2019-10-02 15:54:01 +0200
785b9c7cda removed dhp-mdstore-manager from pom since it was migrated to another repository Sandro La Bruzzo 2019-10-02 15:51:04 +0200
2e6c05a0e1 removed dhp-applications/dhp-mdstore-manager-app since it was migrated to another repository Sandro La Bruzzo 2019-10-02 15:50:04 +0200
27ba72da96 review readme Sandro La Bruzzo 2019-10-02 15:26:58 +0200
d584c79bf7 test commit Sandro La Bruzzo 2019-10-02 15:12:09 +0200
b877bf8a40 test commit luosolo 2019-10-02 15:08:21 +0200
a36ca1b7e9 fixed poms luosolo 2019-10-02 14:59:02 +0200
5b48bb9be1 Removed springboot dependencies, is useless luosolo 2019-10-02 14:45:12 +0200
07355d2811 [maven-release-plugin] prepare for next development iteration Claudio Atzori 2019-09-25 10:39:46 +0200
254eb46809 [maven-release-plugin] prepare release dnet-dedup-3.0.14 Claudio Atzori 2019-09-25 10:39:39 +0200
74c6462b49 updated translation map and some tests Claudio Atzori 2019-09-25 10:15:13 +0200
aed81e4cfa translation map updated miconis 2019-09-25 09:53:06 +0200
afd2b398d5 optimize imports miconis 2019-08-09 15:42:41 +0200
d71dae5fd2 implementation of the conditions in tree nodes. get rid of the conditions part of the configuration miconis 2019-08-09 15:41:49 +0200
a5c5d2f01b implementation of the decision tree. It takes place of the distance algos, necessaryConditions and sufficientConditions are still there. The model contains only path, type and name of the field. ignoreMissing is still in the model because it is used by the conditions. miconis 2019-08-09 10:08:34 +0200
f2136e1024 code refactoring: useless module removed miconis 2019-08-07 15:16:59 +0200
8c867101ef addition of a fixSpecial function to address the problem with special character in organization names, addition of new terms in translation maps miconis 2019-08-06 17:06:05 +0200
4502b44337 addition of the BlockUtils class for meta-blocking, implementation of a new local test with edge filtering example miconis 2019-08-06 12:09:34 +0200
cffb712a99 Merge branch 'master' of https://github.com/dnet-team/dnet-dedup miconis 2019-07-19 17:10:53 +0200
a85576c27e restyling of the JaroWinklerNormalizedName comparator, now it is optimized. Addition of some translations in the translation maps, addition of a clustering based on keywords in organizations legalnames miconis 2019-07-19 17:10:29 +0200
6cb846331a [maven-release-plugin] prepare for next development iteration Claudio Atzori 2019-07-08 11:12:52 +0200
c04d2232c2 [maven-release-plugin] prepare release dnet-dedup-3.0.13 Claudio Atzori 2019-07-08 11:12:45 +0200
fb5e38db26 Merge branch 'master' of https://github.com/dnet-team/dnet-dedup miconis 2019-07-08 11:02:29 +0200
3c6f8d1e44 bug fixing in the keywordsclustering class miconis 2019-07-08 11:01:49 +0200
a69022617d [maven-release-plugin] prepare for next development iteration Claudio Atzori 2019-07-08 10:11:24 +0200
c6baeb93d4 [maven-release-plugin] prepare release dnet-dedup-3.0.12 Claudio Atzori 2019-07-08 10:11:17 +0200
f5de20a508 [maven-release-plugin] rollback the release of dnet-dedup-3.0.12 miconis 2019-07-08 10:00:48 +0200
ba50aa8654 [maven-release-plugin] prepare for next development iteration miconis 2019-07-08 09:48:10 +0200
7065110a21 [maven-release-plugin] prepare release dnet-dedup-3.0.12 miconis 2019-07-08 09:48:03 +0200
15bec5e876 addition of doi normalization in PidMatch comparator, addition of keywordsclustering (clustering based on terms in the translation maps for the organizations), minor changes miconis 2019-07-08 09:44:02 +0200
2dcffb965f [maven-release-plugin] prepare for next development iteration Claudio Atzori 2019-06-19 10:02:39 +0200
85126c59f7 [maven-release-plugin] prepare release dnet-dedup-3.0.11 Claudio Atzori 2019-06-19 10:02:32 +0200
15d7b584f3 optimized classpath resolvers Claudio Atzori 2019-06-19 10:01:35 +0200
ff4956def9 [maven-release-plugin] prepare for next development iteration Claudio Atzori 2019-06-18 14:46:34 +0200
eb5ce312a3 [maven-release-plugin] prepare release dnet-dedup-3.0.10 Claudio Atzori 2019-06-18 14:46:27 +0200