 Sandro La Bruzzo
|
bbb87d0e3d
|
implemented saxonHE on transformation spark job
|
2019-10-10 11:33:51 +02:00 |
miconis
|
5499ca17c3
|
minor changes
|
2019-10-08 16:49:07 +02:00 |
|
miconis
|
50b7a12b3f
|
normalization of the term in the translation map added
|
2019-10-08 15:13:45 +02:00 |
|
miconis
|
26b383fea2
|
translation map moved in json configuration, support for synonyms added in the configuration, now the configuration is argument of conditions, distancealgos and clusteringfunctions
|
2019-10-08 14:53:52 +02:00 |
|
Sandro La Bruzzo
|
4b8c7c279d
|
Added documentation on a class, and reused ArgumetApplicationParser on dhp-aggregation
|
2019-10-07 17:02:53 +02:00 |
|
Sandro La Bruzzo
|
a423a6ebfd
|
Created a generic Argument parser to be used in all modules
|
2019-10-03 12:22:44 +02:00 |
|
Sandro La Bruzzo
|
b259cd0bd8
|
changed wrong version
|
2019-10-02 15:54:01 +02:00 |
|
Sandro La Bruzzo
|
785b9c7cda
|
removed dhp-mdstore-manager from pom since it was migrated to another repository
|
2019-10-02 15:51:04 +02:00 |
|
Sandro La Bruzzo
|
2e6c05a0e1
|
removed dhp-applications/dhp-mdstore-manager-app since it was migrated to another repository
|
2019-10-02 15:50:04 +02:00 |
|
Sandro La Bruzzo
|
27ba72da96
|
review readme
|
2019-10-02 15:26:58 +02:00 |
|
Sandro La Bruzzo
|
d584c79bf7
|
test commit
|
2019-10-02 15:12:09 +02:00 |
luosolo
|
b877bf8a40
|
test commit
|
2019-10-02 15:08:21 +02:00 |
|
luosolo
|
a36ca1b7e9
|
fixed poms
|
2019-10-02 14:59:02 +02:00 |
|
luosolo
|
5b48bb9be1
|
Removed springboot dependencies, is useless
|
2019-10-02 14:45:12 +02:00 |
 Claudio Atzori
|
07355d2811
|
[maven-release-plugin] prepare for next development iteration
|
2019-09-25 10:39:46 +02:00 |
|
Claudio Atzori
|
254eb46809
|
[maven-release-plugin] prepare release dnet-dedup-3.0.14
|
2019-09-25 10:39:39 +02:00 |
|
Claudio Atzori
|
74c6462b49
|
updated translation map and some tests
|
2019-09-25 10:15:13 +02:00 |
|
miconis
|
aed81e4cfa
|
translation map updated
|
2019-09-25 09:53:06 +02:00 |
|
miconis
|
afd2b398d5
|
optimize imports
|
2019-08-09 15:42:41 +02:00 |
|
miconis
|
d71dae5fd2
|
implementation of the conditions in tree nodes. get rid of the conditions part of the configuration
|
2019-08-09 15:41:49 +02:00 |
|
miconis
|
a5c5d2f01b
|
implementation of the decision tree. It takes place of the distance algos, necessaryConditions and sufficientConditions are still there. The model contains only path, type and name of the field. ignoreMissing is still in the model because it is used by the conditions.
|
2019-08-09 10:08:34 +02:00 |
|
miconis
|
f2136e1024
|
code refactoring: useless module removed
|
2019-08-07 15:16:59 +02:00 |
|
miconis
|
8c867101ef
|
addition of a fixSpecial function to address the problem with special character in organization names, addition of new terms in translation maps
|
2019-08-06 17:06:05 +02:00 |
|
miconis
|
4502b44337
|
addition of the BlockUtils class for meta-blocking, implementation of a new local test with edge filtering example
|
2019-08-06 12:09:34 +02:00 |
|
miconis
|
cffb712a99
|
Merge branch 'master' of https://github.com/dnet-team/dnet-dedup
|
2019-07-19 17:10:53 +02:00 |
|
miconis
|
a85576c27e
|
restyling of the JaroWinklerNormalizedName comparator, now it is optimized. Addition of some translations in the translation maps, addition of a clustering based on keywords in organizations legalnames
|
2019-07-19 17:10:29 +02:00 |
|
Claudio Atzori
|
6cb846331a
|
[maven-release-plugin] prepare for next development iteration
|
2019-07-08 11:12:52 +02:00 |
|
Claudio Atzori
|
c04d2232c2
|
[maven-release-plugin] prepare release dnet-dedup-3.0.13
|
2019-07-08 11:12:45 +02:00 |
|
miconis
|
fb5e38db26
|
Merge branch 'master' of https://github.com/dnet-team/dnet-dedup
|
2019-07-08 11:02:29 +02:00 |
|
miconis
|
3c6f8d1e44
|
bug fixing in the keywordsclustering class
|
2019-07-08 11:01:49 +02:00 |
|
Claudio Atzori
|
a69022617d
|
[maven-release-plugin] prepare for next development iteration
|
2019-07-08 10:11:24 +02:00 |
|
Claudio Atzori
|
c6baeb93d4
|
[maven-release-plugin] prepare release dnet-dedup-3.0.12
|
2019-07-08 10:11:17 +02:00 |
|
miconis
|
f5de20a508
|
[maven-release-plugin] rollback the release of dnet-dedup-3.0.12
|
2019-07-08 10:00:48 +02:00 |
|
miconis
|
ba50aa8654
|
[maven-release-plugin] prepare for next development iteration
|
2019-07-08 09:48:10 +02:00 |
|
miconis
|
7065110a21
|
[maven-release-plugin] prepare release dnet-dedup-3.0.12
|
2019-07-08 09:48:03 +02:00 |
|
miconis
|
15bec5e876
|
addition of doi normalization in PidMatch comparator, addition of keywordsclustering (clustering based on terms in the translation maps for the organizations), minor changes
|
2019-07-08 09:44:02 +02:00 |
|
Claudio Atzori
|
2dcffb965f
|
[maven-release-plugin] prepare for next development iteration
|
2019-06-19 10:02:39 +02:00 |
|
Claudio Atzori
|
85126c59f7
|
[maven-release-plugin] prepare release dnet-dedup-3.0.11
|
2019-06-19 10:02:32 +02:00 |
|
Claudio Atzori
|
15d7b584f3
|
optimized classpath resolvers
|
2019-06-19 10:01:35 +02:00 |
|
Claudio Atzori
|
ff4956def9
|
[maven-release-plugin] prepare for next development iteration
|
2019-06-18 14:46:34 +02:00 |
|
Claudio Atzori
|
eb5ce312a3
|
[maven-release-plugin] prepare release dnet-dedup-3.0.10
|
2019-06-18 14:46:27 +02:00 |
|
Claudio Atzori
|
f2bc665403
|
avoid to divide by zero: in case of missing values, return undefined response
|
2019-06-18 14:45:15 +02:00 |
|
Claudio Atzori
|
e3f86b92c8
|
cleanup
|
2019-06-18 14:44:42 +02:00 |
|
miconis
|
54e4d0af04
|
exact match condition gives undefined if a field is missing, ignoremissing semantics changed: now performs the comparison in any case if =true, if false gives -1 in case of missing
|
2019-06-18 14:05:31 +02:00 |
|
miconis
|
e8db8f2abb
|
implementation of the integration test, addition of document blocks to group entities after clustering
|
2019-05-21 16:38:26 +02:00 |
|
Sandro La Bruzzo
|
53ec9bccca
|
changed the implemetation of RabitMQ Comunication
|
2019-04-16 12:28:01 +02:00 |
|
Sandro La Bruzzo
|
403c13eebf
|
Implemented message manager, Fixed bug on collection worker, implemented Collecion and Transform spark job
|
2019-04-11 15:39:29 +02:00 |
enricoottonello
|
58c4e1f725
|
cleaned properties
|
2019-04-09 12:17:03 +02:00 |
|
Sandro La Bruzzo
|
9294851a6c
|
implemented comunication layer using rabbitMq between oozie node and Dnet
|
2019-04-05 12:19:25 +02:00 |
|
Sandro La Bruzzo
|
3f4ba71bbd
|
resolved conflicts
|
2019-04-03 16:12:57 +02:00 |