dnet-hadoop

Commit Graph

Select branches

Hide Pull Requests

dedupTest

deduptesting

doiboost

hive_timeout

impala_changes_by_alexiou

junit5

master

migration_wfs_regular_all_steps

provision_dataset

provision_indexing

scholexplorer

stats_wf_extensions_and_corrections

usage-stats-export-wf

#1

#2

1.0.1

archive/bipFinder_master_test

archive/dedupTest

archive/islookup_timeout

archive/junit5

dhp-1.0.2

dhp-1.0.3

dhp-1.0.4

dhp-1.1.5

dhp-1.1.6

dhp-1.1.7

dhp-1.2.0

dhp-1.2.1

dhp-1.2.2

dhp-1.2.3

dhp-1.2.4

79336d46c5 [Clean Context] first naive implementation of a functionality to clean not wanted contextes from one result. This implementation simply verifies the main title of the results start with a given string Miriam Baglioni 2022-04-04 15:52:31 +0200
873369af1c Merge pull request '[stats wf] added apcs in monitor db' (#207) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2022-03-29 15:40:20 +0200
7112806a73 views cannot be stored as parquet... Antonis Lempesis 2022-03-29 16:37:29 +0300
fff0b3cc19 added apcs in monitor db Antonis Lempesis 2022-03-29 14:15:31 +0300
de85367695 Merge pull request '[stats wf] fix: views cannot be stored as parquet...' (#206) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2022-03-29 12:51:02 +0200
ee24f3eb2c views cannot be stored as parquet... Antonis Lempesis 2022-03-29 13:47:48 +0300
1b11010169 minor fix Sandro La Bruzzo 2022-03-29 10:59:14 +0200
0a0ae84c22 [graph raw] DOI based instance URLs on https Claudio Atzori 2022-03-29 10:52:58 +0200
eca82e30c9 updated dhp-schema version Claudio Atzori 2022-03-29 09:46:49 +0200
9fa3dd78fe Merge pull request '[stats wf] various fixes, organization ids for inst. dashboard' (#205) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2022-03-28 22:03:49 +0200
5d53ac95aa Merge pull request 'XML serialisation of instances with the same URLs - 2nd round' (#204) from instance_group_by_url into beta Claudio Atzori 2022-03-28 09:24:00 +0200
96aa2a5d0d Merge branch 'beta' into instance_group_by_url Claudio Atzori 2022-03-28 09:23:52 +0200
395ac6ecec merged pom.xml from beta branch Claudio Atzori 2022-03-28 09:23:42 +0200
fa3cb84f77 Merge pull request 'Datasource consent fields' (#202) from datasource_pdf_consent into beta Claudio Atzori 2022-03-28 09:21:14 +0200
741bc99c47 Merge branch 'beta' into datasource_pdf_consent Claudio Atzori 2022-03-28 09:20:48 +0200
3610f1749a merged pom.xml from beta branch Claudio Atzori 2022-03-28 09:20:27 +0200
61319b2e83 updated dhp-schema version; set entity-level dataInfo before & after merging the fields from the group of duplicates Claudio Atzori 2022-03-25 16:38:33 +0100
d8503cd191 added moooar organizations Antonis Lempesis 2022-03-24 14:02:36 +0200
7b8f85692e [Enrichment country] fixed issues with parameters and workflow args Miriam Baglioni 2022-03-23 17:20:23 +0100
48d32466e4 instances grouped by URL expose only one refereed Claudio Atzori 2022-03-23 14:52:03 +0100
f10066547b increased spark.sql.shuffle.partitions in affiliation_from_semrel_propagation Claudio Atzori 2022-03-23 12:22:26 +0100
43733c1a18 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Claudio Atzori 2022-03-23 12:14:27 +0100
62f91b0869 cleanup Antonis Lempesis 2022-03-22 16:17:49 +0200
2e8394ecf8 creating aaall tables as parquet Antonis Lempesis 2022-03-22 16:16:08 +0200
dcfbeb8142 yet more typos Antonis Lempesis 2022-03-21 12:36:03 +0200
89fd275480 [HostedByMap] added left over from PR and fixed issue on workflow Miriam Baglioni 2022-03-21 09:54:45 +0100
c763aded70 dependency updated to the new pace-core version miconis 2022-03-16 16:41:50 +0100
c959639bd5 dependency updated to the new pace-core version miconis 2022-03-15 16:33:03 +0100
10172553ab [maven-release-plugin] prepare for next development iteration miconis 2022-03-15 15:06:18 +0100
bd919ac98d [maven-release-plugin] prepare release dnet-dedup-4.1.12 miconis 2022-03-15 15:06:12 +0100
a965233dd0 bug fix in the normalization of a legalname, city map updated and transliteration support added miconis 2022-03-15 14:59:13 +0100
0f7d8ca2e0 [HostedByMap] change on master to align to PR 201 on beta merged as 9f3036c847 Miriam Baglioni 2022-03-11 15:16:02 +0100
f430029596 cleanup Claudio Atzori 2022-03-11 14:28:28 +0100
d48ccfd65e Merge pull request 'enrichment_country' (#203) from enrichment_country into beta Claudio Atzori 2022-03-11 14:27:01 +0100
12de9acb0d [Country Propagation] left out from previous commit Miriam Baglioni 2022-03-11 14:17:02 +0100
2fbb35ade5 mergin with branch beta Miriam Baglioni 2022-03-11 13:58:10 +0100
4437f9345d [Country Propagation] left out from previous commit Miriam Baglioni 2022-03-11 13:57:47 +0100
2b643059fa [Country Propagation] changed the logic to get the collectedfrom at the result level. To fix issue when no instance is created for a result that should have the country associated. Change the code to use spark instead of hive to prepare the data needed for the propagation step. Added new tests for the intermediate steps and new verification for the propagation itself Miriam Baglioni 2022-03-11 13:56:48 +0100
f25407bbe2 added mapping for datasource consent fields to integrate them in the graph Claudio Atzori 2022-03-11 09:32:42 +0100
ac9708e31b [maven-release-plugin] prepare for next development iteration miconis 2022-03-09 13:43:48 +0100
a5a6054039 [maven-release-plugin] prepare release dnet-dedup-4.1.11 miconis 2022-03-09 13:43:44 +0100
3bc07c5881 bug fix in the AuthorMatch, implementation of the concat function in the model creation with jpath query miconis 2022-03-09 12:53:09 +0100
699612dd17 implementation of the size threshold on authors list match miconis 2022-03-08 16:49:28 +0100
9f3036c847 Merge pull request 'HostedByMap' (#201) from hostedByMap_update into beta Claudio Atzori 2022-03-04 16:26:27 +0100
2c5087d55a [HostedByMap] download of doaj from json, modification of test resources, deletion of class no more needed for the CSV download Miriam Baglioni 2022-03-04 15:18:21 +0100
5d608d6291 [HostedByMap] changed the model to include also oaStart date and review process that could be possibly used in the future Miriam Baglioni 2022-03-04 11:06:09 +0100
b7c2340952 [HostedByMap - DOIBoost] changed to use code moved to common since used also from hostedbymap now Miriam Baglioni 2022-03-04 11:05:23 +0100
8a41f63348 [HostedByMap] update to download the json instead of the csv Miriam Baglioni 2022-03-04 10:38:43 +0100
44b0c03080 [HostedByMap] update to download the json instead of the csv Miriam Baglioni 2022-03-04 10:37:59 +0100
ad78e505da yet another fix Antonis Lempesis 2022-03-03 12:28:12 +0200
3be8737c32 [graph-stats] fixed query after the change in the indicator table related to PR#200 Miriam Baglioni 2022-03-02 14:09:05 +0100
3970651ee1 Merge pull request 'fixed query after the change in the indicator table' (#200) from antonis.lempesis/dnet-hadoop:beta into beta Miriam Baglioni 2022-03-02 14:05:58 +0100
efeeebfee1 fixed query after the change in the indicator table Antonis Lempesis 2022-03-02 13:29:25 +0200
580d904aae manually merging PR#199 D-Net/dnet-hadoop#199 Claudio Atzori 2022-02-25 12:22:50 +0100
1932a65d1c Merge pull request '[Stats wf] sprint 6 indicators' (#198) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2022-02-25 12:09:18 +0100
f5b0a6f89c [master to beta] fixed issues in test files Miriam Baglioni 2022-02-25 10:21:57 +0100
8991d097b4 bug fix in the DedupRecordFactory, DataInfo set before merge miconis 2022-02-24 17:08:24 +0100
fe1c966cbf Merge branch 'master_202203' of code-repo.d4science.org:D-Net/dnet-hadoop into master_202203 miconis 2022-02-24 17:08:38 +0100
b0f369dc78 bug fix in the DedupRecordFactory, DataInfo set before merge miconis 2022-02-24 17:08:24 +0100
859cb7ac9d [DoiBoost AR] changed test resource to be sure the result will always have EMBARGO as value for AccessRight Miriam Baglioni 2022-02-24 16:55:32 +0100
a40b59b7d5 [ResultToOrgFromInstRepoTest] fixed issue in model of the input resources Miriam Baglioni 2022-02-24 16:05:57 +0100
66c09b1bc7 code formatting Claudio Atzori 2022-02-24 12:58:07 +0100
e7016c3981 Merge branch 'master_202203' into beta Claudio Atzori 2022-02-24 12:51:58 +0100
a87c070447 conflicts resolved, merged from beta Claudio Atzori 2022-02-24 12:51:31 +0100
55caa389d5 Merge branch 'master' of https://code-repo.d4science.org/D-Net/dnet-hadoop Claudio Atzori 2022-02-24 12:16:43 +0100
ab36154e3e added more ignores Claudio Atzori 2022-02-24 12:16:17 +0100
fbf192d6ba Merge pull request '[provision wf] serialize measures defined on the result level' (#196) from xml_measures into beta Claudio Atzori 2022-02-23 15:56:28 +0100
86cdb7a38f [provision] serialize measures defined on the result level Claudio Atzori 2022-02-23 15:54:18 +0100
9d6203f79b test mapping datasource Alessia Bardi 2022-02-23 15:00:53 +0100
3b92a2ab9c added the rest of spring 6 in monitor db Antonis Lempesis 2022-02-23 12:05:57 +0200
9a75ca1ae4 Merge branch 'beta' of https://code-repo.d4science.org/antonis.lempesis/dnet-hadoop into beta dimitrispie 2022-02-22 14:46:51 +0200
87c91f70a2 added sprint 6 indicators to monitor db Antonis Lempesis 2022-02-18 17:11:23 +0200
0bff45e739 added sprint 6 indicators to monitor db Antonis Lempesis 2022-02-18 17:11:23 +0200
5226d0a100 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Claudio Atzori 2022-02-18 15:21:07 +0100
99f5b14469 [graph raw] invisible records stored among the raw graph rather than the claimed subgraph Claudio Atzori 2022-02-18 15:20:57 +0100
401dd38074 code formatting Claudio Atzori 2022-02-18 15:19:15 +0100
cf8443780e added processingchargeamount to the result view Claudio Atzori 2022-02-18 15:17:48 +0100
891781ee3f Merge branch 'beta' of code-repo.d4science.org:D-Net/dnet-hadoop into beta Sandro La Bruzzo 2022-02-18 11:11:32 +0100
d3f03abd51 fixed wrong json path Sandro La Bruzzo 2022-02-18 11:11:17 +0100
56e048ef21 Merge pull request 'added hierarchy rel in ROR actionset' (#153) from hierarchical_orgs_relations into beta Claudio Atzori 2022-02-17 10:31:56 +0100
89c7313fc5 Merge branch 'beta' into hierarchical_orgs_relations Claudio Atzori 2022-02-17 10:30:04 +0100
58c59f46eb Added Sprint 6 dimitrispie 2022-02-17 10:21:09 +0200
5772f92dba merged beta chnages in hive branch Antonis Lempesis 2022-02-15 13:24:51 +0200
393a4ee956 fixed yet another typo... Antonis Lempesis 2022-02-15 12:56:50 +0200
3aa2020b24 added script to regenerate hostedBy Map following instruction defined on ticket #7539 Sandro La Bruzzo 2022-02-15 11:05:27 +0100
90e197a563 Merge pull request '[OpenCitation] changed the name of destination folders' (#195) from openCitations into beta Miriam Baglioni 2022-02-14 15:52:10 +0100
be64055cfe [OpenCitation] changed the name of destination folders Miriam Baglioni 2022-02-14 15:49:44 +0100
a1013e62d4 Merge pull request 'openCitations' (#194) from openCitations into beta Miriam Baglioni 2022-02-14 14:58:28 +0100
1490867cc7 [OpenCitation] cleaning of the COCI model Miriam Baglioni 2022-02-14 14:52:12 +0100
c191080965 mergin with branch beta Miriam Baglioni 2022-02-14 14:49:39 +0100
6158170334 testing delegated authority and bumped dep to schemas Alessia Bardi 2022-02-11 18:05:18 +0100
600ede1798 serialisation of APCs int he XML records Alessia Bardi 2022-02-11 11:00:20 +0100
5c4043dba8 [OpenCitation] refactoring Miriam Baglioni 2022-02-08 16:23:05 +0100
759ed519f2 [OpenCitation] added logic to avoid the genration of self citations relations Miriam Baglioni 2022-02-08 16:15:34 +0100
b071f8e415 [OpenCitation] change to extract in json format each folder just onece Miriam Baglioni 2022-02-08 15:37:28 +0100
fbc28ee8c3 [OpenCitation] change the integration logic to consider dois with commas inside Miriam Baglioni 2022-02-07 18:32:08 +0100
78be2975f0 [stats-wf]fixed another typo related to PR#193 Miriam Baglioni 2022-02-07 11:22:08 +0100
1f8302dc37 Merge pull request '[stats-wf]fixed yet another typo' (#193) from antonis.lempesis/dnet-hadoop:beta into beta Miriam Baglioni 2022-02-07 11:19:26 +0100
5f762cbd09 fixed yet another typo Antonis Lempesis 2022-02-07 12:09:12 +0200
b04ecfcf13 Merge pull request 'extendResult' (#192) from extendResult into beta Alessia Bardi 2022-02-04 16:43:58 +0100