dnet-hadoop

Commit Graph

Select branches

Hide Pull Requests

beta

convert_hive_to_spark_actions

deduptesting

dhp_oaf_model

dump

forceOrginalId_claims

graph_cleaning

graph_db

hive

master

monitor_dbs

observatory_country

organization_pids

promotion-prod-only

stable_ids

unique_field_in_lists

usage-stats-export-wf-v2

wf-promotion

#1

1.0.1

archive/bipFinder_master_test

archive/dedupTest

archive/islookup_timeout

archive/junit5

archive/master_pre_stable_ids

dhp-1.0.2

dhp-1.0.3

dhp-1.0.4

dhp-1.1.5

dhp-1.1.6

dhp-1.1.7

dhp-1.2.0

dhp-1.2.1

dhp-1.2.2

dhp-1.2.3

dhp-1.2.4

5af5a8ae42 added IdentifierComparator Claudio Atzori 2022-11-09 14:20:59 +0100
0419953470 merge from beta Claudio Atzori 2022-11-07 12:22:35 +0100
7c3390ac10 Merge branch 'beta' into eoscifguidelines-from-mdstores Claudio Atzori 2022-11-07 12:18:40 +0100
55fa3b2a17 Hive memory parameters dimitrispie 2022-10-28 19:00:32 +0300
fc40a4ddf7 Changes 03112022 dimitrispie 2022-11-03 15:55:27 +0200
b5e9f73eb1 Changes for result__country in observatory step observatory_country dimitrispie 2022-11-03 13:00:01 +0200
992fc5b628 Added McMaster University Institution dimitrispie 2022-11-03 11:02:18 +0200
7fda05e380 Added Autonomous University of Barcelona dimitrispie 2022-11-01 13:59:40 +0200
22873c9172 Merge pull request 'Added fields: totalcost, fundedamount, currency, in project table' (#257) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2022-10-31 13:49:27 +0100
7861c472e0 Hive memory parameters dimitrispie 2022-10-28 19:00:32 +0300
5df9c63963 Added fields: totalcost, fundedamount, currency, in project table dimitrispie 2022-10-27 16:44:26 +0300
2b9a20a4a3 Changed the way Scholexplorer filter the relationships, I found that filter all relation coming from openCitation is wrong, because we loose a lot of relation than intersect OpenCitation, but they don't come only from there Sandro La Bruzzo 2022-10-24 12:53:47 +0200
208ed32315 fixed xpath for semantic relation Alessia Bardi 2022-10-23 18:18:13 +0200
ee759ac92d file format after mvn compile Alessia Bardi 2022-10-23 18:09:47 +0200
31a10f000b Map the field oaf:eoscifguidelines from mdstores. Currently we can find it in ROHub metadata Alessia Bardi 2022-10-23 18:05:37 +0200
ec39b84898 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Claudio Atzori 2022-10-19 15:21:02 +0200
bca4a61710 suppressing hyper verbose spark logs during unit test execution Claudio Atzori 2022-10-19 15:20:58 +0200
72f0d88d6c formatted code Sandro La Bruzzo 2022-10-19 14:18:42 +0200
9b449110c6 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Claudio Atzori 2022-10-14 15:48:04 +0200
ae7cd0735a [graph2hive] more partitions Claudio Atzori 2022-10-14 15:47:58 +0200
135cf81151 Merge remote-tracking branch 'origin/beta' into beta Sandro La Bruzzo 2022-10-13 11:47:25 +0200
a1f94530a3 added documentation Sandro La Bruzzo 2022-10-13 11:47:11 +0200
b47aaf4dd1 [cleaning] subjects declared as belonging to specific vocabularies whose values are not found in the vocab are set to type keyword Claudio Atzori 2022-10-13 11:23:43 +0200
6163ecbf63 [cleaning] renamed parameters in wf action Claudio Atzori 2022-10-11 11:20:03 +0200
b301e9fdff [cleaning] renamed action name/description Claudio Atzori 2022-10-11 11:08:52 +0200
ece40adc09 [cleaning] fixing NPE in the country cleaning phase Claudio Atzori 2022-10-11 10:10:20 +0200
d51275a965 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Claudio Atzori 2022-10-07 09:52:49 +0200
8d97949316 [cleaning] fixed loop in wf nodes Claudio Atzori 2022-10-07 09:52:45 +0200
a653e1b3ea [Enrichment - result to community through organization] reimplementation of the data preparation step using spark Miriam Baglioni 2022-10-04 15:01:28 +0200
4d8339614b Revert "[BipFinder] Fixed issue for wrong escaped char in doi" Miriam Baglioni 2022-10-04 14:29:47 +0200
7324853a17 Revert "[BipFinder] refactoring" Miriam Baglioni 2022-10-04 14:29:39 +0200
28dc317350 [BipFinder] refactoring Miriam Baglioni 2022-10-04 09:47:27 +0200
188f25eefa [BipFinder] Fixed issue for wrong escaped char in doi Miriam Baglioni 2022-10-03 12:42:52 +0200
89f7007080 Merge pull request '[stats wf] misc changes' (#254) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2022-10-03 10:32:05 +0200
2c0c3f1806 Cast amount to float for table result_apcs dimitrispie 2022-09-28 19:33:24 +0300
49360770d7 map w3id as instance url Alessia Bardi 2022-09-28 14:16:39 +0200
bdc46e3eaa Remove denormalization of results to fix downloads numbers in monitor dimitrispie 2022-09-28 14:59:08 +0300
2ebb1459a9 Fixed type in no_downloads dimitrispie 2022-09-28 14:36:57 +0300
b5b5a4c192 [CleanCountry] fixed issue Miriam Baglioni 2022-09-28 12:42:51 +0200
f1d7d45cf7 [BulkTag] fixed issue Miriam Baglioni 2022-09-28 12:01:43 +0200
3ec044600d [BulkTag] fixed conflicts Miriam Baglioni 2022-09-28 11:58:28 +0200
1cb79719a7 [BulkTag] fixed issues Miriam Baglioni 2022-09-28 11:44:55 +0200
f3f7604e6c trying to fix a test that fails only on Jenkins Claudio Atzori 2022-09-27 15:21:37 +0200
de7bc9350e Merge pull request 'relation-from-odf' (#251) from relation-from-odf into beta Claudio Atzori 2022-09-27 15:08:26 +0200
3f90d159e3 code formatting Claudio Atzori 2022-09-27 15:08:00 +0200
0b3e44e521 Merge branch 'beta' into relation-from-odf Claudio Atzori 2022-09-27 14:57:01 +0200
b4b6a4457c Merge pull request 'BulkTagging extension' (#250) from horizontalConstraints into beta Claudio Atzori 2022-09-27 14:56:31 +0200
57dbeb08d2 code formatting Claudio Atzori 2022-09-27 14:55:10 +0200
b60985cf68 Merge branch 'beta' into horizontalConstraints Claudio Atzori 2022-09-27 14:39:31 +0200
3b60642ef9 Merge pull request 'Synchronize indicators in stats-db with monitor-db' (#249) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2022-09-27 14:37:33 +0200
6ad38ade74 Merge pull request 'Clean Country' (#241) from clean_country into beta Claudio Atzori 2022-09-27 14:35:35 +0200
25e9d92aad Merge branch 'beta' into clean_country Claudio Atzori 2022-09-27 14:27:49 +0200
80c5e0f637 code formatting Claudio Atzori 2022-09-27 12:51:51 +0200
fd63e9bfac Mapping all relationships supported in ModelConstants and ModelSupport Alessia Bardi 2022-09-26 11:24:13 +0200
ca216a92ad [BulkTagging] changed the query to the IS to insert values for FOS and SDG as subject in the configuration used for the tagging Miriam Baglioni 2022-09-23 17:06:07 +0200
3e6b0f58bb [BulkTagging] changed the query to the IS to get also the information for the advancedConstraint from the profile Miriam Baglioni 2022-09-23 16:47:19 +0200
4a3e119b73 mergin with branch beta Miriam Baglioni 2022-09-23 16:16:06 +0200
f0e303abf9 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2022-09-23 16:15:32 +0200
55da4d8715 [BulkTagging] modifying code to represent constraints horizontally on all the results. Added subject to the set of field used to express the constraint. Modified resorces to test the new approach. Modified test calss Miriam Baglioni 2022-09-23 16:02:19 +0200
c5eb722170 relationships from relatedIdentifier whose target id type is one of the pid type with an authority Alessia Bardi 2022-09-23 15:47:05 +0200
c86cc53520 suppressing hyper verbose spark logs during unit test execution Claudio Atzori 2022-09-23 15:19:50 +0200
c01d528ab2 suppressing hyper verbose spark logs during unit test execution Claudio Atzori 2022-09-23 15:19:50 +0200
ba33ff71fd refactoring for the generation of relationships from related identifier of type 'OPENAIRE' Alessia Bardi 2022-09-23 15:17:13 +0200
e6d788d27a [stats wf] adding missing changes lost in PR#248 Claudio Atzori 2022-09-23 14:38:42 +0200
982bcc1e35 test wrid pid and record identifier Alessia Bardi 2022-09-23 12:06:06 +0200
960cb861a0 refactoring Miriam Baglioni 2022-09-23 11:14:04 +0200
930f118673 fixed semantic (subreltype) for ServiceOrganization relations Claudio Atzori 2022-09-22 16:23:25 +0200
c42850328e fixed semantic (subreltype) for ServiceOrganization relations Claudio Atzori 2022-09-22 16:23:25 +0200
33bb79459e Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2022-09-22 15:55:17 +0200
b2c3071e72 Merge branch 'master' into beta2master_sept_2022 Claudio Atzori 2022-09-22 14:39:15 +0200
10ec074f79 Merge remote-tracking branch 'antonis.lempesis/beta' into beta2master_sept_2022 Claudio Atzori 2022-09-22 14:12:19 +0200
dcd85f8cd7 - Synchronize indicators in stats-db with monitor-db - added new openorg id for Nanyang Technological University - changed openorg id for University of Helsinki #8088 ticket dimitrispie 2022-09-22 13:33:07 +0300
7225fe9cbe integrated changes from discard-non-wellformed Claudio Atzori 2022-09-22 10:06:07 +0200
869e129288 [EOSC BulkTag] refactoring Miriam Baglioni 2022-09-20 16:13:18 +0200
840465958b [EOSC BulkTag] filtering aout the datasources registered in the eosc with compatibility different from 3.0, 4.0 for literature, data and CRIS to add the context eosc to the results Miriam Baglioni 2022-09-20 10:30:41 +0200
bdc8f993d0 [Patch Hosted By] check also the presence of datasource.officialname.value Claudio Atzori 2022-09-19 15:28:03 +0200
ec87149cb3 [Patch Hosted By] added fix to avoi NPE error when datasource official name is not provided. Removing datasources if no officialname has been provided Miriam Baglioni 2022-09-19 14:06:52 +0200
b42e2c9df6 [Patch Hosted By] added fix to avoi NPE error when datasource official name is not provided Miriam Baglioni 2022-09-19 12:30:32 +0200
1329aa8479 [EOSC BulkTag] modified test to remove association of result to eosc when eoscifguidelines are set Miriam Baglioni 2022-09-19 11:59:48 +0200
a0ee1a8640 [EOSC BulkTag] remove addition of eosc context for result with eosc if guidelines set Miriam Baglioni 2022-09-19 11:44:10 +0200
e45ec15221 Merge branch 'beta' into clean_country Claudio Atzori 2022-09-19 11:34:02 +0200
26e1badded added instance.url syntactical validation, avoid creating multiple duplicated URLs Claudio Atzori 2022-09-19 11:19:10 +0200
5240ac3d7b [EOSC Tag] remove addition of eosc context for result with eosc if guidelines set Miriam Baglioni 2022-09-19 11:02:18 +0200
192215a18e merged from branch discard-non-wellformed Claudio Atzori 2022-09-19 10:17:10 +0200
96062164f9 Merge pull request '[Aggregator graph|master] Discard invalid records' (#245) from discard-non-wellformed into master Claudio Atzori 2022-09-19 09:48:16 +0200
35bb7c423f updated dhp-schemas version to 2.12.1 Claudio Atzori 2022-09-16 16:13:15 +0200
fd87571506 code formatting Claudio Atzori 2022-09-16 16:05:03 +0200
c527112e33 Merge commit 'ff6f789b6d9be0567b6ad72f8a0e75fe3f52726a' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:59:10 +0200
65209359bc Merge commit 'b5f7bd30be7f7adaaa28170740da0484b50a77ed' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:58:11 +0200
d72a64ded3 Merge commit '690be4482fc84327dc7617acbc8d976d559df512' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:57:44 +0200
3e8499ce47 Merge commit '71b069ca90a2f7ec09d64241c60917d3636fc81e' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:57:20 +0200
61aacb3271 Merge commit '1203378441dc6d8e8435cacd42e76e11746f6d1b' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:56:55 +0200
dbb567251a merged 853c996fa2 Claudio Atzori 2022-09-16 15:56:28 +0200
c7e8ad853e Merge commit '2b5f8c9c9a3611c57ee5febfe262a455a39ad801' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:55:04 +0200
0849ebfd80 merged a11eb38065 Claudio Atzori 2022-09-16 15:53:22 +0200
281239249e Merge commit 'b7c387c21f946adbc9da90ded95166205195edb0' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:49:20 +0200
45fc5e12be Merge commit 'cb7c07c54e59675e8dffe42b7f2a13f16c956068' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:48:55 +0200
1c05aaaa2e Merge commit '3418ce50ac9b28fed4fa949919e6c8208738cdcf' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:48:36 +0200
01d5ad6361 Merge commit 'd85ba3c1a9d7f0e80565742161ff6c9ecffd52b7' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:48:16 +0200
d872d1cdd9 Merge commit 'a4815f6bec87f05be8cd740d236707949a0f746e' into beta2master_sept_2022 Claudio Atzori 2022-09-16 15:47:49 +0200