dnet-hadoop

Commit Graph

Select branches

Hide Pull Requests

beta

convert_hive_to_spark_actions

deduptesting

dhp_oaf_model

dump

forceOrginalId_claims

graph_cleaning

graph_db

hive

master

monitor_dbs

observatory_country

organization_pids

promotion-prod-only

stable_ids

unique_field_in_lists

usage-stats-export-wf-v2

wf-promotion

#1

1.0.1

archive/bipFinder_master_test

archive/dedupTest

archive/islookup_timeout

archive/junit5

archive/master_pre_stable_ids

dhp-1.0.2

dhp-1.0.3

dhp-1.0.4

dhp-1.1.5

dhp-1.1.6

dhp-1.1.7

dhp-1.2.0

dhp-1.2.1

dhp-1.2.2

dhp-1.2.3

dhp-1.2.4

242d647146 cleanup & docs Claudio Atzori 2023-10-12 12:23:20 +0200
76447958bb cleanup & docs Claudio Atzori 2023-10-12 12:23:20 +0200
af3ffad6c4 [AMF] docs Claudio Atzori 2023-10-12 10:05:46 +0200
1902728f7e Merge pull request '[ActionManagerFramework] documentation' (#347) from actionset_docs into beta Claudio Atzori 2023-10-12 10:07:25 +0200
dda602fff7 [AMF] docs Claudio Atzori 2023-10-12 10:05:46 +0200
05ee7d8b09 [graph cleaning] avoid NPEs Claudio Atzori 2023-10-12 09:13:42 +0200
8e9493fad9 mergin with branch beta Miriam Baglioni 2023-10-11 18:18:09 +0200
89184d5b4f used the API instead of the IS for bulktagging and propagation for community through organization. Added a new propagation step for communities through projects. Still using the API and not the IS Miriam Baglioni 2023-10-11 18:17:35 +0200
554551682d [raw graph] adopting the new COAR based vocabularies for the resource typing Claudio Atzori 2023-10-11 16:09:19 +0200
a460ebe215 [UnresolvedEntities] updated action name Claudio Atzori 2023-10-10 15:50:11 +0200
ecea58a41c Merge pull request '[UnresolvedEntities] changing in the creation of the unresolved entities' (#346) from fos into beta Claudio Atzori 2023-10-10 15:10:21 +0200
66064e99fe Merge branch 'beta' into fos Claudio Atzori 2023-10-10 15:07:21 +0200
a431b04814 leftover for the properties and removal of bipfinder Miriam Baglioni 2023-10-10 12:53:57 +0200
ed9282ef2a removed module dhp-stats-monitor-update Claudio Atzori 2023-10-10 09:52:03 +0200
110ce4b40f extend the fos model to include the level4 and the scores for level3 and level4. removed bip indicators from the instance Miriam Baglioni 2023-10-10 09:46:40 +0200
204404b0e3 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Claudio Atzori 2023-10-10 09:36:13 +0200
9a98f408b3 code formatting Claudio Atzori 2023-10-10 09:36:11 +0200
4e6fccf4f6 Merge pull request 'Beta stats wf updated' (#332) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2023-10-10 09:35:32 +0200
a3d01ccb24 refactoring Miriam Baglioni 2023-10-09 14:52:17 +0200
8448b9ebfb mergin with branch beta Miriam Baglioni 2023-10-09 14:27:23 +0200
3d6be20989 changes to use the API instead of the IS the get the information for the communities to be used during bulktagging and context propagation Miriam Baglioni 2023-10-09 14:26:33 +0200
17586f0ff8 Update step20-createMonitorDB.sql dimitrispie 2023-10-09 14:21:31 +0300
489a082f04 Update step16-createIndicatorsTables.sql dimitrispie 2023-10-09 14:00:50 +0300
ef833840c3 [Doiboost] removed linkage to SFI unidentified project Claudio Atzori 2023-10-06 15:48:18 +0200
84a58802ab [OC] using the common pid cleaning function Claudio Atzori 2023-10-06 14:48:05 +0200
46034630cf [OC] compress the output actionset Claudio Atzori 2023-10-06 14:42:02 +0200
774e874d18 Merge pull request 'implemented relation to irish funder from a Json list' (#344) from irish_funder into beta Claudio Atzori 2023-10-06 14:26:54 +0200
3bc44fbf1d Merge branch 'beta' into irish_funder Claudio Atzori 2023-10-06 14:26:41 +0200
11153742c9 Merge pull request 'Extending the coverage of the peer non-unknown refereed instances' (#342) from peer_reviewed into beta Claudio Atzori 2023-10-06 14:22:13 +0200
8108491722 Merge branch 'beta' into peer_reviewed Claudio Atzori 2023-10-06 14:21:52 +0200
2f3cf6d0e7 Fix cleaning of Pmid where parsing of numbers stopped at first not leading 0' character Giambattista Bloisi 2023-10-06 12:35:54 +0200
ba5475ed4c Merge pull request 'Fix cleaning of Pmid where parsing of numbers stopped at first not leading 0 (zero) character' (#345) from fix_truncated_pmid into master Claudio Atzori 2023-10-06 14:19:49 +0200
6856ab28ab Merge pull request 'SWH_integration' (#343) from SWH_integration into beta Claudio Atzori 2023-10-06 14:15:56 +0200
3c23d5f9bc Merge branch 'beta' into SWH_integration Claudio Atzori 2023-10-06 14:15:38 +0200
858931ccb6 [SWH] compress the output actionset Claudio Atzori 2023-10-06 14:03:33 +0200
f759b18bca [SWH] aligned parameter name Claudio Atzori 2023-10-06 13:43:20 +0200
2c235e82ad Fix cleaning of Pmid where parsing of numbers stopped at first not leading 0' character Giambattista Bloisi 2023-10-06 12:35:54 +0200
eed9fe0902 code formatting Claudio Atzori 2023-10-06 12:31:17 +0200
7f27111b1f Merge branch 'importpoci' into beta Claudio Atzori 2023-10-06 12:23:28 +0200
73c49b8d26 Merge branch 'beta' into SWH_integration Claudio Atzori 2023-10-06 12:21:51 +0200
42a2dad975 implemented relation to irish funder from a Json list Sandro La Bruzzo 2023-10-06 11:52:33 +0200
13f332ce77 ignored jenv prop Sandro La Bruzzo 2023-10-06 10:40:05 +0200
1bb83b9188 Add prefix in SWH ID Serafeim Chatzopoulos 2023-10-04 20:31:45 +0300
ee8a39e7d2 cleanup and refinements Claudio Atzori 2023-10-04 12:32:05 +0200
e9f24df21c Move SWH API Key from constants to workflow param Serafeim Chatzopoulos 2023-10-03 20:57:57 +0300
cae75fc75d Add SWH in the collectedFrom field Serafeim Chatzopoulos 2023-10-03 16:55:10 +0300
b49a3ac9b2 Add actionsetsPath as a global WF param Serafeim Chatzopoulos 2023-10-03 15:43:38 +0300
24c43e0c60 Restructure workflow parameters Serafeim Chatzopoulos 2023-10-03 15:11:58 +0300
9f73d93e62 Add param for limiting repo Urls Serafeim Chatzopoulos 2023-10-03 14:39:08 +0300
b446a9ed98 Merge branch 'beta' into peer_reviewed Claudio Atzori 2023-10-03 10:52:23 +0200
f344ad76d0 Merge pull request 'extended existing code to import of POCI from open citation' (#340) from importpoci into beta Claudio Atzori 2023-10-03 10:52:11 +0200
5919e488dd Merge branch 'beta' into importpoci Claudio Atzori 2023-10-03 10:43:53 +0200
839a8524e7 Add action for creating actionsets Serafeim Chatzopoulos 2023-10-02 23:50:38 +0300
c9a5ad6a02 extending the coverage of the peer non-unknown refereed instances Claudio Atzori 2023-10-02 16:28:42 +0200
d7fccdc64b fixed paths in wf to match the req of the pathname Miriam Baglioni 2023-10-02 14:10:57 +0200
9898470b0e Addressing comments in D-Net/dnet-hadoop#340\#issuecomment-10592 Miriam Baglioni 2023-10-02 12:54:16 +0200
c412dc162b Fix bug in conversion from dedup json model to Spark Dataset of Rows: list of strings contained the json escaped representation of the value instead of the plain value, this caused instanceTypeMatch failures because of the leading and trailing double quotes Giambattista Bloisi 2023-09-27 22:30:47 +0200
4ac06c9e37 Merge pull request 'Fix bug in conversion from dedup json model to Spark Dataset of Rows (instanceTypeMatch no longer working)' (#339) from fix_dedupfailsonmatchinginstances into master Claudio Atzori 2023-10-02 11:34:20 +0200
fa692b3629 Merge branch 'master' into fix_dedupfailsonmatchinginstances Claudio Atzori 2023-10-02 11:28:16 +0200
5d09b7db8b Merge pull request 'SparkPropagateRelation relations do not propagate deletedByInference and invisible' (#333) from consistency_keep_mergerels into beta Claudio Atzori 2023-10-02 11:27:57 +0200
7b403a920f Merge branch 'beta' into consistency_keep_mergerels Claudio Atzori 2023-10-02 11:26:00 +0200
dc86018a5f Merge branch 'merge_entities_job' into beta Claudio Atzori 2023-10-02 11:24:48 +0200
3c47920c78 Use asScala to convert java List to Scala Sequence Giambattista Bloisi 2023-09-20 16:14:01 +0200
7f244d9a7a code formatting Claudio Atzori 2023-09-20 15:53:21 +0200
e239b81740 Fix defect #8997: GenerateEventsJob is generating huge amounts of logs because broker entity similarity calculation consistently failed Giambattista Bloisi 2023-09-20 15:42:00 +0200
ef02648399 Merge pull request 'fixed dedup configuration management in the Broker workflow' (#341) from fix_8997 into master Claudio Atzori 2023-10-02 11:03:50 +0200
d13bb534f0 Merge branch 'master' into fix_8997 Claudio Atzori 2023-10-02 11:03:18 +0200
e84f5b5e64 extended existing codo to accomodate import of POCI from open citation Miriam Baglioni 2023-10-02 09:25:16 +0200
ab0d70691c Add step for archiving repoUrls to SWH Serafeim Chatzopoulos 2023-09-28 20:56:18 +0300
775c3f704a Fix bug in conversion from dedup json model to Spark Dataset of Rows: list of strings contained the json escaped representation of the value instead of the plain value, this caused instanceTypeMatch failures because of the leading and trailing double quotes Giambattista Bloisi 2023-09-27 22:30:47 +0200
ed9c81a0b7 Add steps to collect last visit data && archive not found repository URLs Serafeim Chatzopoulos 2023-09-27 19:00:54 +0300
9c3ab11d5b Merge branch 'master' of code-repo.d4science.org:D-Net/dnet-hadoop Sandro La Bruzzo 2023-09-25 15:29:19 +0200
423ef30676 minor fix on the aggregation of uniprot and pdb Sandro La Bruzzo 2023-09-25 15:28:58 +0200
7152d47f84 Use asScala to convert java List to Scala Sequence Giambattista Bloisi 2023-09-20 16:14:01 +0200
4853c19b5e code formatting Claudio Atzori 2023-09-20 15:53:21 +0200
1f226d1dce Fix defect #8997: GenerateEventsJob is generating huge amounts of logs because broker entity similarity calculation consistently failed Giambattista Bloisi 2023-09-20 15:42:00 +0200
0935d7757c Use v5 of the UNIBI Gold ISSN list in test Alessia Bardi 2023-09-19 14:47:01 +0200
cc7204a089 tests for d4science catalog Alessia Bardi 2023-09-19 13:38:25 +0200
76476cdfb6 Added maven repo for dependencies that are not in maven central Sandro La Bruzzo 2023-09-20 10:33:14 +0200
6186cdc2cc Use v5 of the UNIBI Gold ISSN list in test Alessia Bardi 2023-09-19 14:47:01 +0200
d94b9bebf7 Merge branch 'master' of https://code-repo.d4science.org/D-Net/dnet-hadoop Alessia Bardi 2023-09-19 13:38:45 +0200
19abba8fa7 tests for d4science catalog Alessia Bardi 2023-09-19 13:38:25 +0200
9ef971a146 Update step16-createIndicatorsTables.sql dimitrispie 2023-09-19 14:25:42 +0300
9d44418d38 Add collecting software code repository URLs Serafeim Chatzopoulos 2023-09-14 18:43:25 +0300
395a4af020 Run CC and RAM sequentieally in dhp-impact-indicators WF Serafeim Chatzopoulos 2023-09-12 22:31:50 +0300
c2f179800c Merge pull request 'Run CC and RAM sequentieally in dhp-impact-indicators WF' (#338) from run_cc_and_ram_sequentially into master Claudio Atzori 2023-09-13 08:52:53 +0200
2aed5a74be Run CC and RAM sequentieally in dhp-impact-indicators WF Serafeim Chatzopoulos 2023-09-12 22:31:50 +0300
8a6892cc63 [graph dedup] consistency wf should not remove the relations while dispatching the entities Claudio Atzori 2023-09-12 14:34:28 +0200
4dc4862011 Merge branch 'master' of https://code-repo.d4science.org/D-Net/dnet-hadoop 1694585884046600017/tmp_refs/heads/master 1694585884046600017/master Claudio Atzori 2023-09-12 14:34:34 +0200
dc80ab14d3 [graph dedup] consistency wf should not remove the relations while dispatching the entities Claudio Atzori 2023-09-12 14:34:28 +0200
77a2199837 updated test for EOSC comunity Alessia Bardi 2023-09-08 11:05:49 +0200
4786aa0e09 added Archive ouverte UNIGE (ETHZ.UNIGENF, opendoar____::1400) to the Datacite hostedBy_map Claudio Atzori 2023-09-07 11:20:35 +0200
265180bfd2 added Archive ouverte UNIGE (ETHZ.UNIGENF, opendoar____::1400) to the Datacite hostedBy_map Claudio Atzori 2023-09-07 11:20:35 +0200
5f90cc11e9 Update step16-createIndicatorsTables.sql dimitrispie 2023-09-06 14:14:38 +0300
da0e9828f7 resolved conflicts for PR#337 Claudio Atzori 2023-09-06 11:28:46 +0200
9f5d16624c Merge pull request '[graph raw] datainfo.invisible set as true only for entities' (#336) from invisible_relations into beta Claudio Atzori 2023-09-04 16:14:47 +0200
adec6692ca Merge branch 'beta' into invisible_relations Claudio Atzori 2023-09-04 16:13:06 +0200
15666e86a8 added collectedfrom to the affiliation relations imported from Crossref Claudio Atzori 2023-09-04 15:56:06 +0200
7d6bd4f20b Merge pull request 'Fix import of affiliations relations from Crossref' (#335) from 8876_fix_crossref_affiliation_relations_import into beta Claudio Atzori 2023-09-04 15:19:58 +0200
5b06c9d06f [graph raw] datainfo.invisible set as true only for entities Claudio Atzori 2023-09-04 15:15:24 +0200