Commit Graph

5147 Commits (master)
 

Author SHA1 Message Date
Claudio Atzori 6132bd028e Merge pull request 'Extend Crossref-funders mapping and datacite hostedbymap' (#417) from CrossrefFundersMap into master
Reviewed-on: #417
1 week ago
Miriam Baglioni 519db1ddef Extended mapping of funder from crossref (#9169, #9277) and change the correspondece files for the irish fundrs (#9635). Extended the datacite map to include the association between metadata and the EBRAINS datasource (SciLake) 1 week ago
Claudio Atzori 5add51f38c Merge pull request 'fixed the result_country definition and updated the stats DB copy procedure' (#412) from antonis.lempesis/dnet-hadoop:beta into master
Reviewed-on: #412
2 weeks ago
Lampros Smyrnaios b7c8acc563 - Update the code which acquires the "IMPALA_HDFS_NODE", to test the "tmp"-dir, instead of the base-dir and introduce retries, to overcome potential file-system failures. This change was suggested by "Sebastian Tymkow" and "Grzegorz Bakalarski".
- Fix typos.
2 weeks ago
Antonis Lempesis df6e3bda04 added new orgs in monitor 2 weeks ago
Antonis Lempesis 573b081f1d added new orgs in monitor 2 weeks ago
Antonis Lempesis 0bf2a7a359 fixed the result_country definition 2 weeks ago
Claudio Atzori f01390702e Merge pull request 'fixed typo in indicator query' (#410) from antonis.lempesis/dnet-hadoop:beta into master
Reviewed-on: #410
3 weeks ago
Antonis Lempesis 9ff44eed96 fixed typo in indicator query
added more institutions
3 weeks ago
Claudio Atzori 5592ccc37a Merge pull request 'added missing EOS, Generate tables with parquet-files, instead of csv in the contexts.sh script' (#408) from antonis.lempesis/dnet-hadoop:beta into master
Reviewed-on: #408
3 weeks ago
Antonis Lempesis 1fee4124e0 added missing EOS 3 weeks ago
Claudio Atzori d16c15da8d adjusted pom files 3 weeks ago
Lampros Smyrnaios 036ba03fcd Generate tables with parquet-files, instead of csv, in "dhp-stats-update/.../contexts.sh" script. 3 weeks ago
Claudio Atzori 09a6d17059 Merge pull request '[Stats wf] #372, #405 to production' (#406) from antonis.lempesis/dnet-hadoop:beta into master
Reviewed-on: #406
3 weeks ago
Claudio Atzori d70793847d resolving conflicts on step16-createIndicatorsTables.sql 3 weeks ago
Lampros Smyrnaios bc8c97182d Automatically select the ACTIVE HDFS NODE for Impala cluster, in all "copyDataToImpalaCluster.sh" scripts. 3 weeks ago
Lampros Smyrnaios 92cc27e7eb Use the ACTIVE HDFS NODE for Impala cluster, in "copyDataToImpalaCluster.sh" script. 3 weeks ago
Michele De Bonis f6601ea7d1 default parameters for openorgs updated 3 weeks ago
Michele De Bonis cd4c3c934d openorgs wf updated 4 weeks ago
Antonis Lempesis 4c40c96e30 code cleanup 4 weeks ago
Antonis Lempesis 459167ac2f Merge branch 'beta' of https://code-repo.d4science.org/antonis.lempesis/dnet-hadoop into beta 4 weeks ago
Antonis Lempesis 07f634a46d code cleanup 4 weeks ago
Antonis Lempesis 9521625a07 code cleanup 4 weeks ago
Antonis Lempesis 67a5aa0a38 Merge branch 'beta' of https://code-repo.d4science.org/antonis.lempesis/dnet-hadoop into beta 4 weeks ago
dimitrispie a3a570e9a0 Commit monitor-updates-wf 4 weeks ago
Michele Artini a99942f7cf filter by base types 1 month ago
Michele Artini 7f7083f53e updated sql query for filtering BASE records 1 month ago
Michele Artini d9b23a76c5 comments 1 month ago
Michele Artini 841ca92246 Merge pull request 'new plugin to collect from a dump of BASE' (#400) from base-collector-plugin into master
Reviewed-on: #400
1 month ago
Michele Artini 3bcfc40293 new plugin to collect from a dump of BASE 1 month ago
Antonis Lempesis f74c7e8689 selecting distinct peer_reviewed 1 month ago
Antonis Lempesis 3c79720342 fixed the irish result subset 1 month ago
Antonis Lempesis 5ae4b4286c Merge branch 'beta' of https://code-repo.d3science.org/antonis.lempesis/dnet-hadoop into beta 1 month ago
Antonis Lempesis 316d585c8a using distinct apcs per publication to avoid huge sums 1 month ago
Giambattista Bloisi 3067ea390d Use SparkSQL in place of Hive for executing step16-createIndicatorsTables.sql of stats update wf 1 month ago
Miriam Baglioni c94d94035c [BulkTagging] added check to verify if field is present in the pathMap 2 months ago
Michele Artini 4374d7449e mapping of project PIDs 2 months ago
Claudio Atzori 07d009007b Merge pull request 'Fixed problem on missing author in crossref Mapping' (#384) from crossref_missing_author_fix_master into master
Reviewed-on: #384
2 months ago
Claudio Atzori 071d044971 Merge branch 'master' into crossref_missing_author_fix_master 2 months ago
Claudio Atzori b3ddbaed58 fixed import of ORPs stored on HDFS in the internal graph format (e.g. Datacite) 2 months ago
Claudio Atzori 1416f16b35 [graph raw] fixed mapping of the original resource type from the Datacite format 2 months ago
Giambattista Bloisi ba1a0e7b4f Merge pull request 'Set deletedbyinference =true to dedup aliases, created when a dedup in a previous build has been merged in a new dedup' (#392) from fix_dedupaliases_deletedbyinference into master
Reviewed-on: #392
2 months ago
Giambattista Bloisi 079085286c Merge branch 'master' into fix_dedupaliases_deletedbyinference 2 months ago
Giambattista Bloisi 8dd666aedd Dedup aliases, created when a dedup in a previous build has been merged in a new dedup, need to be marked as "deletedbyinference", since they are "merged" in the new dedup 2 months ago
Claudio Atzori f21133229a Merge pull request 'Support for the PromoteAction strategy [master]' (#391) from promote_actions_join_type_master into master
Reviewed-on: #391
2 months ago
Claudio Atzori d86b909db2 [actiosets] fixed join type 2 months ago
Claudio Atzori 08162902ab [actiosets] introduced support for the PromoteAction strategy 2 months ago
Antonis Lempesis dd4c27f4f3 added 2 new institutions in monitor 2 months ago
Claudio Atzori e8630a6d03 [graph cleaning] rule out datasources without an officialname 2 months ago
Claudio Atzori f28c63d5ef [orcid enrichment] fixed directory cleanup before distcp 2 months ago