dnet-hadoop

lsmyrnaios

dnet-hadoop

forked from D-Net/dnet-hadoop

Fork 0

Commit Graph

Select branches

Hide Pull Requests

7096-fileGZip-collector-plugin

8172_impact_indicators_workflow

8232-mdstore-synch-improve

8876

9078_xml_records_irish_tender

SWH_integration

UsageStatsRecordDS

advConstraintsInBeta

apc_affiliation

beta

beta_dedup_configuration

bulkTag

bulkTagRefactor

citations_monodirectional

cleanCountryOnMaster

clean_context_master

clean_license_publisher

compatibility_order

continuous-validation

continuous_validation2

dedup-with-dataframe-spark34

dedup_increasenumofblocks

deduptesting

discard-non-wellformed

distinct_pids_from_openorgs_beta

doiboostFunderExtention

doiboostMappingExtention

doiboost_authormerger

doiboost_refactor

dump

dump_delta_projects

dump_new_funded_products

enrichment

eosc_context_tagging

fc4e-rsac

fulltext_url_validation

graph_cleaning

graph_cleaning_refactoring

h2020classification

horizontalConstraints

hostedByMap_oastartdate

hostedByMap_update

importpoci

instance_group_by_url

mag_citation_relation

master

master_july23

monitoring

native_records_migration

oaf_relation_mapping

orcid_import

organizationToRepresentative

propagationProjectThroughParentChils

pubmed_to_production

pubmed_update

removeDump

removeTaggingCondition

scholix_data_type_openaire

scholix_flat_indexing

scholix_to_solr

spark34-integration

subjectPropagation

sygma_indexing

ticket_8369

transformation_wf

tweaking_spark_params

updateCopyScripts

validation

1.0.1

archive/bipFinder_master_test

archive/dedupTest

archive/islookup_timeout

archive/junit5

archive/master_pre_stable_ids

dhp-1.0.2

dhp-1.0.3

dhp-1.0.4

dhp-1.1.5

dhp-1.1.6

dhp-1.1.7

dhp-1.2.0

dhp-1.2.1

dhp-1.2.2

dhp-1.2.3

dhp-1.2.4

september-2023

ef52128c55 included new stats* workflows in parent pom list of modules, code formatting Claudio Atzori 2024-03-26 10:42:10 +0100
bfba71a95c further follow up changes from integrating the mergeutils branch Claudio Atzori 2024-03-26 09:01:18 +0100
d72e7b7487 Merge pull request 'Changes to indicators and funders definition' (#372) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2024-03-26 08:46:20 +0100
ece56f0178 update crossref mapping to be transformed together with UnpayWall Sandro La Bruzzo 2024-03-25 18:18:10 +0100
414acd4ef4 Merge pull request 'refactoring the Oaf records merge utilities into dhp-common' (#404) from mergeutils into beta Claudio Atzori 2024-03-25 16:16:07 +0100
ecff0b4825 merge from beta Claudio Atzori 2024-03-25 16:15:52 +0100
25c2025223 Merge pull request 'mapped oaf:country from results' (#403) from oaf_country_beta into beta Claudio Atzori 2024-03-25 16:13:31 +0100
538b180fe0 Merge branch 'beta' into oaf_country_beta Claudio Atzori 2024-03-25 16:13:20 +0100
eae88c0fe3 Merge pull request 'Solr JSON payload' (#399) from index_records into beta Claudio Atzori 2024-03-25 16:12:59 +0100
82fc609c4f Merge branch 'beta' into index_records Claudio Atzori 2024-03-25 16:12:49 +0100
4b978ffa2d align dhp-schema.version with the beta branch Claudio Atzori 2024-03-25 16:12:36 +0100
fa4b3e6d2b Merge pull request 'Open Citation integration' (#401) from ocnew into beta Claudio Atzori 2024-03-25 16:10:40 +0100
74e5d05577 Merge branch 'beta' into ocnew Claudio Atzori 2024-03-25 16:10:31 +0100
6c3b692f60 integrated minor change from beta branch Claudio Atzori 2024-03-25 16:10:23 +0100
e9eb590f87 Merge pull request 'FOS ActionSet for the classification of results without a doi' (#397) from FOSNew into beta Claudio Atzori 2024-03-25 16:07:47 +0100
9a5b134ddf Merge branch 'beta' into FOSNew Claudio Atzori 2024-03-25 16:07:37 +0100
069803f34a Merge pull request 'Added exception throwing in Hadoop transformation when TR is not syntactically valid' (#387) from exception_on_invalid_transofmation_rule into beta Claudio Atzori 2024-03-25 16:05:43 +0100
71c1f81b54 Merge branch 'beta' into exception_on_invalid_transofmation_rule Claudio Atzori 2024-03-25 16:05:11 +0100
c3c9bdb59c Merge pull request 'bulkTaggingPathMapExtention' (#381) from bulkTaggingPathMapExtention into beta Claudio Atzori 2024-03-25 16:02:01 +0100
91b61687fa Merge branch 'beta' into bulkTaggingPathMapExtention Claudio Atzori 2024-03-25 15:50:18 +0100
63067d4b24 align dhp-schema.version with the beta branch Claudio Atzori 2024-03-25 15:50:05 +0100
e0c315b07b Merge pull request 'Extract Information from Transformative Agreement' (#371) from transformativeagreement into beta Claudio Atzori 2024-03-25 15:42:36 +0100
54936b7f42 Merge branch 'beta' into transformativeagreement Claudio Atzori 2024-03-25 15:42:22 +0100
9fc70a9451 implemented default merge procedure applied to result.instance Claudio Atzori 2024-03-25 15:39:14 +0100
e1149eb5c4 xslt rules and tests Michele Artini 2024-03-25 15:01:42 +0100
3f174ad90f Merge branch 'beta' of code-repo.d4science.org:D-Net/dnet-hadoop into beta Michele Artini 2024-03-25 12:16:02 +0100
6ffb1faf09 fixed a problem with multiple nodes Michele Artini 2024-03-25 12:15:51 +0100
3f22c101d9 Merge pull request 'Enrich authors with ORCID info using new matching algorithm' (#398) from new_orcid_enhancement into beta Giambattista Bloisi 2024-03-22 17:29:20 +0100
c8683eb13c Merge branch 'beta' into mergeutils Claudio Atzori 2024-03-22 16:36:13 +0100
aaa73f89d1 refactoring the Oaf records merge utilities into dhp-common Claudio Atzori 2024-03-22 16:34:03 +0100
0ff7faad72 Fix conditions that prevented ORCID Enrichment Giambattista Bloisi 2024-03-22 16:24:49 +0100
7faa115ba0 Merge branch 'beta' of code-repo.d4science.org:D-Net/dnet-hadoop into beta Michele Artini 2024-03-22 11:08:59 +0100
f9c74c98fa fixed an identifier xpath Michele Artini 2024-03-22 11:08:45 +0100
7ae7e8aa06 Merge pull request 'Unify merge logic of entities in MergeUtils.class' (#370) from mergeutils into beta Claudio Atzori 2024-03-22 10:53:14 +0100
4c40c96e30 code cleanup Antonis Lempesis 2024-03-22 10:16:49 +0200
459167ac2f Merge branch 'beta' of https://code-repo.d4science.org/antonis.lempesis/dnet-hadoop into beta Antonis Lempesis 2024-03-21 12:44:58 +0200
07f634a46d code cleanup Antonis Lempesis 2024-03-21 12:44:30 +0200
9521625a07 code cleanup Antonis Lempesis 2024-03-21 11:45:08 +0200
58dbe71d39 update crossref mapping to be runnable separately as a single datasource outside doiboost Sandro La Bruzzo 2024-03-20 17:04:52 +0100
67a5aa0a38 Merge branch 'beta' of https://code-repo.d4science.org/antonis.lempesis/dnet-hadoop into beta Antonis Lempesis 2024-03-19 11:24:54 +0200
a3a570e9a0 Commit monitor-updates-wf dimitrispie 2024-03-19 09:42:21 +0200
664a381d31 Unify merge logic of entities in MergeUtils.class Giambattista Bloisi 2023-12-14 11:43:58 +0100
cb29b9773c xslt rules Michele Artini 2024-03-18 15:31:34 +0100
85b844d57e updated BASE filter param Michele Artini 2024-03-15 15:03:27 +0100
455f2e1e07 apply commits from master Michele Artini 2024-03-15 14:56:39 +0100
30167aa882 mapped oaf:country from results Michele Artini 2024-03-15 11:24:16 +0100
88fef367b9 new plugin to collect from a dump of BASE Michele Artini 2024-03-12 12:17:58 +0100
078169b922 cleanup Claudio Atzori 2024-03-15 09:56:04 +0100
af154d4456 implemented changes from #9497: sort abstracts by string length, included author fullnames in the related results, expanded instance details within each children/result XML element Claudio Atzori 2024-03-14 16:21:23 +0100
7863c92466 expanded paper abstract in the result/children XML element (ticket #9497) Claudio Atzori 2024-03-13 16:25:31 +0100
eb5887cb9a including related organization url in the XML record serialization (ticket #9498) Claudio Atzori 2024-03-13 14:46:00 +0100
5281f010a5 applied cherry pick Sandro La Bruzzo 2024-02-14 11:41:28 +0100
ee1fcb672b code refactor Sandro La Bruzzo 2024-03-13 09:46:31 +0100
5a32bb9578 [OC New] last fix Miriam Baglioni 2024-03-13 09:36:18 +0100
c532831718 Moved Crossref Mapping on dhp-aggregations, refactored code, avoid to use utility for create part of the oaf defined in DOIBoostMappingUtils, used instead utility in OafMappingUtils Sandro La Bruzzo 2024-03-13 06:56:10 +0100
48c052215c [OC New] last fix Miriam Baglioni 2024-03-12 23:12:32 +0100
db66555ebb WIP: updated provision workflow to create a JSON based representation of the payload Claudio Atzori 2024-03-12 09:56:09 +0100
f74c7e8689 selecting distinct peer_reviewed Antonis Lempesis 2024-03-12 02:13:04 +0200
9092075760 Enrich authors with ORCID info using new matching algorithm Giambattista Bloisi 2024-02-04 10:07:15 +0100
cbd4e5e4bb update mag mapping Sandro La Bruzzo 2024-03-08 16:31:40 +0100
d4871b31e8 WIP: extended provision workflow to create the JSON based payload Claudio Atzori 2024-03-08 11:43:20 +0100
3c79720342 fixed the irish result subset Antonis Lempesis 2024-03-07 14:08:57 +0200
5ae4b4286c Merge branch 'beta' of https://code-repo.d3science.org/antonis.lempesis/dnet-hadoop into beta Antonis Lempesis 2024-03-07 12:15:19 +0200
5180b6ec8a [FOSNEW] removed test class Miriam Baglioni 2024-03-07 10:47:13 +0100
7827a2d66b [OCNEW] added creation of the actionset for the results classified with FoS based ont he OpenAIRE identifier Miriam Baglioni 2024-03-07 10:36:30 +0100
316d585c8a using distinct apcs per publication to avoid huge sums Antonis Lempesis 2024-03-07 02:07:59 +0200
fd34372c40 [OCNEW] first implementation Miriam Baglioni 2024-03-06 13:42:00 +0100
d34cef3f8d Merge remote-tracking branch 'origin/beta' into doidoost_dismiss Sandro La Bruzzo 2024-03-05 11:45:31 +0100
3b837d38ce added oozie workflow Sandro La Bruzzo 2024-03-05 11:44:59 +0100
f417515e43 Implemented class that generates a normalized table of MAG, which is the starting point for the creation of the mag source Sandro La Bruzzo 2024-03-04 17:15:13 +0100
ad0e9aa80c added first part of refactoring of the code generating MAG, make it more readable using spark sql queries Sandro La Bruzzo 2024-02-29 18:16:15 +0100
9d94648f3b code formatted Sandro La Bruzzo 2024-02-29 18:15:20 +0100
3cd5590f3b When converting json to XML, remove characters that are not allowed in the XML 1.0 specs, as they will cause xpath failures even if escaped Giambattista Bloisi 2024-02-28 15:14:18 +0100
56dd05f85c Merge pull request 'Revised procedure when converting json data into xml' (#395) from restiterator_xmlcleanup into beta Giambattista Bloisi 2024-02-28 10:38:54 +0100
6fcf872daa Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into index_records Claudio Atzori 2024-02-28 10:27:28 +0100
3f07390a58 WIP Claudio Atzori 2024-02-28 10:10:10 +0100
7d806a434c formatted code Sandro La Bruzzo 2024-02-28 09:31:58 +0100
e468e99100 Merge pull request 'Orcid Update Procedure' (#394) from orcid_update into beta Sandro La Bruzzo 2024-02-28 09:17:30 +0100
b63994dcc4 Merge remote-tracking branch 'origin/beta' into orcid_update Sandro La Bruzzo 2024-02-28 09:11:18 +0100
915a76a796 following the comment on the pull requests: - Added #NUM_OF_THREADS complete job in the queue at the end of the main loop to avoid deadlock Sandro La Bruzzo 2024-02-28 09:10:55 +0100
773e856550 Revised procedure when converting json data into xml: - json object keys are renamed to be conformant to xml tag elements, special characters are substituted or removed - json string values are no longer post-processed as they are already escaped by the org.json.XML.toString method Giambattista Bloisi 2024-02-24 16:54:30 +0100
a712df1e1d Merge remote-tracking branch 'origin/beta' into orcid_update Sandro La Bruzzo 2024-02-23 10:12:25 +0100
b32a9d1994 Implemented workflow for updating table , added step to check if the new generated table is valid Sandro La Bruzzo 2024-02-23 10:04:28 +0100
3268570b2c mapping of project PIDs Michele Artini 2024-02-22 14:47:21 +0100
0198362200 Add documentation about the problems with views and set the number of iterations back to 5. updateCopyScripts Lampros Smyrnaios 2024-02-21 16:52:28 +0200
72bae7af76 [Transformative Agreement] removed the relations from the ActionSet waiting to have the gree light from Ioanna Miriam Baglioni 2024-02-19 16:20:12 +0100
43da7e1191 [Tagging Projects and Datasource] changed the way the pathMap parameter is passed. It was too long and was truncated Miriam Baglioni 2024-02-19 16:12:59 +0100
f0dc12634b Add Action Set creation for affiliations inferred from the OpenAPC data Serafeim Chatzopoulos 2024-02-18 18:02:09 +0200
753c2a72bd Merge pull request 'fix import of ORPs' (#390) from import_orps_fix into beta Claudio Atzori 2024-02-15 15:02:08 +0100
a63b091bae Merge branch 'beta' into import_orps_fix Claudio Atzori 2024-02-15 15:01:56 +0100
85aeff72f1 Merge pull request 'Revised instance type comparisons in dedup phase' (#393) from revisedInstanceType into beta Giambattista Bloisi 2024-02-15 12:15:37 +0100
d65285da7f Promote "Research" to a jolly instanceType in dedup comparisons Compare "Journal" and "Part of book or chapter of book" with "Article" Giambattista Bloisi 2024-02-15 12:10:42 +0100
29194472a7 Promote "Research" to a jolly instanceType in dedup comparisons Compare Part of book or chapter of book with Article Giambattista Bloisi 2024-02-04 10:19:33 +0100
8dae10b442 - Miriam Baglioni 2024-02-14 14:57:08 +0100
83bb97be83 [Tagging Projects and Datasource] added test to check datasource tagging. Fixed issue Miriam Baglioni 2024-02-14 11:23:47 +0100
6e1f383e4a [Tagging Projects and Datasource] first extention of bulktagging to add the context to projects and datasource Miriam Baglioni 2024-02-13 16:37:14 +0100
3f7d262a4e mergin with branch beta Miriam Baglioni 2024-02-13 14:05:58 +0100
eca021f4d6 [Transformative Agreement] add results with information abount the agreement and the country of the organization paid for it Miriam Baglioni 2024-02-13 12:21:07 +0100
bdb6bbb365 mergin with branch beta Miriam Baglioni 2024-02-12 15:50:43 +0100
d85d2df6ad [graph raw] fixed mapping of the original resource type from the Datacite format Claudio Atzori 2024-02-09 10:19:53 +0100