H2020Classification #109

Closed

miriam.baglioni wants to merge 0 commits from miriam.baglioni/dnet-hadoop:master into master

pull from: miriam.baglioni/dnet-hadoop:master

merge into: D-Net:master

D-Net:master

D-Net:spark34-integration

D-Net:beta_indexing_May2024

D-Net:beta

D-Net:irish-oaipmh-exporter

D-Net:rest-collector-plugin-with-retry

D-Net:beta_provision_relation

D-Net:dependency-revision

D-Net:beta-release-1.2.5

D-Net:misc_fixes_merge_entities

D-Net:WebCrowlBeta

D-Net:WebCrowl

D-Net:provision_memoryOverhead

D-Net:stats_step16_fix

D-Net:doidoost_dismiss

D-Net:CrossrefFundersMap

D-Net:taggingProjects

D-Net:9647_datacite_affiliations

D-Net:UsageStatsRecordDS

D-Net:mergeutils

D-Net:oaf_country_beta

D-Net:index_records

D-Net:ocnew

D-Net:FOSNew

D-Net:bulkTaggingPathMapExtention

D-Net:transformativeagreement

D-Net:new_orcid_enhancement

D-Net:9559_DBLP_data

D-Net:base_stats_job_deprecated

D-Net:SWH_issue_377

D-Net:import_orps_fix

D-Net:spark_join_param_tuning

D-Net:crossref_mapping_vocabularies

D-Net:promote_actions_join_type_master

D-Net:promote_actions_join_type

D-Net:provision_community_api

D-Net:enrichmentSingleStepFixed

D-Net:fosPreparationBeta

D-Net:resource_types

D-Net:enrichmentSingleStep

D-Net:oldPropagationOrganizationCommunity

D-Net:beta_to_master_dicember2023

D-Net:orcid_import

D-Net:9078_xml_records_irish_tender

D-Net:clean_license_publisher

D-Net:bulkTag

D-Net:SWH_integration

D-Net:importpoci

D-Net:8172_impact_indicators_workflow

D-Net:dedup-with-dataframe-spark34

D-Net:8876

D-Net:master_july23

D-Net:distinct_pids_from_openorgs_beta

D-Net:propagationProjectThroughParentChils

D-Net:fulltext_url_validation

D-Net:removeTaggingCondition

D-Net:ticket_8369

D-Net:tweaking_spark_params

D-Net:fc4e-rsac

D-Net:doiboost_authormerger

D-Net:beta_dedup_configuration

D-Net:apc_affiliation

D-Net:bulkTagRefactor

D-Net:organizationToRepresentative

D-Net:graph_cleaning_refactoring

D-Net:scholix_flat_indexing

D-Net:scholix_data_type_openaire

D-Net:advConstraintsInBeta

D-Net:doiboostMappingExtention

D-Net:mag_citation_relation

D-Net:h2020classification

D-Net:doiboostFunderExtention

D-Net:citations_monodirectional

D-Net:compatibility_order

D-Net:8232-mdstore-synch-improve

D-Net:subjectPropagation

D-Net:pubmed_to_production

D-Net:cleanCountryOnMaster

D-Net:graph_cleaning

D-Net:deduptesting

D-Net:horizontalConstraints

D-Net:enrichment

D-Net:scholix_to_solr

D-Net:transformation_wf

D-Net:discard-non-wellformed

D-Net:removeDump

D-Net:eosc_context_tagging

D-Net:pubmed_update

D-Net:doiboost_refactor

D-Net:clean_context_master

D-Net:monitoring

D-Net:dump_new_funded_products

D-Net:dump_delta_projects

D-Net:dump

D-Net:7096-fileGZip-collector-plugin

D-Net:oaf_relation_mapping

D-Net:validation

D-Net:native_records_migration

D-Net:instance_group_by_url

D-Net:hostedByMap_update

D-Net:hostedByMap_oastartdate

D-Net:sygma_indexing

Conversation 0 Commits - Files Changed -

miriam.baglioni commented 2021-05-21 14:59:01 +02:00

Member

Copy Link

This PR fixes bugs due to changes in the input file. It also modifies the flow of the workflow to increase the level of parallelism

This PR fixes bugs due to changes in the input file. It also modifies the flow of the workflow to increase the level of parallelism

miriam.baglioni added the

bug

enhancement

labels 2021-05-21 14:59:01 +02:00

claudio.atzori was assigned by miriam.baglioni 2021-05-21 14:59:01 +02:00

miriam.baglioni added 12 commits 2021-05-21 14:59:02 +02:00

052c837843 -

aa45b4df9b -

9610224671 added param to workflow property

2eb1a8b344 changed because the input file changed

7180505519 removed non needed variable

54f6e2f693 changed to get the needed information to build the action set as parallel jobs

e07c3ba089 due to change in the input file the filtering step is no more needed

1ee8f13580 refactoring and added "left" as join type to be 100% sure to get the whole set of projects

53b9d87fec new prepareProgramme according to the new file

4c8b4a774c removed not needed code

073d76864d refactoring

c844877de2 changed workflow flow to possibly parallelize also the programme and project preparation steps

miriam.baglioni added 1 commit 2021-05-21 15:20:57 +02:00

abd88f663d changed test resource to mirror change in the input file

claudio.atzori changed target branch from master to stable_ids 2021-05-27 10:57:42 +02:00

claudio.atzori changed target branch from stable_ids to master 2021-05-27 10:58:08 +02:00

claudio.atzori changed title from H2020CLassification to H2020Classification 2021-05-27 11:02:53 +02:00

claudio.atzori referenced this issue from a commit 2021-05-27 11:57:05 +02:00

integrating pull #109, H2020Classification

claudio.atzori referenced this issue from a commit 2021-05-27 12:23:03 +02:00

integrating pull #109, H2020Classification

claudio.atzori closed this pull request 2021-05-27 15:43:54 +02:00

Pull request closed

Please reopen this pull request to perform a merge.

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels   

bug

Something is not working

  

duplicate

This issue or pull request already exists

  

enhancement

New feature / refactoring

  

help wanted

Need some help

  

invalid

Something is wrong

  

question

More information is needed

  

RDGraph

EOSC Research Discovery Graph

  

RSAC

EOSC Research Software APIs and Connectors

  

wontfix

This won't be fixed

No Label

bug

duplicate

enhancement

help wanted

invalid

question

RDGraph

RSAC

wontfix

Milestone

Clear milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

No Assignees

claudio.atzori

1 Participants

Notifications

Subscribe

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#109

No description provided.