use saveParquet method to ensure mergerel output is compressed #348

Closed

giambattista.bloisi wants to merge 1 commits from fix_mergerels_notcompressed into beta

pull from: fix_mergerels_notcompressed

merge into: D-Net:beta

D-Net:master

D-Net:beta

D-Net:spark34-integration

D-Net:beta_to_master_may2024

D-Net:beta_indexing_May2024

D-Net:dblp_collection_plugin

D-Net:mag_only_doi

D-Net:irish-oaipmh-exporter

D-Net:rest-collector-plugin-with-retry

D-Net:beta_provision_relation

D-Net:dependency-revision

D-Net:beta-release-1.2.5

D-Net:misc_fixes_merge_entities

D-Net:WebCrowlBeta

D-Net:WebCrowl

D-Net:provision_memoryOverhead

D-Net:stats_step16_fix

D-Net:doidoost_dismiss

D-Net:CrossrefFundersMap

D-Net:taggingProjects

D-Net:9647_datacite_affiliations

D-Net:UsageStatsRecordDS

D-Net:mergeutils

D-Net:oaf_country_beta

D-Net:index_records

D-Net:ocnew

D-Net:FOSNew

D-Net:bulkTaggingPathMapExtention

D-Net:transformativeagreement

D-Net:new_orcid_enhancement

D-Net:9559_DBLP_data

D-Net:base_stats_job_deprecated

D-Net:SWH_issue_377

D-Net:import_orps_fix

D-Net:spark_join_param_tuning

D-Net:crossref_mapping_vocabularies

D-Net:promote_actions_join_type_master

D-Net:promote_actions_join_type

D-Net:provision_community_api

D-Net:enrichmentSingleStepFixed

D-Net:fosPreparationBeta

D-Net:resource_types

D-Net:enrichmentSingleStep

D-Net:oldPropagationOrganizationCommunity

D-Net:beta_to_master_dicember2023

D-Net:orcid_import

D-Net:9078_xml_records_irish_tender

D-Net:clean_license_publisher

D-Net:bulkTag

D-Net:SWH_integration

D-Net:importpoci

D-Net:8172_impact_indicators_workflow

D-Net:dedup-with-dataframe-spark34

D-Net:8876

D-Net:master_july23

D-Net:distinct_pids_from_openorgs_beta

D-Net:propagationProjectThroughParentChils

D-Net:fulltext_url_validation

D-Net:removeTaggingCondition

D-Net:ticket_8369

D-Net:tweaking_spark_params

D-Net:fc4e-rsac

D-Net:doiboost_authormerger

D-Net:beta_dedup_configuration

D-Net:apc_affiliation

D-Net:bulkTagRefactor

D-Net:organizationToRepresentative

D-Net:graph_cleaning_refactoring

D-Net:scholix_flat_indexing

D-Net:scholix_data_type_openaire

D-Net:advConstraintsInBeta

D-Net:doiboostMappingExtention

D-Net:mag_citation_relation

D-Net:h2020classification

D-Net:doiboostFunderExtention

D-Net:citations_monodirectional

D-Net:compatibility_order

D-Net:8232-mdstore-synch-improve

D-Net:subjectPropagation

D-Net:pubmed_to_production

D-Net:cleanCountryOnMaster

D-Net:graph_cleaning

D-Net:deduptesting

D-Net:horizontalConstraints

D-Net:enrichment

D-Net:scholix_to_solr

D-Net:transformation_wf

D-Net:discard-non-wellformed

D-Net:removeDump

D-Net:eosc_context_tagging

D-Net:pubmed_update

D-Net:doiboost_refactor

D-Net:clean_context_master

D-Net:monitoring

D-Net:dump_new_funded_products

D-Net:dump_delta_projects

D-Net:dump

D-Net:7096-fileGZip-collector-plugin

D-Net:oaf_relation_mapping

D-Net:validation

D-Net:native_records_migration

D-Net:instance_group_by_url

D-Net:hostedByMap_update

D-Net:hostedByMap_oastartdate

D-Net:sygma_indexing

Conversation 1 Commits 1 Files Changed 1 +1 -2

1 Commits

Author	SHA1	Message	Date
Giambattista Bloisi	9fa125b16f	use saveParquet method to ensure mergerel output is compressed	2023-10-16 10:48:38 +02:00