dimitris.pierrakos
/
dnet-hadoop
forked from D-Net/dnet-hadoop
1
0
Fork 0
Code Pull Requests Activity
4,798 Commits
67 Branches
18 Tags
634 MiB
beta
bulkTag
9117_pubmed_affiliations
propagationapi
url_validation
resource_types
master
SWH_integration
importpoci
dedup_increasenumofblocks
spark34-integration
8172_impact_indicators_workflow
dedup-with-dataframe-spark34
8876
cleaning_8898
master_july23
UsageStatsRecordDS
distinct_pids_from_openorgs_beta
propagationProjectThroughParentChils
fulltext_url_validation
removeTaggingCondition
ticket_8369
tweaking_spark_params
fc4e-rsac
doiboost_authormerger
beta_dedup_configuration
apc_affiliation
bulkTagRefactor
organizationToRepresentative
graph_cleaning_refactoring
scholix_flat_indexing
scholix_data_type_openaire
advConstraintsInBeta
doiboostMappingExtention
mag_citation_relation
h2020classification
doiboostFunderExtention
citations_monodirectional
compatibility_order
8232-mdstore-synch-improve
subjectPropagation
pubmed_to_production
cleanCountryOnMaster
graph_cleaning
deduptesting
horizontalConstraints
enrichment
scholix_to_solr
transformation_wf
discard-non-wellformed
removeDump
eosc_context_tagging
pubmed_update
doiboost_refactor
clean_context_master
monitoring
dump_new_funded_products
dump_delta_projects
dump
7096-fileGZip-collector-plugin
oaf_relation_mapping
validation
native_records_migration
instance_group_by_url
hostedByMap_update
hostedByMap_oastartdate
sygma_indexing
dhp-1.2.4
dhp-1.2.3
dhp-1.2.2
dhp-1.2.1
dhp-1.2.0
dhp-1.1.7
dhp-1.1.6
dhp-1.1.5
dhp-1.0.4
dhp-1.0.3
dhp-1.0.2
1.0.1
september-2023
archive/master_pre_stable_ids
archive/junit5
archive/islookup_timeout
archive/dedupTest
archive/bipFinder_master_test
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Commit Graph

4798 Commits (master)
 

Author SHA1 Message Date
Claudio Atzori 242d647146 cleanup & docs 6 months ago
Claudio Atzori af3ffad6c4 [AMF] docs 6 months ago
Claudio Atzori ba5475ed4c Merge pull request 'Fix cleaning of Pmid where parsing of numbers stopped at first not leading 0 (zero) character' (#345) from fix_truncated_pmid into master 
Reviewed-on: D-Net/dnet-hadoop#345
 7 months ago
Giambattista Bloisi 2c235e82ad Fix cleaning of Pmid where parsing of numbers stopped at first not leading 0' character 7 months ago
Claudio Atzori 4ac06c9e37 Merge pull request 'Fix bug in conversion from dedup json model to Spark Dataset of Rows (instanceTypeMatch no longer working)' (#339) from fix_dedupfailsonmatchinginstances into master 
Reviewed-on: D-Net/dnet-hadoop#339
 7 months ago
Claudio Atzori fa692b3629 Merge branch 'master' into fix_dedupfailsonmatchinginstances 7 months ago
Claudio Atzori ef02648399 Merge pull request 'fixed dedup configuration management in the Broker workflow' (#341) from fix_8997 into master 
Reviewed-on: D-Net/dnet-hadoop#341
 7 months ago
Claudio Atzori d13bb534f0 Merge branch 'master' into fix_8997 7 months ago
Giambattista Bloisi 775c3f704a Fix bug in conversion from dedup json model to Spark Dataset of Rows: list of strings contained the json escaped representation of the value instead of the plain value, this caused instanceTypeMatch failures because of the leading and trailing double quotes 7 months ago
Sandro La Bruzzo 9c3ab11d5b Merge branch 'master' of code-repo.d4science.org:D-Net/dnet-hadoop 7 months ago
Sandro La Bruzzo 423ef30676 minor fix on the aggregation of uniprot and pdb 7 months ago
Giambattista Bloisi 7152d47f84 Use asScala to convert java List to Scala Sequence 7 months ago
Claudio Atzori 4853c19b5e code formatting 7 months ago
Giambattista Bloisi 1f226d1dce Fix defect #8997: GenerateEventsJob is generating huge amounts of logs because broker entity similarity calculation consistently failed 7 months ago
Alessia Bardi 6186cdc2cc Use v5 of the UNIBI Gold ISSN list in test 7 months ago
Alessia Bardi d94b9bebf7 Merge branch 'master' of https://code-repo.d4science.org/D-Net/dnet-hadoop 7 months ago
Alessia Bardi 19abba8fa7 tests for d4science catalog 7 months ago
Claudio Atzori c2f179800c Merge pull request 'Run CC and RAM sequentieally in dhp-impact-indicators WF' (#338) from run_cc_and_ram_sequentially into master 
Reviewed-on: D-Net/dnet-hadoop#338
 7 months ago
Serafeim Chatzopoulos 2aed5a74be Run CC and RAM sequentieally in dhp-impact-indicators WF 7 months ago
Claudio Atzori 4dc4862011 Merge branch 'master' of https://code-repo.d4science.org/D-Net/dnet-hadoop 7 months ago
Claudio Atzori dc80ab14d3 [graph dedup] consistency wf should not remove the relations while dispatching the entities 7 months ago
Alessia Bardi 77a2199837 updated test for EOSC comunity 8 months ago
Claudio Atzori 265180bfd2 added Archive ouverte UNIGE (ETHZ.UNIGENF, opendoar____::1400) to the Datacite hostedBy_map 8 months ago
Claudio Atzori da0e9828f7 resolved conflicts for PR#337 8 months ago
Claudio Atzori 9f5d16624c Merge pull request '[graph raw] datainfo.invisible set as true only for entities' (#336) from invisible_relations into beta 
Reviewed-on: D-Net/dnet-hadoop#336
 8 months ago
Claudio Atzori adec6692ca Merge branch 'beta' into invisible_relations 8 months ago
Claudio Atzori 15666e86a8 added collectedfrom to the affiliation relations imported from Crossref 8 months ago
Claudio Atzori 7d6bd4f20b Merge pull request 'Fix import of affiliations relations from Crossref' (#335) from 8876_fix_crossref_affiliation_relations_import into beta 
Reviewed-on: D-Net/dnet-hadoop#335
 8 months ago
Claudio Atzori 5b06c9d06f [graph raw] datainfo.invisible set as true only for entities 8 months ago
Serafeim Chatzopoulos 7de0164c26 Fix import of affiliations relations from Crossref 8 months ago
Claudio Atzori 488d9a1cea Merge pull request 'Add sparkExecutorMemoryOverhead workflow config to set off-heap memory for Spark actions. If not explicitly set it is defaulted to 1Gb' (#331) from consistencywf_memoryoverhead_conf into beta 
Reviewed-on: D-Net/dnet-hadoop#331
 8 months ago
Giambattista Bloisi 6b1c05d118 Add sparkExecutorMemoryOverhead workflow config to set off-heap memory for Spark actions. If not explicitly set it is defaulted to 1Gb 8 months ago
Claudio Atzori bf35280ea6 code formatting 8 months ago
Claudio Atzori 0515d81c7c Merge pull request 'Rewrite SparkPropagateRelation exploiting Dataframe API' (#330) from propagate_relation_rewrite into beta 
Reviewed-on: D-Net/dnet-hadoop#330
 8 months ago
Claudio Atzori 58665a246c Merge branch 'beta' into propagate_relation_rewrite 8 months ago
Claudio Atzori f437be80ad [impact indicators] adjusted paths in the bip ranker wf parameters 8 months ago
Giambattista Bloisi d012aec0b3 Revert PropagateRelation's argument name from outputPath to graphOutputPath in consistency workflow (#8964) 8 months ago
Giambattista Bloisi a860e19423 Fix ensure all relations are written out, not only those managed by dedup 8 months ago
Giambattista Bloisi 0d7b2bf83d Rewrite SparkPropagateRelation exploiting Dataframe API 8 months ago
Miriam Baglioni 9c8b41475a Merge pull request '8172_impact_indicators_workflow' (#284) from 8172_impact_indicators_workflow into beta 
Reviewed-on: D-Net/dnet-hadoop#284
 8 months ago
Serafeim Chatzopoulos 97c1ba8918 Merge actionsets of results and projects 8 months ago
Miriam Baglioni 35b8deb2c6 Merge pull request 'DispatchEntitiesSparkJob: manage all entity types together, support filtering by dataInfo.invisible flag' (#329) from dispatch_filter_invisible_entities into beta 
Reviewed-on: D-Net/dnet-hadoop#329
 8 months ago
Giambattista Bloisi 95cd2b9b1e Make filterInvisible a mandatory parameter of DispathEntitiesSparkJob 
Make filterInvisible a mandatory parameter of both dedup/consistency and graph/group oozie workflows
 8 months ago
Giambattista Bloisi fab9920271 DispatchEntitiesSparkJob: manage all entity types together, support filtering by dataInfo.invisible flag 8 months ago
Miriam Baglioni c25ac21e5e Merge pull request 'graph cleaning, suggestions from ticket 8898' (#325) from cleaning_8898 into beta 
Reviewed-on: D-Net/dnet-hadoop#325
 9 months ago
Miriam Baglioni c334fe2438 Merge pull request 'Add a "CleanRelation" action after the PropagateRelation to filter out all relations that have been deleted by inference or that are pointing to dangling entities' (#328) from cleanup_relations_after_dedup into beta 
Reviewed-on: D-Net/dnet-hadoop#328
 9 months ago
Miriam Baglioni 0e2f855807 Merge pull request 'Updates Promotion DBs' (#321) from antonis.lempesis/dnet-hadoop:beta into beta 
Reviewed-on: D-Net/dnet-hadoop#321
 9 months ago
Miriam Baglioni 18fbe52b20 Merge pull request 'Import affiliation relations from Crossref' (#320) from 8876 into beta 
Reviewed-on: D-Net/dnet-hadoop#320
 9 months ago
Giambattista Bloisi 97b6d1dc45 Filter ids by dataInfo.deletedbyinference and DataInfo.invisible flags 
Filter relations also by dataInfo.invisible flag
 9 months ago
Giambattista Bloisi af49424b59 Add a "CleanRelation" action after the PropagateRelation to filter out all relations that have been deleyted by inference or that are pointing to dangling entities 9 months ago