1
0
Fork 0
dnet-hadoop/dhp-workflows
dimitrispie 75bfde043c Historical Snapshots Workflow
Create historical snapshots db with parameters:

hist_db_name=openaire_beta_historical_snapshots_xxx
hist_db_name_prev=openaire_beta_historical_snapshots_xxx (previous run of wf)
stats_db_name=openaire_beta_stats_xxx
stats_irish_db_name=openaire_beta_stats_monitor_ie_xxx
monitor_db_name=openaire_beta_stats_monitor_xxx
monitor_db_prod_name=openaire_beta_stats_monitor
monitor_irish_db_name=openaire_beta_stats_monitor_ie_xxx
monitor_irish_db_prod_name=openaire_beta_stats_monitor_ie
hist_db_prod_name=openaire_beta_historical_snapshots
hist_db_shadow_name=openaire_beta_historical_snapshots_shadow
hist_date=122023
hive_timeout=150000
hadoop_user_name=xxx
resumeFrom=CreateDB
2024-01-04 15:11:04 +02:00
..
dhp-actionmanager [actionmanager] increased spark.sql.shuffle.partitions to 5000 2021-11-15 12:31:45 +01:00
dhp-aggregation code formatting 2021-11-15 17:07:16 +01:00
dhp-blacklist since dhp-schemas changed, introducing new Relation inverse model, this class has been updated 2021-10-19 15:24:22 +02:00
dhp-broker-events suggestions from SonarLint 2021-08-11 12:13:22 +02:00
dhp-dedup-openaire [dedup] increased number of partitions in the consistency phase 2021-11-16 08:43:41 +01:00
dhp-distcp switched project version to 1.2.4-branch_hadoop_aggregator-SNAPSHOT 2021-02-04 14:08:18 +01:00
dhp-doiboost [DOIBoost Mapping] removed not needed comments 2021-11-04 16:24:07 +01:00
dhp-enrichment [Bypass Action Set] creation of unresolved entities 2021-11-11 16:11:25 +01:00
dhp-graph-mapper Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta 2021-11-17 14:17:27 +01:00
dhp-graph-provision code formatted 2021-10-19 15:24:59 +02:00
dhp-stats-hist-snaps Historical Snapshots Workflow 2024-01-04 15:11:04 +02:00
dhp-stats-monitor-irish Monitor Irish Stats WF 2023-12-22 11:05:24 +02:00
dhp-stats-monitor-update/src/main/resources/eu/dnetlib/dhp/oa/graph/stats-monitor/oozie_app Changes 2023-07-13 15:25:00 +03:00
dhp-stats-promote Updates Promotion DBs 2023-07-12 22:49:08 +03:00
dhp-stats-update Changes to indicators and funders definition 2023-12-22 10:29:20 +02:00
dhp-usage-raw-data-update suggestions from SonarLint 2021-08-11 12:13:22 +02:00
dhp-usage-stats-build suggestions from SonarLint 2021-08-11 12:13:22 +02:00
dhp-workflow-profiles different funders in blacklist from BETA and PROD aggregator 2021-08-19 11:32:27 +02:00
docs
pom.xml cleanup 2021-08-09 11:53:06 +02:00