sabeel
/
dnet-hadoop
forked from D-Net/dnet-hadoop
1
0
Fork 0
Code Pull Requests Activity
Collection of OOZIE workflows for the OpenAIRE Graph construction, processing, provisioning.
3,465 Commits 55 Branches 18 Tags 649 MiB
Java 72.7%
Scala 12.7%
XSLT 10.3%
Shell 2.4%
Python 1.8%
Go to file
dimitrispie 75bfde043c Historical Snapshots Workflow 
Create historical snapshots db with parameters:

hist_db_name=openaire_beta_historical_snapshots_xxx
hist_db_name_prev=openaire_beta_historical_snapshots_xxx (previous run of wf)
stats_db_name=openaire_beta_stats_xxx
stats_irish_db_name=openaire_beta_stats_monitor_ie_xxx
monitor_db_name=openaire_beta_stats_monitor_xxx
monitor_db_prod_name=openaire_beta_stats_monitor
monitor_irish_db_name=openaire_beta_stats_monitor_ie_xxx
monitor_irish_db_prod_name=openaire_beta_stats_monitor_ie
hist_db_prod_name=openaire_beta_historical_snapshots
hist_db_shadow_name=openaire_beta_historical_snapshots_shadow
hist_date=122023
hive_timeout=150000
hadoop_user_name=xxx
resumeFrom=CreateDB
 		2024-01-04 15:11:04 +02:00
dhp-build suggestions from SonarLint 2021-08-11 12:13:22 +02:00
dhp-common [cleaning wf] fixed methodology to rule out invalid result titles, based on https://support.openaire.eu/issues/7206 2021-11-17 14:17:22 +01:00
dhp-doc-resources/img updated image 2020-03-05 15:11:42 +01:00
dhp-workflows Historical Snapshots Workflow 2024-01-04 15:11:04 +02:00
.gitignore merging contributions from PR#97 2021-03-05 15:45:28 +01:00
LICENSE added LICENSE file - AGPL-3.0 2020-04-29 16:11:17 +02:00
README.md Update 'README.md' 2021-07-30 11:54:38 +02:00
pom.xml Merge branch 'beta' of code-repo.d4science.org:D-Net/dnet-hadoop into beta 2021-11-15 14:32:09 +01:00

README.md

dnet-hadoop

Dnet-hadoop is the project that defined all the OOZIE workflows for the OpenAIRE Graph construction, processing, provisioning.