mdstoreInputPath
the path of the input MDStore
mdstoreOutputPath
the path of the cleaned mdstore
transformationRule
The transformation Rule to apply
timestamp
The timestamp of the collection date
workflowId
The identifier of the workflow
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
${jobTracker}
${nameNode}
yarn
cluster
MDBuilder
eu.dnetlib.dhp.transformation.TransformSparkJobNode
dhp-aggregations-1.0.0-SNAPSHOT.jar
--num-executors 50 --conf spark.yarn.jars="hdfs://hadoop-rm1.garr-pa1.d4science.org:8020/user/oozie/share/lib/lib_20180405103059/spark2"
--dateOfCollection ${timestamp}
-mt yarn
--input${mdstoreInputPath}
--output${mdstoreOutputPath}
-w${workflowId}
-tr${transformationRule}
-ru${rmq_user}
-rp${rmq_pwd}
-rh${rmq_host}
-ro${rmq_ongoing}
-rr${rmq_report}