workingPath
the working dir base path
token
access token
sparkDriverMemory
memory for driver process
sparkExecutorMemory
memory for individual executor
sparkExecutorCores
number of cores used by single executor
outputPath
the working dir base path
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
${jobTracker}
${nameNode}
yarn
cluster
Split_Lambda_File
eu.dnetlib.doiboost.orcid.SparkPartitionLambdaFile
dhp-doiboost-1.2.1-SNAPSHOT.jar
--num-executors 24 --conf spark.yarn.jars="hdfs://hadoop-rm1.garr-pa1.d4science.org:8020/user/oozie/share/lib/lib_20180405103059/spark2" --executor-memory=${sparkExecutorMemory} --executor-cores=${sparkExecutorCores} --driver-memory=${sparkDriverMemory}
-w${workingPath}/
-oauthors/
-t${token}
${jobTracker}
${nameNode}
yarn
cluster
Gen_Orcid_Authors
eu.dnetlib.doiboost.orcid.SparkOrcidGenerateAuthors
dhp-doiboost-1.2.1-SNAPSHOT.jar
--num-executors 20 --conf spark.yarn.jars="hdfs://hadoop-rm1.garr-pa1.d4science.org:8020/user/oozie/share/lib/lib_20180405103059/spark2" --executor-memory=${sparkExecutorMemory} --executor-cores=${sparkExecutorCores} --driver-memory=${sparkDriverMemory}
-w${workingPath}/
-oauthors/
-t${token}