workingPath
the working dir base path
sparkDriverMemory
memory for driver process
sparkExecutorMemory
memory for individual executor
sparkExecutorCores
number of cores used by single executor
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
${jobTracker}
${nameNode}
eu.dnetlib.doiboost.crossref.CrossrefImporter
-t${workingPath}/input/crossref/index_dump
-n${nameNode}
yarn-cluster
cluster
ExtractCrossrefToOAF
eu.dnetlib.doiboost.crossref.SparkMapDumpIntoOAF
dhp-doiboost-${projectVersion}.jar
--executor-memory=${sparkExecutorMemory}
--executor-cores=${sparkExecutorCores}
--driver-memory=${sparkDriverMemory}
${sparkExtraOPT}
--sourcePath${workingPath}/crossref/index_dump
--targetPath${workingPath}/input/crossref
--masteryarn-cluster