sourcePath
the source path
targetPath
the source path
targetDir
the name of the path
sparkDriverMemory
memory for driver process
sparkExecutorMemory
memory for individual executor
sparkExecutorCores
number of cores used by single executor
entities
the entities to be extracted
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
${jobTracker}
${nameNode}
yarn-cluster
cluster
Extract ${entities}
eu.dnetlib.dhp.graph.scholexplorer.SparkExtractEntitiesJob
dhp-graph-mapper-${projectVersion}.jar
--executor-memory ${sparkExecutorMemory}
--driver-memory=${sparkDriverMemory}
--num-executors 100
--conf spark.yarn.jars="hdfs://hadoop-rm1.garr-pa1.d4science.org:8020/user/oozie/share/lib/lib_20180405103059/spark2"
-mt yarn-cluster
--sourcePath${sourcePath}
--targetPath${targetPath}
--targetDir${targetDir}
--entities${entities}