sourcePath
the source path
targetPath
the source path
sparkDriverMemory
memory for driver process
sparkExecutorMemory
memory for individual executor
sparkExecutorCores
number of cores used by single executor
entity
the entity type
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
${jobTracker}
${nameNode}
yarn-cluster
cluster
Import ${entity} and related entities
eu.dnetlib.dhp.graph.scholexplorer.SparkScholexplorerGraphImporter
dhp-graph-mapper-${projectVersion}.jar
--executor-memory ${sparkExecutorMemory}
--driver-memory=${sparkDriverMemory}
--num-executors 100
--conf spark.yarn.jars="hdfs://hadoop-rm1.garr-pa1.d4science.org:8020/user/oozie/share/lib/lib_20180405103059/spark2"
-mt yarn-cluster
--sourcePath${sourcePath}
--targetPath${targetPath}
--entity${entity}