graphBasePath
the raw graph base path
rawSet
the output directory in the targetPath
isLookUpUrl
the address of the lookUp service
actionSetId
id of the actionSet
workingPath
path for the working directory
sparkDriverMemory
memory for driver process
sparkExecutorMemory
memory for individual executor
sparkExecutorCores
number of cores used by single executor
${jobTracker}
${nameNode}
mapreduce.job.queuename
${queueName}
oozie.launcher.mapred.job.queue.name
${oozieLauncherQueueName}
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
yarn
cluster
Create Similarity Relations
eu.dnetlib.dhp.dedup.SparkCreateSimRels
dhp-dedup-${projectVersion}.jar
--executor-memory ${sparkExecutorMemory}
--executor-cores ${sparkExecutorCores}
--driver-memory=${sparkDriverMemory}
--conf spark.extraListeners="com.cloudera.spark.lineage.NavigatorAppListener"
--conf spark.sql.queryExecutionListeners="com.cloudera.spark.lineage.NavigatorQueryListener"
-mtyarn
--i${graphBasePath}
--o${rawSet}
--la${isLookUpUrl}
--asi${actionSetId}
--w${workingPath}