sourcePath
the source path of scholix graph
datacitePath
the datacite native path
workingSupportPath
the working Support path
isLookupUrl
The IS lookUp service endopoint
updateDS
false
The transformation Rule to apply
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
yarn
cluster
New Update from Datacite to Scholix
eu.dnetlib.dhp.sx.graph.SparkRetrieveDataciteDelta
dhp-aggregation-${projectVersion}.jar
--executor-memory=${sparkExecutorMemory}
--executor-cores=${sparkExecutorCores}
--driver-memory=${sparkDriverMemory}
--conf spark.extraListeners=${spark2ExtraListeners}
--conf spark.sql.shuffle.partitions=6000
--conf spark.sql.queryExecutionListeners=${spark2SqlQueryExecutionListeners}
--conf spark.yarn.historyServer.address=${spark2YarnHistoryServerAddress}
--conf spark.eventLog.dir=${nameNode}${spark2EventLogDir}
--sourcePath${sourcePath}
--datacitePath${datacitePath}
--masteryarn
--workingSupportPath${workingSupportPath}
--isLookupUrl${isLookupUrl}
--updateDS${updateDS}