baseInputPath
the path of the BASE dump
baseDataPath
the path where to store BASE records
baseReportsPath
path where to store the reports
baseOpenDoarReportsPath
path where to store the OpenDOAR reports
baseTypesReportPath
path of the generated the types report
postgresURL
the postgres URL to access to the database
postgresUser
the user postgres
postgresPassword
the password postgres
baseFromStep
the initial step (numeric, 0 for ALL STEPS)
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
yarn
cluster
AnalyzeBaseRecords
eu.dnetlib.dhp.collection.plugin.base.BaseAnalyzerJob
dhp-aggregation-${projectVersion}.jar
--executor-cores=${sparkExecutorCores}
--executor-memory=${sparkExecutorMemory}
--driver-memory=${sparkDriverMemory}
--conf spark.extraListeners=${spark2ExtraListeners}
--conf spark.sql.queryExecutionListeners=${spark2SqlQueryExecutionListeners}
--conf spark.yarn.historyServer.address=${spark2YarnHistoryServerAddress}
--conf spark.eventLog.dir=${nameNode}${spark2EventLogDir}
--conf spark.sql.shuffle.partitions=3840
--inputPath${baseInputPath}
--dataPath${baseDataPath}
--outputPath${baseReportsPath}
--opendoarPath${baseOpenDoarReportsPath}
--typesReportPath${baseTypesReportPath}
--postgresUrl${postgresURL}
--postgresUser${postgresUser}
--postgresPassword${postgresPassword}
--fromStep${baseFromStep}