activePromoteDatasetActionPayload
when true will promote actions with eu.dnetlib.dhp.schema.oaf.Dataset payload
activePromoteDatasourceActionPayload
when true will promote actions with eu.dnetlib.dhp.schema.oaf.Datasource payload
activePromoteOrganizationActionPayload
when true will promote actions with eu.dnetlib.dhp.schema.oaf.Organization payload
activePromoteOtherResearchProductActionPayload
when true will promote actions with eu.dnetlib.dhp.schema.oaf.OtherResearchProduct payload
activePromoteProjectActionPayload
when true will promote actions with eu.dnetlib.dhp.schema.oaf.Project payload
activePromotePublicationActionPayload
when true will promote actions with eu.dnetlib.dhp.schema.oaf.Publication payload
activePromoteRelationActionPayload
when true will promote actions with eu.dnetlib.dhp.schema.oaf.Relation payload
activePromoteResultActionPayload
when true will promote actions with eu.dnetlib.dhp.schema.oaf.Result payload
activePromoteSoftwareActionPayload
when true will promote actions with eu.dnetlib.dhp.schema.oaf.Software payload
inputGraphRootPath
root location of input materialized graph
isLookupUrl
URL of the ISLookupService
inputActionSetIds
comma separated list of action set ids to promote
outputGraphRootPath
root location for output materialized graph
mergeAndGetStrategy
strategy for merging graph table objects with action payload instances, MERGE_FROM_AND_GET or SELECT_NEWER_AND_GET
shouldGroupById
false
indicates whether the promotion operation should group objects in the graph by id or not
sparkDriverMemory
memory for driver process
sparkExecutorMemory
memory for individual executor
sparkExecutorCores
number of cores used by single executor
oozieActionShareLibForSpark2
oozie action sharelib for spark 2.*
spark2ExtraListeners
com.cloudera.spark.lineage.NavigatorAppListener
spark 2.* extra listeners classname
spark2SqlQueryExecutionListeners
com.cloudera.spark.lineage.NavigatorQueryListener
spark 2.* sql query execution listeners classname
spark2YarnHistoryServerAddress
spark 2.* yarn history server address
spark2EventLogDir
spark 2.* event log dir location
${jobTracker}
${nameNode}
oozie.action.sharelib.for.spark
${oozieActionShareLibForSpark2}
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
yarn-cluster
cluster
PartitionActionSetsByPayloadType
eu.dnetlib.dhp.actionmanager.partition.PartitionActionSetsByPayloadTypeJob
dhp-actionmanager-${projectVersion}.jar
--executor-memory=${sparkExecutorMemory}
--executor-cores=${sparkExecutorCores}
--driver-memory=${sparkDriverMemory}
--conf spark.extraListeners=${spark2ExtraListeners}
--conf spark.sql.queryExecutionListeners=${spark2SqlQueryExecutionListeners}
--conf spark.yarn.historyServer.address=${spark2YarnHistoryServerAddress}
--conf spark.eventLog.dir=${nameNode}${spark2EventLogDir}
--inputActionSetIds${inputActionSetIds}
--outputPath${workingDir}/action_payload_by_type
--isLookupUrl${isLookupUrl}
${wf:appPath()}/promote_action_payload_for_dataset_table
inputActionPayloadRootPath
${workingDir}/action_payload_by_type
${wf:appPath()}/promote_action_payload_for_datasource_table
inputActionPayloadRootPath
${workingDir}/action_payload_by_type
${wf:appPath()}/promote_action_payload_for_organization_table
inputActionPayloadRootPath
${workingDir}/action_payload_by_type
${wf:appPath()}/promote_action_payload_for_otherresearchproduct_table
inputActionPayloadRootPath
${workingDir}/action_payload_by_type
${wf:appPath()}/promote_action_payload_for_project_table
inputActionPayloadRootPath
${workingDir}/action_payload_by_type
${wf:appPath()}/promote_action_payload_for_publication_table
inputActionPayloadRootPath
${workingDir}/action_payload_by_type
${wf:appPath()}/promote_action_payload_for_relation_table
inputActionPayloadRootPath
${workingDir}/action_payload_by_type
${wf:appPath()}/promote_action_payload_for_software_table
inputActionPayloadRootPath
${workingDir}/action_payload_by_type