mdStoreInputId
the identifier of the native MDStore
mdStoreOutputId
the identifier of the cleaned MDStore
mdStoreManagerURI
the path of the cleaned mdstore
transformationRuleId
The transformation Rule to apply
transformationPlugin
The transformation Plugin
dateOfTransformation
The timestamp of the transformation date
Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
eu.dnetlib.dhp.aggregation.mdstore.MDStoreActionNode
--actionREAD_LOCK
--mdStoreID${mdStoreInputId}
--mdStoreManagerURI${mdStoreManagerURI}
eu.dnetlib.dhp.aggregation.mdstore.MDStoreActionNode
--actionNEW_VERSION
--mdStoreID${mdStoreOutputId}
--mdStoreManagerURI${mdStoreManagerURI}
yarn
cluster
Transform MetadataStore
eu.dnetlib.dhp.transformation.TransformSparkJobNode
dhp-aggregations-${projectVersion}.jar
--executor-memory=${sparkExecutorMemory}
--executor-cores=${sparkExecutorCores}
--driver-memory=${sparkDriverMemory}
--conf spark.extraListeners=${spark2ExtraListeners}
--conf spark.sql.queryExecutionListeners=${spark2SqlQueryExecutionListeners}
--conf spark.yarn.historyServer.address=${spark2YarnHistoryServerAddress}
--conf spark.eventLog.dir=${nameNode}${spark2EventLogDir}
--mdstoreInputVersion${wf:actionData('StartTransaction')['mdStoreVersion']}
--mdstoreOutputVersion${wf:actionData('BeginRead')['mdStoreReadLockVersion']}
--dateOfTransformation${dateOfTransformation}
--transformationPlugin${transformationPlugin}
--transformationRuleId${transformationRuleId}
eu.dnetlib.dhp.aggregation.mdstore.MDStoreActionNode
--actionREAD_UNLOCK
--mdStoreManagerURI${mdStoreManagerURI}
--readMDStoreId${wf:actionData('BeginRead')['mdStoreReadLockVersion']}
eu.dnetlib.dhp.aggregation.mdstore.MDStoreActionNode
--actionCOMMIT
--namenode${nameNode}
--mdStoreVersion${wf:actionData('StartTransaction')['mdStoreVersion']}
--mdStoreManagerURI${mdStoreManagerURI}
eu.dnetlib.dhp.aggregation.mdstore.MDStoreActionNode
--actionREAD_UNLOCK
--mdStoreManagerURI${mdStoreManagerURI}
--readMDStoreId${wf:actionData('BeginRead')['mdStoreReadLockVersion']}
eu.dnetlib.dhp.aggregation.mdstore.MDStoreActionNode
--actionROLLBACK
--mdStoreVersion${wf:actionData('StartTransaction')['mdStoreVersion']}
--mdStoreManagerURI${mdStoreManagerURI}