singleDeposition Indicates if it is a single community deposition communityId the id of the community to be dumped if a dump for a single community should be done dumpType the type of the dump one of {complete, community, funder} onlyUpload true if the dump is already done and should only be upload in zenodo upload true if the dump should be upload in zenodo sourcePath the source path isLookUpUrl the isLookup service endpoint outputPath the output path resultAggregation true if all the result type have to be dumped under result. false otherwise accessToken the access token used for the deposition in Zenodo connectionUrl the connection url for Zenodo metadata the metadata associated to the deposition depositionType the type of deposition we want to perform. "new" for brand new deposition, "version" for a new version of a published deposition (in this case the concept record id must be provided), "upload" to upload content to an open deposition for which we already have the deposition id (in this case the deposition id should be provided) conceptRecordId for new version, the id of the record for the old deposition depositionId the depositionId of a deposition open that has to be added content organizationCommunityMap the organization community map hiveDbName the target hive database name hiveJdbcUrl hive server jdbc url hiveMetastoreUris hive server metastore URIs sparkDriverMemory memory for driver process sparkExecutorMemory memory for individual executor sparkExecutorCores number of cores used by single executor oozieActionShareLibForSpark2 oozie action sharelib for spark 2.* spark2ExtraListeners com.cloudera.spark.lineage.NavigatorAppListener spark 2.* extra listeners classname spark2SqlQueryExecutionListeners com.cloudera.spark.lineage.NavigatorQueryListener spark 2.* sql query execution listeners classname spark2YarnHistoryServerAddress spark 2.* yarn history server address spark2EventLogDir spark 2.* event log dir location ${jobTracker} ${nameNode} mapreduce.job.queuename ${queueName} oozie.launcher.mapred.job.queue.name ${oozieLauncherQueueName} oozie.action.sharelib.for.spark ${oozieActionShareLibForSpark2} Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}] ${wf:conf('onlyUpload') eq true} eu.dnetlib.dhp.oa.graph.dump.SaveCommunityMap --outputPath${workingDir}/communityMap --nameNode${nameNode} --isLookUpUrl${isLookUpUrl} --singleDeposition${singleDeposition} --communityId${communityId} ${wf:conf('dumpType') eq "funder"} ${wf:conf('dumpType') eq "community"} ${wf:appPath()}/dump_complete communityMapPath ${workingDir}/communityMap outputPath ${workingDir}/tar sourcePath ${sourcePath} organizationCommunityMap ${organizationCommunityMap} isLookUpUrl ${isLookUpUrl} resultAggregation ${resultAggregation} ${wf:appPath()}/dump_community sourcePath ${sourcePath} communityMapPath ${workingDir}/communityMap outputPath ${workingDir}/tar ${wf:appPath()}/dump_funder communityMapPath ${workingDir}/communityMap outputPath ${workingDir}/tar sourcePath ${sourcePath} dumpType ${dumpType} eu.dnetlib.dhp.oa.graph.dump.MakeTar --hdfsPath${outputPath} --nameNode${nameNode} --sourcePath${workingDir}/tar ${wf:conf('upload') eq true} eu.dnetlib.dhp.oa.graph.dump.SendToZenodoHDFS --hdfsPath${outputPath} --nameNode${nameNode} --accessToken${accessToken} --connectionUrl${connectionUrl} --metadata${metadata} --conceptRecordId${conceptRecordId} --depositionType${depositionType} --depositionId${depositionId}