D-Net
/
dnet-hadoop
13
4
Fork 10
Code Issues 14 Pull Requests 8 Projects 2 Releases 1 Wiki Activity
dnet-hadoop/dhp-workflows/dhp-swh/src/main/resources/eu/dnetlib/dhp/swh/job.properties

19 lines
1.0 KiB
Properties
Raw Normal View History

Add collecting software code repository URLs
2023-09-14 17:43:25 +02:00
# hive
Remove graphPath input WF parameter
2024-02-27 15:58:33 +01:00
hiveDbName=openaire_beta_20231208
Add collecting software code repository URLs
2023-09-14 17:43:25 +02:00
Add steps to collect last visit data && archive not found repository URLs
2023-09-27 18:00:54 +02:00
# input/output files
softwareCodeRepositoryURLs=${workingDir}/1_code_repo_urls.csv
lastVisitsPath=${workingDir}/2_last_visits.seq
archiveRequestsPath=${workingDir}/3_archive_requests.seq
Add action for creating actionsets
2023-10-02 22:50:38 +02:00
actionsetsPath=${workingDir}/4_actionsets
Add collecting software code repository URLs
2023-09-14 17:43:25 +02:00
Move SWH API Key from constants to workflow param
2023-10-03 19:57:57 +02:00
apiAccessToken=eyJhbGciOiJIUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJhMTMxYTQ1My1hM2IyLTQwMTUtODQ2Ny05MzAyZjk3MTFkOGEifQ.eyJpYXQiOjE2OTQ2MzYwMjAsImp0aSI6IjkwZjdkNTNjLTQ5YTktNGFiMy1hY2E0LTcwMTViMjEyZTNjNiIsImlzcyI6Imh0dHBzOi8vYXV0aC5zb2Z0d2FyZWhlcml0YWdlLm9yZy9hdXRoL3JlYWxtcy9Tb2Z0d2FyZUhlcml0YWdlIiwiYXVkIjoiaHR0cHM6Ly9hdXRoLnNvZnR3YXJlaGVyaXRhZ2Uub3JnL2F1dGgvcmVhbG1zL1NvZnR3YXJlSGVyaXRhZ2UiLCJzdWIiOiIzMTY5OWZkNC0xNmE0LTQxOWItYTdhMi00NjI5MDY4ZjI3OWEiLCJ0eXAiOiJPZmZsaW5lIiwiYXpwIjoic3doLXdlYiIsInNlc3Npb25fc3RhdGUiOiIzMjYzMzEwMS00ZDRkLTQwMjItODU2NC1iMzNlMTJiNTE3ZDkiLCJzY29wZSI6Im9wZW5pZCBvZmZsaW5lX2FjY2VzcyBwcm9maWxlIGVtYWlsIn0.XHj1VIZu1dZ4Ej32-oU84mFmaox9cLNjXosNxwZM0Xs
Add step for archiving repoUrls to SWH
2023-09-28 19:56:18 +02:00
maxNumberOfRetry=2
retryDelay=1
requestDelay=100
Add param for limiting repo Urls
2023-10-03 13:39:08 +02:00
softwareLimit=500
Remove graphPath input WF parameter
2024-02-27 15:58:33 +01:00
resumeFrom=collect-software-repository-urls