Lampros Smyrnaios
92d011e8a0
- When the user sets the "maxAssignmentsBatchesToHandleBeforeRestart" above zero, shutdown immediately after the last assignments-batch. Do not wait for the next scheduled check. - Allow the user to set the "maxAssignmentsBatchesToHandleBeforeRestart" in the "installAndRun.sh" script. - Increase the "fixedRate" for the "ScheduledTasks.deleteHandledAssignmentsFullTexts()" method to 12 hours. - Update README.md |
||
|---|---|---|
| gradle/wrapper | ||
| scripts | ||
| src | ||
| .gitignore | ||
| README.md | ||
| build.gradle | ||
| installAndRun.sh | ||
| settings.gradle | ||
README.md
UrlsWorker
This is the Worker's Application.
It requests assignments from the controller and processes them.
It posts the results to the controller, which in turn, puts them in a database.
To install and run the application:
- Run
git cloneand thencd UrlsWorker. - Create the file
S3_minIO_credentials.txt, which contains just one line with the S3_url, S3_username, S3_password, S3_server_region and the S3_bucket, all separated by a comma,. - [Optional] Create the file
inputData.txt, which contains just one line with the workerId, the maxAssignmentsLimitPerBatch, the maxAssignmentsBatchesToHandleBeforeRestart and the controller's base api-url, all seperated by a comma,. For example:worker_1,http://IP:PORT/api/. - Execute the
installAndRun.shscript. In case the above file (inputData.txt) does not exist, it will request the current worker's ID, the maxAssignmentsLimitPerBatch, the maxAssignmentsBatchesToHandleBeforeRestart and the Controller's Url, and it will create the inputData.txt file.
Note: If the "maxAssignmentsBatchesToHandleBeforeRestart" is zero or negative, then an infinite number of assignments-batches will be handled.
That script, installs the PublicationsRetriever, as a library and then compiles and runs the whole Application.
If you want to just run the app, then run the script with the argument "1": ./installAndRun.sh 1.