UrlsWorker/src/main/java/eu/openaire/urls_worker/util
Lampros Smyrnaios 377b98d677 Increase the "requestReadTimeoutDuration" from 1 hour to 3. This way, each worker will handle saturation without aborting the connection, when multiple workers are waiting for the "databaseLock" in the Controller. 2022-02-22 13:29:02 +02:00
..
AssignmentsHandler.java Increase the "requestReadTimeoutDuration" from 1 hour to 3. This way, each worker will handle saturation without aborting the connection, when multiple workers are waiting for the "databaseLock" in the Controller. 2022-02-22 13:29:02 +02:00
FilesZipper.java - Increase the system-reserved memory, in "installAndRun.sh". 2021-12-17 00:26:47 +02:00
UriBuilder.java - Refactor the scheduling of the "handleNewAssignments()" task. Spring already waits for the last task to get finished, before running the new one (unless Async is specifically enabled), so the "isAvailableForWork" didn't do anything (thus the bug described in a previous commit was never going to appear). Also, now we set to request the new assignments-batch immediately after the last one is finished (not after 15 mins), while dealing with potential continuous connection-errors. 2022-02-21 12:48:21 +02:00
WorkerConstants.java - Improve performance when requesting, processing and posting requests. 2021-10-30 17:14:18 +03:00