This website requires JavaScript.
Explore
Help
Sign In
lsmyrnaios
/
UrlsWorker
Watch
1
Star
0
Fork
You've already forked UrlsWorker
1
Code
Issues
Pull Requests
Releases
14
Wiki
Activity
a1f750a0aa
UrlsWorker
/
src
/
main
/
java
/
eu
/
openaire
/
urls_worker
/
util
History
Lampros Smyrnaios
377b98d677
Increase the "requestReadTimeoutDuration" from 1 hour to 3. This way, each worker will handle saturation without aborting the connection, when multiple workers are waiting for the "databaseLock" in the Controller.
2022-02-22 13:29:02 +02:00
..
AssignmentsHandler.java
Increase the "requestReadTimeoutDuration" from 1 hour to 3. This way, each worker will handle saturation without aborting the connection, when multiple workers are waiting for the "databaseLock" in the Controller.
2022-02-22 13:29:02 +02:00
FilesZipper.java
- Increase the system-reserved memory, in "installAndRun.sh".
2021-12-17 00:26:47 +02:00
UriBuilder.java
- Refactor the scheduling of the "handleNewAssignments()" task. Spring already waits for the last task to get finished, before running the new one (unless Async is specifically enabled), so the "isAvailableForWork" didn't do anything (thus the bug described in a previous commit was never going to appear). Also, now we set to request the new assignments-batch immediately after the last one is finished (not after 15 mins), while dealing with potential continuous connection-errors.
2022-02-21 12:48:21 +02:00
WorkerConstants.java
- Improve performance when requesting, processing and posting requests.
2021-10-30 17:14:18 +03:00