UrlsWorker/src/main/java/eu/openaire/urls_worker
Lampros Smyrnaios 3d1faf4a8a - Reduce memory-consumption in the long-run, by clearing some underlying data-structures after a threshold.
- Update Gradle.
2022-02-18 20:02:34 +02:00
..
components - Make sure the handled assignments - full-texts are deleted before the application exits. 2021-12-31 04:09:05 +02:00
controllers - Upgrade the zip-file delivery by using the "InputStreamResource". This way is more reliable, have better performance and uses less memory. 2021-12-17 08:25:54 +02:00
exceptions - The worker will store the files in its local file-system and will send them to the controller in batches, after the latter requests them. When all files from a given assignments-num are sent, the files will be deleted from the Worker, in a scheduled-job. 2021-11-26 17:04:31 +02:00
models - Use the "Timestamp" data-type instead of the "Date", in order to include more information. 2021-11-27 02:37:33 +02:00
payloads - Use the "Timestamp" data-type instead of the "Date", in order to include more information. 2021-11-27 02:37:33 +02:00
plugins - Reduce memory-consumption in the long-run, by clearing some underlying data-structures after a threshold. 2022-02-18 20:02:34 +02:00
security Initial commit of UrlsWorker. 2021-03-16 18:38:53 +02:00
services - Upgrade the zip-file delivery by using the "InputStreamResource". This way is more reliable, have better performance and uses less memory. 2021-12-17 08:25:54 +02:00
util - Handle the latest download-errors provided by the "PublicationsRetriever" program. 2022-02-07 14:40:33 +02:00
UrlsWorkerApplication.java - In case of an unknown (non-documented) exception inside "LoaderAndChecker.invokeAllTasksAndWait", now it will be logged and the app will gently shut down with an error-message in the Error-stream. 2022-01-04 00:23:45 +02:00