UrlsWorker/src/main/java/eu/openaire/urls_worker
Lampros Smyrnaios 25070d7aba - Lower the thresholds for how often to clear the data-structures.
- Clear the "ConnSupportUtils.domainsWithConnectionData" data-structure, after each batch.
- Move the code for handling the "CookieStore" inside the "PublicationsRetrieverPlugin", as it is more related to that.
2022-07-04 18:42:05 +03:00
..
components - Add deletion, of the cookies in the newly-supported CookieManager, after each batch. 2022-06-27 17:58:02 +03:00
controllers - Lower the thresholds for how often to clear the data-structures. 2022-07-04 18:42:05 +03:00
exceptions - The worker will store the files in its local file-system and will send them to the controller in batches, after the latter requests them. When all files from a given assignments-num are sent, the files will be deleted from the Worker, in a scheduled-job. 2021-11-26 17:04:31 +02:00
models Fix a "@JsonProperty" annotation inside "Payload.java". 2022-04-01 23:43:43 +03:00
payloads - Use the "Timestamp" data-type instead of the "Date", in order to include more information. 2021-11-27 02:37:33 +02:00
plugins - Lower the thresholds for how often to clear the data-structures. 2022-07-04 18:42:05 +03:00
security - Add deletion, of the cookies in the newly-supported CookieManager, after each batch. 2022-06-27 17:58:02 +03:00
services - Upgrade the zip-file delivery by using the "InputStreamResource". This way is more reliable, have better performance and uses less memory. 2021-12-17 08:25:54 +02:00
util - Lower the thresholds for how often to clear the data-structures. 2022-07-04 18:42:05 +03:00
UrlsWorkerApplication.java - Move the "shutdownOrCancelCode" input in the "inputDataFile" provided by the user, for convenience and to be able to make this "auth-code" mandatory. Previously, it was optional and the app could not be made to stop in a normal-manner, if this code was not provided. 2022-06-28 16:00:11 +03:00