UrlsWorker/src/main/java/eu/openaire/urls_worker
Lampros Smyrnaios 53ab51922a Allow shutdown requests from the Controller. 2023-04-28 23:46:39 +03:00
..
components Increase the "requestReadTimeoutDuration" to 10 hours, as the number of full-texts to be transferred to the Controller keeps getting larger. 2023-04-26 15:08:46 +03:00
controllers Allow shutdown requests from the Controller. 2023-04-28 23:46:39 +03:00
models Fix a "@JsonProperty" annotation inside "Payload.java". 2022-04-01 23:43:43 +03:00
payloads - Use the "Timestamp" data-type instead of the "Date", in order to include more information. 2021-11-27 02:37:33 +02:00
security - Add deletion, of the cookies in the newly-supported CookieManager, after each batch. 2022-06-27 17:58:02 +03:00
services - Improve performance of full-texts transferring to the Controller, by preloading some bytes for faster response to the Controller's read requests. 2023-03-08 13:12:17 +02:00
util Reduce memory usage. 2023-04-28 17:59:36 +03:00
UrlsWorkerApplication.java - Handle the case, where an instance of a urlReport record (having the same id and sourceUrl), may have failed to give a docUrl, due to en error, even if another instance gives the docUrl and the docFile. The absence of that handling could lead to a record-instance, being assigned a "fileLocation" which was actually an error-message (comment), and as a result the real "fileLocation" would have never been reached to be assigned, so the payload would be lost. 2023-02-21 15:22:49 +02:00