UrlsWorker/src/main/java/eu/openaire/urls_worker
Lampros Smyrnaios 7f3ca80959 Bypass url-canonicalization for urls containing certain uncommon characters which cause the urls to get rejected. 2023-05-30 19:45:14 +03:00
..
components Bypass url-canonicalization for urls containing certain uncommon characters which cause the urls to get rejected. 2023-05-30 19:45:14 +03:00
controllers - Improve elapsed time precision for the "lastModified" metadata of the assignments-fulltext subDirectories. 2023-05-25 00:37:44 +03:00
models Fix a "@JsonProperty" annotation inside "Payload.java". 2022-04-01 23:43:43 +03:00
payloads - After a WorkerReport has been sent, ask for new assignments immediately. So, the Worker does not have to wait for hours for the Controller to check for duplicate files in the DB, retrieve and upload the full-texts and insert the records to the DB. 2023-05-23 22:19:41 +03:00
security - Add deletion, of the cookies in the newly-supported CookieManager, after each batch. 2022-06-27 17:58:02 +03:00
services - Improve performance of full-texts transferring to the Controller, by preloading some bytes for faster response to the Controller's read requests. 2023-03-08 13:12:17 +02:00
util - After a WorkerReport has been sent, ask for new assignments immediately. So, the Worker does not have to wait for hours for the Controller to check for duplicate files in the DB, retrieve and upload the full-texts and insert the records to the DB. 2023-05-23 22:19:41 +03:00
UrlsWorkerApplication.java - After a WorkerReport has been sent, ask for new assignments immediately. So, the Worker does not have to wait for hours for the Controller to check for duplicate files in the DB, retrieve and upload the full-texts and insert the records to the DB. 2023-05-23 22:19:41 +03:00