Lampros Smyrnaios a1f750a0aa - Handle the case, where, from a group of related records, the initial record which led to a publication-url, failed to have its full-text downloaded. Now we make sure the file-related data for all those related records is kept "null" and a special error is written. ... - Code optimization.		2022-04-05 17:51:45 +03:00
..
components	- Refactor the scheduling of the "handleNewAssignments()" task. Spring already waits for the last task to get finished, before running the new one (unless Async is specifically enabled), so the "isAvailableForWork" didn't do anything (thus the bug described in a previous commit was never going to appear). Also, now we set to request the new assignments-batch immediately after the last one is finished (not after 15 mins), while dealing with potential continuous connection-errors.	2022-02-21 12:48:21 +02:00
controllers	- Refactor the scheduling of the "handleNewAssignments()" task. Spring already waits for the last task to get finished, before running the new one (unless Async is specifically enabled), so the "isAvailableForWork" didn't do anything (thus the bug described in a previous commit was never going to appear). Also, now we set to request the new assignments-batch immediately after the last one is finished (not after 15 mins), while dealing with potential continuous connection-errors.	2022-02-21 12:48:21 +02:00
exceptions	- The worker will store the files in its local file-system and will send them to the controller in batches, after the latter requests them. When all files from a given assignments-num are sent, the files will be deleted from the Worker, in a scheduled-job.	2021-11-26 17:04:31 +02:00
models	Fix a "@JsonProperty" annotation inside "Payload.java".	2022-04-01 23:43:43 +03:00
payloads	- Use the "Timestamp" data-type instead of the "Date", in order to include more information.	2021-11-27 02:37:33 +02:00
plugins	- Handle the case, where, from a group of related records, the initial record which led to a publication-url, failed to have its full-text downloaded. Now we make sure the file-related data for all those related records is kept "null" and a special error is written.	2022-04-05 17:51:45 +03:00
security	Initial commit of UrlsWorker.	2021-03-16 18:38:53 +02:00
services	- Upgrade the zip-file delivery by using the "InputStreamResource". This way is more reliable, have better performance and uses less memory.	2021-12-17 08:25:54 +02:00
util	Increase the "requestReadTimeoutDuration" from 1 hour to 3. This way, each worker will handle saturation without aborting the connection, when multiple workers are waiting for the "databaseLock" in the Controller.	2022-02-22 13:29:02 +02:00
UrlsWorkerApplication.java	- In case of an unknown (non-documented) exception inside "LoaderAndChecker.invokeAllTasksAndWait", now it will be logged and the app will gently shut down with an error-message in the Error-stream.	2022-01-04 00:23:45 +02:00