Lampros Smyrnaios
088cf73b30
- Update dependencies.
...
- Code optimization and polishing.
2023-07-27 17:46:17 +03:00
Lampros Smyrnaios
903032f454
- After a WorkerReport has been sent, ask for new assignments immediately. So, the Worker does not have to wait for hours for the Controller to check for duplicate files in the DB, retrieve and upload the full-texts and insert the records to the DB.
...
- Special care is taken to delete the delivered full-texts as soon as possible.
- Write the workerReport to a json-file, in case something goes wrong, and keep it until the Controller notifies the Worker that the processing was successful.
2023-05-23 22:19:41 +03:00
Lampros Smyrnaios
045788c728
- Use the "Timestamp" data-type instead of the "Date", in order to include more information.
...
- Code cleanup.
2021-11-27 02:37:33 +02:00
Lampros Smyrnaios
6307cda23a
- Refactor the assignments-handling. In order to match with the database schema, now the AssignmentRequest returns a list of Assignments instead of a single assignment having a list of Tasks.
...
- Cleanup the members of the "Payload" model.
2021-07-05 15:00:29 +03:00
Lampros Smyrnaios
83d1bd2def
Update the "WorkerReport" response and the "UrlReport" and "Payload" models.
2021-06-19 07:12:24 +03:00
Lampros Smyrnaios
a4c97dffbf
- Add the "Datasource" class in the "Task" class and include it in the Assignment that the worker retrieves.
...
- Update dependencies.
2021-05-20 02:58:08 +03:00
Lampros Smyrnaios
137744a8ce
- Add classes: "Assignment", "AssignmentRequest", "UrlReport", "WorkerReport" and "WorkerResponse".
...
- Add interface "WorkerConstants".
2021-04-24 21:10:35 +03:00
Lampros Smyrnaios