Lampros Smyrnaios
cd1fb0af88
- Process the WorkerReports in background Jobs and post the reportResults to the Workers.
...
- Save the workerReports to json files, until they are processed successfully.
- Show some custom metrics in prometheus.
2023-05-24 13:52:28 +03:00
Lampros Smyrnaios
780ed15ce2
- Fix a "databaseLock" bug, which could cause both the payload and attempt inserts and the "mergeParquetFiles" to fail, as the inserts could be executed concurrently with tables-compaction.
...
- Fix the "null" representation of an "unknown" payload-size in the database.
- Remove the obsolete thread-locking for the "CreateDatabase" operation. This code is guaranteed to run BEFORE any other operation in the database.
- Implement the "handlePreparedStatementException" and "closeConnection" methods.
- Improve error-logs.
- Update dependencies.
- Code cleanup.
2021-11-30 13:26:19 +02:00
Lampros Smyrnaios
0d47c33a08
- Improve logging configurations.
...
- Fix the "AssignmentResponse.toString()" method.
- Update SpringBoot to v.2.5.6
- Code cleanup.
2021-11-04 11:57:19 +02:00
Lampros Smyrnaios
27375b9396
- Refactor the Assignment-creation.
...
In order to match the database, now we have a list of Assignments sent through the AssignmentResponse, instead of a single Assignment having a list of tasks.
- Cleanup the members of the "Payload" model (also prepare for database integration).
2021-07-05 14:04:39 +03:00
Lampros Smyrnaios
40763ec146
Update the "WorkerReport" request and the "UrlReport" and "Payload" models.
2021-06-19 07:07:36 +03:00
Lampros Smyrnaios
d20fcf9cce
- Update the "getUrls" and "getTestUrls" endpoints to take the data from the workers, in http-request-parameters instead of the http-body.
...
- Fix tasksLimit-check.
- Code cleanup.
2021-05-19 02:32:46 +03:00
Lampros Smyrnaios
e2cc320baf
- Add the "getTestUrls"-endpoint which returns an "Assignment" with data retrieved from the added resource-file.
...
- Update the "getUrls"-endpoint to be ready to retrieve data from the database, once it's added.
- Update the dependencies.
- Code cleanup.
2021-05-18 17:23:20 +03:00
Lampros Smyrnaios
85ecc4a36b
Add classes: "AssignmentResponse", "WorkerReport", "WorkerRequest", "UrlReport".
2021-04-24 21:06:52 +03:00
Lampros Smyrnaios
c2ea8a69de
Update classes: "Assignment", "Task", "Error", "Payload", "UrlsRequest".
2021-04-24 21:05:21 +03:00
Lampros Smyrnaios
c6e12d3e95
- Update "addResults"-endpoint.
...
- Add "UrlsRequest.java".
- Some minor updates in "build.gradle" and "application.properties".
2021-03-16 18:07:30 +02:00
Lampros Smyrnaios
8a4376da9c
Initial commit of UrlsController.
2021-03-16 15:25:15 +02:00
Lampros Smyrnaios