UrlsController/src/main/java/eu/openaire/urls_controller
Lampros Smyrnaios 33ba3e8d91 - Avoid getting and uploading (to S3), full-texts which are already uploaded by previous assignments-batches.
- Fix not updating the fileLocation with the s3Url for records which share the same full-text.
- Set only one delete-order for each assignments-batch-files, not one (or more, by mistake) per zip-batch.
- Set the HttpStatus to "204 - NO_CONTENT", when no assignments are available to be returned to the Worker.
- Fix not unlocking the "dataBaseLock" in case of a "dataBase-connection"-error, in "addWorkerReport()".
- Improve some log-messages.
- Change the log-level for the "S3-bucket already exists" message.
- Update Gradle.
- Optimize imports.
- Code cleanup.
2021-12-21 15:55:27 +02:00
..
components - Avoid getting and uploading (to S3), full-texts which are already uploaded by previous assignments-batches. 2021-12-21 15:55:27 +02:00
configuration - Avoid getting and uploading (to S3), full-texts which are already uploaded by previous assignments-batches. 2021-12-21 15:55:27 +02:00
controllers - Avoid getting and uploading (to S3), full-texts which are already uploaded by previous assignments-batches. 2021-12-21 15:55:27 +02:00
models Improve performance in the "getUrls"-endpoint, and more: 2021-11-30 19:59:46 +02:00
payloads - Fix a "databaseLock" bug, which could cause both the payload and attempt inserts and the "mergeParquetFiles" to fail, as the inserts could be executed concurrently with tables-compaction. 2021-11-30 13:26:19 +02:00
security - Add the "isControllerAlive"-endpoint. 2021-09-23 15:08:52 +03:00
util - Avoid getting and uploading (to S3), full-texts which are already uploaded by previous assignments-batches. 2021-12-21 15:55:27 +02:00
Application.java - Avoid getting and uploading (to S3), full-texts which are already uploaded by previous assignments-batches. 2021-12-21 15:55:27 +02:00