UrlsController/src/main/java/eu/openaire/urls_controller/controllers
Lampros Smyrnaios 48eed20dd8 - Implement the "getAndUploadFullTexts" functionality. In order to access the S3-ObjectStore from one trusted place, the Controller will request the files from the workers and upload them on S3. Afterwards, the workers will delete those files from their local storage. Previously, each worker uploaded its own files.
- Move the "mergeParquetFiles" and "getCutBatchExceptionMessage" methods inside the "FileUtils" class.
- Code cleanup.
2021-11-30 18:23:27 +02:00
..
GeneralController.java - Add the "isControllerAlive"-endpoint. 2021-09-23 15:08:52 +03:00
ImpalaController.java - Implement the "getUrls" and "addWorkerReport" endpoints with full database-handling. 2021-11-09 23:59:27 +02:00
UrlController.java - Implement the "getAndUploadFullTexts" functionality. In order to access the S3-ObjectStore from one trusted place, the Controller will request the files from the workers and upload them on S3. Afterwards, the workers will delete those files from their local storage. Previously, each worker uploaded its own files. 2021-11-30 18:23:27 +02:00