UrlsController/src/main/java/eu/openaire/urls_controller/util
Lampros Smyrnaios cd1fb0af88 - Process the WorkerReports in background Jobs and post the reportResults to the Workers.
- Save the workerReports to json files, until they are processed successfully.
- Show some custom metrics in prometheus.
2023-05-24 13:52:28 +03:00
..
FileDecompressor.java Fix a bug, which caused the full-text files to never close. 2023-05-04 13:03:28 +03:00
FileUtils.java - Process the WorkerReports in background Jobs and post the reportResults to the Workers. 2023-05-24 13:52:28 +03:00
GenericUtils.java New feature: BulkImport full-text files from compatible datasources. 2023-05-11 03:07:55 +03:00
ParquetFileUtils.java - Use separate HDFS subdirectories for each worker in order to avoid seeing exceptions about "empty hdfs directory" when "loading" data to the database, because one worker has loaded data generated by multiple workers (since we use only 1 load operation for multiple parquet files). 2023-05-15 13:12:20 +03:00
S3ObjectStore.java Add an extra precaution-check to allow the emptying or deletion of an S3-Object-Store bucket, only when the app runs in "TestEnvironment". 2023-02-01 16:42:22 +02:00
TestFileUtils.java - Optimize file-related tasks. 2022-05-26 15:43:59 +03:00
UriBuilder.java - Add the "getWorkersInfo" endpoint. 2023-05-23 14:57:15 +03:00