UrlsController/src/main/java/eu/openaire/urls_controller/util
Lampros Smyrnaios dc8f0f2bd1 - Heavily reduce the maximum amount of space needed, by deleting the files of each full-texts batch, right after they are uploaded to the S3 Object Store.
- Add a check for when the retrieved full-texts-batch is missing some requested files and show a warn-log.
- Update dependencies.
2023-01-23 20:23:21 +02:00
..
FileDecompressor.java - Use Facebook's [**Zstandard**](https://facebook.github.io/zstd/) compression algorithm, which brings very big benefits on compression rate and speed. 2023-01-10 13:34:54 +02:00
FileUtils.java - Heavily reduce the maximum amount of space needed, by deleting the files of each full-texts batch, right after they are uploaded to the S3 Object Store. 2023-01-23 20:23:21 +02:00
GenericUtils.java Add the "Datasource" inside the "Task" class and include it in the Assignment. 2021-05-20 02:50:50 +03:00
ParquetFileUtils.java - Make sure the test-environment uses a dedicated hdfs-parquet-directory. 2023-01-18 13:38:05 +02:00
S3ObjectStore.java - Make sure the fullPath of the baseFilesLocation is available when the user specifies a non-root directory. 2023-01-09 15:44:53 +02:00
TestFileUtils.java - Optimize file-related tasks. 2022-05-26 15:43:59 +03:00
UriBuilder.java - Make sure the fullPath of the baseFilesLocation is available when the user specifies a non-root directory. 2023-01-09 15:44:53 +02:00