UrlsController/src/main/java/eu/openaire/urls_controller/services
Lampros Smyrnaios 08de530f03 Various improvements:
- Handle the case when "fileUtils.constructS3FilenameAndUploadToS3()" returns "null", in "processBulkImportedFile()".
- Avoid an "IllegalArgumentException" in "Lists.partition()" when the number of files to bulkImport are fewer than the number of threads available to handle them.
- Include the last directory's "/" divider in the fileDIR group of "FILEPATH_ID_EXTENSION" regex (renamed from "FILENAME_ID_EXTENSION").
- Fix an incomplete log-message.
- Provide the "fileLocation" argument in the "DocFileData" constructor, in "processBulkImportedFile()", even though it's not used after.
2024-03-29 17:23:01 +02:00
..
BulkImportService.java - Add bulk-import support for non-Authoritative data-sources. 2023-09-26 18:02:48 +03:00
BulkImportServiceImpl.java Various improvements: 2024-03-29 17:23:01 +02:00
ShutdownService.java Add the "shutdownAllWorkersGracefully" and "cancelShutdownAllWorkersGracefully" endpoints, in order to be able to shut them down at once and update them, without shutting down the whole Service. So in this case the bulk-import procedures will continue to work. 2023-11-29 16:45:58 +02:00
ShutdownServiceImpl.java - Allow to easily change the por used by workers. 2023-12-19 23:31:42 +02:00
StatsService.java - Improve the "shutdownController.sh" script. 2023-07-27 18:27:48 +03:00
StatsServiceImpl.java - Improve handling of the case when no fulltexts have been found or none of the found ones were requested from the worker, as they were already retrieved in the past. 2024-02-23 12:39:28 +02:00
UrlsService.java - Process the WorkerReports in background Jobs and post the reportResults to the Workers. 2023-05-24 13:52:28 +03:00
UrlsServiceImpl.java - Optimize writing to the Bulk-import-report file. 2024-03-22 17:50:55 +02:00