UrlsController/src/main/java/eu/openaire/urls_controller/services
Lampros Smyrnaios e2d43a9af0 Upgrade the "processBulkImportedFilesSegment" code:
1) Pre-calculate the file-hashes for all files of the segment and perform a single "getHashLocationsQuery", instead of thousands
2) Write some important events to the bulkImportReport file, as soon as they are added in the list.
2024-04-02 14:35:19 +03:00
..
BulkImportService.java - Add bulk-import support for non-Authoritative data-sources. 2023-09-26 18:02:48 +03:00
BulkImportServiceImpl.java Upgrade the "processBulkImportedFilesSegment" code: 2024-04-02 14:35:19 +03:00
ShutdownService.java Add the "shutdownAllWorkersGracefully" and "cancelShutdownAllWorkersGracefully" endpoints, in order to be able to shut them down at once and update them, without shutting down the whole Service. So in this case the bulk-import procedures will continue to work. 2023-11-29 16:45:58 +02:00
ShutdownServiceImpl.java - Allow to easily change the por used by workers. 2023-12-19 23:31:42 +02:00
StatsService.java - Improve the "shutdownController.sh" script. 2023-07-27 18:27:48 +03:00
StatsServiceImpl.java - Improve handling of the case when no fulltexts have been found or none of the found ones were requested from the worker, as they were already retrieved in the past. 2024-02-23 12:39:28 +02:00
UrlsService.java - Process the WorkerReports in background Jobs and post the reportResults to the Workers. 2023-05-24 13:52:28 +03:00
UrlsServiceImpl.java - Optimize writing to the Bulk-import-report file. 2024-03-22 17:50:55 +02:00