You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
UrlsController/src/main/java/eu/openaire/urls_controller/services
Lampros Smyrnaios e2d43a9af0 Upgrade the "processBulkImportedFilesSegment" code:
1) Pre-calculate the file-hashes for all files of the segment and perform a single "getHashLocationsQuery", instead of thousands
2) Write some important events to the bulkImportReport file, as soon as they are added in the list.
4 weeks ago
..
BulkImportService.java - Add bulk-import support for non-Authoritative data-sources. 7 months ago
BulkImportServiceImpl.java Upgrade the "processBulkImportedFilesSegment" code: 4 weeks ago
ShutdownService.java Add the "shutdownAllWorkersGracefully" and "cancelShutdownAllWorkersGracefully" endpoints, in order to be able to shut them down at once and update them, without shutting down the whole Service. So in this case the bulk-import procedures will continue to work. 5 months ago
ShutdownServiceImpl.java - Allow to easily change the por used by workers. 4 months ago
StatsService.java - Improve the "shutdownController.sh" script. 9 months ago
StatsServiceImpl.java - Improve handling of the case when no fulltexts have been found or none of the found ones were requested from the worker, as they were already retrieved in the past. 2 months ago
UrlsService.java - Process the WorkerReports in background Jobs and post the reportResults to the Workers. 11 months ago
UrlsServiceImpl.java - Optimize writing to the Bulk-import-report file. 1 month ago