UrlsController/src/main/java/eu/openaire/urls_controller/controllers
Lampros Smyrnaios 66a5b3c7da Update Bulk-Import API:
- Increase the "numOfThreadsPerBulkImportProcedure" to 6.
- Fix Bulk import not working from a second-level subdirectory; the report-subDirectory was not created.
- Fix not returning the bulk-import-report as "application/json".
- Add useful messages for missing parameters.
- Change the HTTP-method for the "bulkImportFullTexts" endpoint to "POST".
- Show a structured json-response for the "bulkImportFullTexts" endpoint.
- Fix uncommon date-format.
- Remove single quotes from json-report, since they are returned as bytes, not characters.
- Optimize the generation of the json-bulkImport-report.
2023-07-25 11:59:47 +03:00
..
BulkImportController.java Update Bulk-Import API: 2023-07-25 11:59:47 +03:00
GeneralController.java - Add the "getWorkersInfo" endpoint. 2023-05-23 14:57:15 +03:00
ShutdownController.java - Identify and handle a possible Worker-crash, in "UrlsServiceImpl.postReportResultToWorker()". 2023-06-15 23:19:36 +03:00
StatsController.java - Avoid passing some duplicate publications to the Workers, by post-processing the assignments retrieved from Impala. The assignments may contain duplicate id-url pairs, which have different datasources, since one publication may be connected to multiple datasources. 2023-07-19 18:31:24 +03:00
TestController.java - Fix missing changes. 2023-07-24 19:55:37 +03:00
UrlsController.java Improve performance by applying the merging-procedure for the parquet files of the database tables less often, while keeping the benefits of having a relatively small maximum number of parquet files in search operations. 2023-07-24 20:28:41 +03:00