UrlsController/src/main/java/eu/openaire/urls_controller
Lampros Smyrnaios 1111c850b9 - Add support for more than one full-text per id. Allow recognizing fileName additions: "id(1).pdf", "id(2).pdf", etc.
- Fix not giving the databaseName in the "ImpalaController.get10PublicationIdsTest()".
- Improve consistency in the "maxAttemptsPerRecord" value, among different threads. Also, reduce the value-increase by one.
- Check if the tableName string is empty, in the "mergeParquetFiles".
- Improve error-logging.
- Set some local variables to "final", optimizing code-execution by the JVM.
2022-02-07 13:57:09 +02:00
..
components - Avoid getting and uploading (to S3), full-texts which are already uploaded by previous assignments-batches. 2021-12-21 15:55:27 +02:00
configuration - Add support for more than one full-text per id. Allow recognizing fileName additions: "id(1).pdf", "id(2).pdf", etc. 2022-02-07 13:57:09 +02:00
controllers - Add support for more than one full-text per id. Allow recognizing fileName additions: "id(1).pdf", "id(2).pdf", etc. 2022-02-07 13:57:09 +02:00
models Improve performance in the "getUrls"-endpoint, and more: 2021-11-30 19:59:46 +02:00
payloads - Fix a "databaseLock" bug, which could cause both the payload and attempt inserts and the "mergeParquetFiles" to fail, as the inserts could be executed concurrently with tables-compaction. 2021-11-30 13:26:19 +02:00
security - Add the "isControllerAlive"-endpoint. 2021-09-23 15:08:52 +03:00
util - Add support for more than one full-text per id. Allow recognizing fileName additions: "id(1).pdf", "id(2).pdf", etc. 2022-02-07 13:57:09 +02:00
Application.java - Improve performance when handling WorkerReports' database insertions, by using parallelism to insert to two different tables in the same time. Also, pre-cache the query-argument-types. 2022-02-04 14:48:22 +02:00