UrlsController/src/main/java/eu/openaire/urls_controller/controllers
Lampros Smyrnaios c7bfd75973 - Add the "getWorkersInfo" endpoint.
- Improve startup speed, by using a faster remote server to get the host's machine public IP. This also reduces the risk of not being able to get the public IP at all.
- Fix the detection of a different IP for a known worker.
- Improve documentation.
2023-05-23 14:57:15 +03:00
..
FullTextsController.java New feature: BulkImport full-text files from compatible datasources. 2023-05-11 03:07:55 +03:00
GeneralController.java - Add the "getWorkersInfo" endpoint. 2023-05-23 14:57:15 +03:00
StatsController.java - In test-environment mode, check for already existing file-hashes only in the "payload_aggregated" table, instead of the whole "payload" view. This way the investigation for false-positive docUrls is easier, as we avoid checking against the millions of "legacy" payloads. 2023-05-15 12:44:16 +03:00
TestController.java - Upgrade the results-loading process: Instead of making thousands of sql-insert requests to Impala now we write the results to parquet files, upload them to HDFS and then import the data into the Impala tables with just 2 requests. This results in a huge performance improvement. 2022-11-10 17:18:21 +02:00
UrlsController.java - Add the "getWorkersInfo" endpoint. 2023-05-23 14:57:15 +03:00