UrlsController/src/main/java/eu/openaire/urls_controller/util
Lampros Smyrnaios 577ea983e8 - Improve some log-messages.
- Set some optimization settings for gradle.
- Fix error-handling in "installAndRun.sh".
- Update dependencies.
2022-11-30 16:28:39 +02:00
..
FileUnZipper.java - Optimize file-related tasks. 2022-05-26 15:43:59 +03:00
FileUtils.java - Upgrade the results-loading process: Instead of making thousands of sql-insert requests to Impala now we write the results to parquet files, upload them to HDFS and then import the data into the Impala tables with just 2 requests. This results in a huge performance improvement. 2022-11-10 17:18:21 +02:00
GenericUtils.java Add the "Datasource" inside the "Task" class and include it in the Assignment. 2021-05-20 02:50:50 +03:00
ParquetFileUtils.java - Improve some log-messages. 2022-11-30 16:28:39 +02:00
S3ObjectStore.java - Remove the obsolete "parenthesis" and "increasing duplicate-num" from the full-texts' names, before sending them to the S3-Object-Store. They now end with the "file-hash", so it is guaranteed that they will be unique. The Worker continues to produce the previous kind of names, without any disturbance. 2022-04-11 21:15:22 +03:00
TestFileUtils.java - Optimize file-related tasks. 2022-05-26 15:43:59 +03:00
UriBuilder.java Update the "UriBuilder.java" to be able to acquire the running port of the server, in case the port-number was initially set to "random" (0). Also make sure we get the "localHostAddress" and not the "localHostName", in case the public IP is not retrievable. 2022-09-12 17:04:05 +03:00