29 Commits (master)
 

Author SHA1 Message Date
LSmyrnaios a46ab84f10 - Increase the lower and upper limits for the Java Heap Size. 8 hours ago
LSmyrnaios dea257b87f - Fix a bug, which caused the get-full-texts request to fail, because of the wrong "requestAssignmentsCounter". 8 hours ago
LSmyrnaios 15224c6468 Improve performance in the "getUrls"-endpoint, and more: 6 days ago
LSmyrnaios 48eed20dd8 - Implement the "getAndUploadFullTexts" functionality. In order to access the S3-ObjectStore from one trusted place, the Controller will request the files from the workers and upload them on S3. Afterwards, the workers will delete those files from their local storage. Previously, each worker uploaded its own files. 6 days ago
LSmyrnaios 780ed15ce2 - Fix a "databaseLock" bug, which could cause both the payload and attempt inserts and the "mergeParquetFiles" to fail, as the inserts could be executed concurrently with tables-compaction. 7 days ago
LSmyrnaios d100af35d0 - Implement the "getUrls" and "addWorkerReport" endpoints with full database-handling. 4 weeks ago
LSmyrnaios 0d47c33a08 - Improve logging configurations. 1 month ago
LSmyrnaios 0540820817 -Update "installAndRun.sh": 2 months ago
LSmyrnaios d931315ced - Add the "isControllerAlive"-endpoint. 2 months ago
LSmyrnaios 983b900da7 - Add the "installAndRun.sh" script. 3 months ago
LSmyrnaios d56e988518 - Process the Error of PDF-aggregation. Distinguish between "couldRetry" and "noRetry" cases. 4 months ago
LSmyrnaios 25c566bf68 - Change server's port. 4 months ago
LSmyrnaios 27375b9396 - Refactor the Assignment-creation. 5 months ago
LSmyrnaios 5e7ccbd8c6 Add the "addWorkerReport" endpoint. 6 months ago
LSmyrnaios 40763ec146 Update the "WorkerReport" request and the "UrlReport" and "Payload" models. 6 months ago
LSmyrnaios c194af167f Allow handling of concurrent requests to the "getTestUrls"-endpoint. 6 months ago
LSmyrnaios 308cab5ecd - Return an HTTP-500-error when the server cannot find the resourceFile requested by the "getTestUrls"-endpoint. 6 months ago
LSmyrnaios 6729f51b03 Add an "assignmentId" field in the "Assignment"-class. 6 months ago
LSmyrnaios 87044574b5 Update dependencies and add the "gradle-wrapper.properties" file which defines the gradle version. 6 months ago
LSmyrnaios 787299b5b7 Add the "Datasource" inside the "Task" class and include it in the Assignment. 7 months ago
LSmyrnaios d20fcf9cce - Update the "getUrls" and "getTestUrls" endpoints to take the data from the workers, in http-request-parameters instead of the http-body. 7 months ago
LSmyrnaios e2cc320baf - Add the "getTestUrls"-endpoint which returns an "Assignment" with data retrieved from the added resource-file. 7 months ago
LSmyrnaios d3588ea36b Add the "DownloadAttempt" class. 8 months ago
LSmyrnaios a6ab810ad3 Update classes: "Publication" and "Payload". 8 months ago
LSmyrnaios 85ecc4a36b Add classes: "AssignmentResponse", "WorkerReport", "WorkerRequest", "UrlReport". 8 months ago
LSmyrnaios c2ea8a69de Update classes: "Assignment", "Task", "Error", "Payload", "UrlsRequest". 8 months ago
LSmyrnaios 89c6a73a30 Add "Assignment", "Task" and "Error" classes. 8 months ago
LSmyrnaios c6e12d3e95 - Update "addResults"-endpoint. 9 months ago
LSmyrnaios 8a4376da9c Initial commit of UrlsController. 9 months ago