UrlsWorker

Commit Graph

Author	SHA1	Message	Date
Lampros Smyrnaios	2ffb44a615	- Update the "installAndRun.sh": --Ask the user to give the "workerId" and the "controllerBaseUrl". --Make sure the "libs" directory is created, if not exists. --Make sure the "unzip" package is installed. - Change the data-type of the "UrlReport.status" to be "enum StatusType", in order to increase consistency and comparability. - Update the guidelines in the README.	2021-09-22 16:36:48 +03:00
Lampros Smyrnaios	61597d1627	- Read the Controller's url from a file, when starting the Application. - Switch the "AssignmentsHandler.askForTest" to "false". - Get the size and the hash of a docFile which is previously downloaded by another ID in that batch. - Reset the "AssignmentHandler.urlReports" list after posting the results to the Controller. - Enhance logging and comments. - Add more guidelines in the README. - Disable the scheduled test-live job. - Code cleanup.	2021-09-21 16:21:39 +03:00
Lampros Smyrnaios	f6e53ca289	Integrate the "PublicationsRetriever" program as a plugin, which downloads the full-texts of the publications. Afterwards, the retrieved data info is transferred to the Controller. The "PublicationsRetriever" can be installed locally as a library, using the "installPublicationsRetriever.sh" script.	2021-06-22 05:58:07 +03:00
Lampros Smyrnaios	3550ed71d9	Execute the "AssignmentHandler.handleAssignment()", only from the scheduler, as it starts automatically when the program starts.	2021-06-11 13:44:33 +03:00
Lampros Smyrnaios	82e12655e7	- Add an "AssignmentHandler", which retrieves the assignment from the controller and categorises the tasks using their datasource. In the future, it will execute the tasks of the assignment, using different plugins. It runs upon the Application start and also every 30 mins (if no other job is in execution). - Add the "isWorkerAvailableForWork-endpoint.	2021-05-20 03:28:48 +03:00
Lampros Smyrnaios	08eabe6f08	Initial commit of UrlsWorker.	2021-03-16 18:38:53 +02:00

6 Commits