This website requires JavaScript.
Explore
Help
Sign In
lsmyrnaios
/
UrlsWorker
Watch
1
Star
0
Fork
You've already forked UrlsWorker
1
Code
Issues
Pull Requests
Releases
14
Wiki
Activity
7f3ca80959
UrlsWorker
/
src
/
main
/
java
/
eu
/
openaire
/
urls_worker
/
components
History
Lampros Smyrnaios
7f3ca80959
Bypass url-canonicalization for urls containing certain uncommon characters which cause the urls to get rejected.
2023-05-30 19:45:14 +03:00
..
plugins
Bypass url-canonicalization for urls containing certain uncommon characters which cause the urls to get rejected.
2023-05-30 19:45:14 +03:00
AssignmentsHandler.java
Use a single "restTemplate" object, with the same timeouts (a bit increased from the old requestRestTemplate, to account for a possible overloaded Controller), since we no longer need to wait for hours until the workerReport is processed by the Controller.
2023-05-29 14:15:55 +03:00
ConnWithController.java
- Delete any left-over full-texts after 36 hours.
2023-05-23 22:22:57 +03:00
ScheduledTasks.java
- Prevent running out of space, by checking the available free space and stalling the acquisition of new assignments until more free space becomes available.
2023-05-30 17:58:29 +03:00