Lampros Smyrnaios 8f9786de09 Upgrade the algorithm for finding the previously-found fulltexts, based on their md5hash: ... - Use a single query with a list of the fileHashes, instead of thousands of singe-md5hash-check queries (run at most 6 in parallel) which require a lot of I/O. - Avoid checking multiple times the same fileHash, in case it is related with multiple payloads. - In case of a database-error, avoid completely losing the full-texts of that worker, instead, continue processing the full-texts.		2024-03-13 11:28:37 +02:00
..
urls_controller	Upgrade the algorithm for finding the previously-found fulltexts, based on their md5hash:	2024-03-13 11:28:37 +02:00