Commit Graph

19 Commits

Author SHA1 Message Date
Luca Frosini 0abad39443 Moved sleep time to the implementation 2024-03-08 11:46:07 +01:00
Luca Frosini 2c927dda9d Added estimated row to be aggregated as info in logs 2024-02-28 16:37:22 +01:00
Luca Frosini 3d9fd9d42f Added bulk delete to try to speedup the process 2024-02-27 12:12:57 +01:00
Luca Frosini 210361a0ff Fixing plugin 2024-02-16 17:06:49 +01:00
Luca Frosini d2a67855c1 Improved aggregator 2024-02-13 16:03:10 +01:00
Luca Frosini 508f599729 Migrating aggregator completely to TimescaleDB 2021-05-06 13:13:30 +02:00
Luca Frosini db6e78e252 Added 3 milliseconds between each delete/insert operation to slow down
the access to DB.
2020-03-16 15:07:48 +01:00
Luca Frosini 0ba72759af Using StorageHubClient in place of Home Library Webapp HTTP calls.
Added the generation of a CSV to post analyze the calledMethods
2020-03-12 19:42:34 +01:00
Luca Frosini 19d7dc83e7 Logging every 1% elaborated rows when the total number is greatest than 1000000
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164545 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-23 09:55:54 +00:00
Luca Frosini beddf36e7a Refs #11258 Added retry when inserting or deleting documents
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164527 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 14:37:04 +00:00
Luca Frosini 243c1cd6c7 Refs #11258: Add possibility to force to rerun an already completed aggregation
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164526 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 14:32:06 +00:00
Luca Frosini f0332ebd4d Refs #11258 Added retry when inserting or deleting documents
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164525 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 14:31:35 +00:00
Luca Frosini a6a5302227 Refs #11258: Add possibility to force aggregation (already made or after the allowed range)
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164522 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 13:49:54 +00:00
Luca Frosini c9d6c39777 Logging every 5% elaborated rows when the total number is greatest than 100000
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@163325 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-15 17:45:41 +00:00
Luca Frosini b2e0eb62cb Merged from branch
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154647 82a268e6-3cf1-43bd-a215-b396298e98cf
2017-09-26 16:07:54 +00:00
Luca Frosini 891d15e355 Fixing exception message
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154628 82a268e6-3cf1-43bd-a215-b396298e98cf
2017-09-26 15:00:05 +00:00
Luca Frosini 1c7574c4f3 Fixed typo
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154626 82a268e6-3cf1-43bd-a215-b396298e98cf
2017-09-26 14:56:44 +00:00
Luca Frosini f954b7ff03 Added guard to avoid to lose data in case of problems
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154623 82a268e6-3cf1-43bd-a215-b396298e98cf
2017-09-26 14:55:39 +00:00
Luca Frosini d3c44831b7 Merged from private branch. Refactored accounting-aggregator-plugin. Fixes #9419
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@152682 82a268e6-3cf1-43bd-a215-b396298e98cf
2017-09-05 15:13:50 +00:00