gCubeSystem
/
accounting-aggregator-se-plugin
16
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
206 Commits 2 Branches 2 Tags 368 KiB
Commit Graph

102 Commits

Author SHA1 Message Date
Luca Frosini 74349c3253 Added 3 attempts in upsert aggregation_status 2024-03-08 11:47:26 +01:00
Luca Frosini e2bcfc016a Fixed ConnectorStatus 2024-03-08 11:46:50 +01:00
Luca Frosini 0abad39443 Moved sleep time to the implementation 2024-03-08 11:46:07 +01:00
Luca Frosini 5e8f31f384 Moved aggregation status connector to dst instance 2024-02-29 16:11:31 +01:00
Luca Frosini 58529a17ca Improved code 2024-02-29 15:28:00 +01:00
Luca Frosini e7759dd97f Fixed bulk delete 2024-02-28 17:12:01 +01:00
Luca Frosini 2c927dda9d Added estimated row to be aggregated as info in logs 2024-02-28 16:37:22 +01:00
Luca Frosini 3d9fd9d42f Added bulk delete to try to speedup the process 2024-02-27 12:12:57 +01:00
Luca Frosini 0c236e845d Improving aggregator 2024-02-22 16:14:51 +01:00
Luca Frosini 210361a0ff Fixing plugin 2024-02-16 17:06:49 +01:00
Luca Frosini e9eed9f889 Fixing code 2024-02-14 18:18:05 +01:00
Luca Frosini 9ff6bdc135 Fixed code 2024-02-14 17:50:22 +01:00
Luca Frosini d2a67855c1 Improved aggregator 2024-02-13 16:03:10 +01:00
Luca Frosini a11a3ba8e8 Fixing inheritance 2024-02-06 12:38:15 +01:00
Luca Frosini 28b6498967 REfactoring code to enable different src and destination 2024-02-06 12:31:38 +01:00
Luca Frosini 750c5ebb19 Refactoring persistence to support src and dst 2024-02-05 17:29:27 +01:00
Luca Frosini abec9f97f8 Creating management of source and destination persistence 2024-02-05 16:32:08 +01:00
Luca Frosini 3a90441a22 Removed no more needed persist start and end time check 2021-11-11 14:29:09 +01:00
Luca Frosini 532c74d7e4 Improved aggregator 2021-11-09 11:53:29 +01:00
Luca Frosini d5352602ef Implementation seems working 2021-11-08 14:57:35 +01:00
Luca Frosini fd2dac679b Implementing PostgreSQLConnector 2021-11-05 14:25:45 +01:00
Luca Frosini 26a8d2649a Merge branch 'feature/20952' into feature/21347 
Conflicts:
	src/test/java/org/gcube/accounting/aggregator/plugin/CouchBaseConnectorTest.java
 2021-11-02 17:36:54 +01:00
Luca Frosini d574715763 Added missing import 2021-11-02 14:50:43 +01:00
Luca Frosini c5f5e7266c Merge branch 'feature/20952' of gitea@code-repo.d4science.org:gCubeSystem/accounting-aggregator-se-plugin.git into feature/20952 2021-11-02 14:43:19 +01:00
Luca Frosini ac30596d70 Restored check on time 2021-11-02 14:22:44 +01:00
Luca Frosini 0eb3d2fcad removed uneeded import 2021-07-29 14:06:48 +02:00
Luca Frosini 508f599729 Migrating aggregator completely to TimescaleDB 2021-05-06 13:13:30 +02:00
Luca Frosini bc4d09aeaf added tests to investigate issues 2021-04-15 14:58:12 +02:00
Luca Frosini 752b933419 Some fixes 2021-04-12 16:50:41 +02:00
Luca Frosini 91ce1233ed Added procedure to migrate AccountignManager documents 2021-04-08 23:08:47 +02:00
Luca Frosini f7c89321ee Fixes 2021-04-08 11:30:13 +02:00
Luca Frosini 12ca03a111 Migrating aggregator to PersistenceSQL 2021-03-25 12:38:28 +01:00
Luca Frosini cc6fea69fb Aggregator mvoe the rcords to TimeScaleDB 2021-03-12 11:24:09 +01:00
Luca Frosini c2950bd135 Switching to new smart-executor-api 2020-09-30 12:12:22 +02:00
Luca Frosini bd213405d5 Removed white spaces 2020-04-14 18:05:29 +02:00
Luca Frosini 4477b0e735 Fixed workspace folder creation #19056 2020-04-11 00:10:02 +02:00
Luca Frosini 1f560d0b01 Improved aggregator 2020-04-03 17:59:39 +02:00
Luca Frosini 8812f66acc Fixing aggregator 2020-03-24 20:19:00 +01:00
Luca Frosini e730349f8d Added a sleep of 3 milliseconds to slow down the record read so mitigate 
the overload on couchbase
 2020-03-16 16:43:37 +01:00
Luca Frosini 5f7455da9a Switched form HTTP request to the old HomeLibrary Webapp to storage hub 
client
 2020-03-16 15:10:43 +01:00
Luca Frosini 3434b1e208 Added DesignId for MonthlyAggregatedServiceUsageRecord 2020-03-16 15:08:16 +01:00
Luca Frosini db6e78e252 Added 3 milliseconds between each delete/insert operation to slow down 
the access to DB.
 2020-03-16 15:07:48 +01:00
Luca Frosini 0ba72759af Using StorageHubClient in place of Home Library Webapp HTTP calls. 
Added the generation of a CSV to post analyze the calledMethods
 2020-03-12 19:42:34 +01:00
Luca Frosini e6a4dbc3a7 USing StorageHubClient in place of Home Library Webapp HTTP calls 2020-03-11 18:52:39 +01:00
Luca Frosini 19d7dc83e7 Logging every 1% elaborated rows when the total number is greatest than 1000000 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164545 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-23 09:55:54 +00:00
Luca Frosini e8b6dfcc50 Refs #11258 Add possibility to force to rerun an already completed aggregation 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164535 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 16:13:54 +00:00
Luca Frosini beddf36e7a Refs #11258 Added retry when inserting or deleting documents 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164527 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:37:04 +00:00
Luca Frosini 243c1cd6c7 Refs #11258: Add possibility to force to rerun an already completed aggregation 
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164526 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:32:06 +00:00
Luca Frosini f0332ebd4d Refs #11258 Added retry when inserting or deleting documents 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164525 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:31:35 +00:00
Luca Frosini a6a5302227 Refs #11258: Add possibility to force aggregation (already made or after the allowed range) 
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164522 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 13:49:54 +00:00