Commit Graph

114 Commits

Author SHA1 Message Date
Luca Frosini 34c9207468 Fixed tests 2021-11-11 14:53:03 +01:00
Luca Frosini 3a90441a22 Removed no more needed persist start and end time check 2021-11-11 14:29:09 +01:00
Luca Frosini 83b63af502 Fxied test 2021-11-10 17:37:56 +01:00
Luca Frosini 532c74d7e4 Improved aggregator 2021-11-09 11:53:29 +01:00
Luca Frosini d5352602ef Implementation seems working 2021-11-08 14:57:35 +01:00
Luca Frosini 9752f74c95 Added test 2021-11-05 14:39:18 +01:00
Luca Frosini fd2dac679b Implementing PostgreSQLConnector 2021-11-05 14:25:45 +01:00
Luca Frosini 26a8d2649a Merge branch 'feature/20952' into feature/21347
Conflicts:
	src/test/java/org/gcube/accounting/aggregator/plugin/CouchBaseConnectorTest.java
2021-11-02 17:36:54 +01:00
Luca Frosini e84ec43c5a Fixed test class name 2021-11-02 15:10:55 +01:00
Luca Frosini d574715763 Added missing import 2021-11-02 14:50:43 +01:00
Luca Frosini c5f5e7266c Merge branch 'feature/20952' of gitea@code-repo.d4science.org:gCubeSystem/accounting-aggregator-se-plugin.git into feature/20952 2021-11-02 14:43:19 +01:00
Luca Frosini ac30596d70 Restored check on time 2021-11-02 14:22:44 +01:00
Luca Frosini 0eb3d2fcad removed uneeded import 2021-07-29 14:06:48 +02:00
Luca Frosini d7677d5b51 updating test 2021-07-29 14:06:11 +02:00
Luca Frosini bdddde38e8 Porting plugin to smart-executor 3 2021-07-29 12:35:12 +02:00
Luca Frosini 508f599729 Migrating aggregator completely to TimescaleDB 2021-05-06 13:13:30 +02:00
Luca Frosini bf5acae417 fixing test 2021-04-18 21:28:06 +02:00
Luca Frosini 8d0ebb19a2 fixed test 2021-04-15 17:59:19 +02:00
Luca Frosini ac09f0390b fixed test 2021-04-15 17:58:30 +02:00
Luca Frosini 05af440c93 fixed test data 2021-04-15 16:52:42 +02:00
Luca Frosini bc4d09aeaf added tests to investigate issues 2021-04-15 14:58:12 +02:00
Luca Frosini 752b933419 Some fixes 2021-04-12 16:50:41 +02:00
Luca Frosini ebc2dfe7ee Changed tests 2021-04-11 21:29:05 +02:00
Luca Frosini 91ce1233ed Added procedure to migrate AccountignManager documents 2021-04-08 23:08:47 +02:00
Luca Frosini f7c89321ee Fixes 2021-04-08 11:30:13 +02:00
Luca Frosini 12ca03a111 Migrating aggregator to PersistenceSQL 2021-03-25 12:38:28 +01:00
Luca Frosini cc6fea69fb Aggregator mvoe the rcords to TimeScaleDB 2021-03-12 11:24:09 +01:00
Luca Frosini c2950bd135 Switching to new smart-executor-api 2020-09-30 12:12:22 +02:00
Luca Frosini e9a3239f07 added test to analyse aggreation results 2020-04-17 17:34:13 +02:00
Luca Frosini bd213405d5 Removed white spaces 2020-04-14 18:05:29 +02:00
Luca Frosini 4477b0e735 Fixed workspace folder creation #19056 2020-04-11 00:10:02 +02:00
Luca Frosini 1f560d0b01 Improved aggregator 2020-04-03 17:59:39 +02:00
Luca Frosini 8812f66acc Fixing aggregator 2020-03-24 20:19:00 +01:00
Luca Frosini e730349f8d Added a sleep of 3 milliseconds to slow down the record read so mitigate
the overload on couchbase
2020-03-16 16:43:37 +01:00
Luca Frosini 653dd085ba Fixed test 2020-03-16 15:12:34 +01:00
Luca Frosini 5f7455da9a Switched form HTTP request to the old HomeLibrary Webapp to storage hub
client
2020-03-16 15:10:43 +01:00
Luca Frosini 3434b1e208 Added DesignId for MonthlyAggregatedServiceUsageRecord 2020-03-16 15:08:16 +01:00
Luca Frosini db6e78e252 Added 3 milliseconds between each delete/insert operation to slow down
the access to DB.
2020-03-16 15:07:48 +01:00
Luca Frosini 0ba72759af Using StorageHubClient in place of Home Library Webapp HTTP calls.
Added the generation of a CSV to post analyze the calledMethods
2020-03-12 19:42:34 +01:00
Luca Frosini e6a4dbc3a7 USing StorageHubClient in place of Home Library Webapp HTTP calls 2020-03-11 18:52:39 +01:00
Luca Frosini b26baa781a Fixing project to migrate monthly aggregated accounting records in a
dedicated bucket #12803
2020-03-11 15:33:39 +01:00
Luca Frosini 62664d2a51 fixed test
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164679 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-03-02 16:01:03 +00:00
Luca Frosini 19d7dc83e7 Logging every 1% elaborated rows when the total number is greatest than 1000000
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164545 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-23 09:55:54 +00:00
Luca Frosini e8b6dfcc50 Refs #11258 Add possibility to force to rerun an already completed aggregation
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164535 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 16:13:54 +00:00
Luca Frosini a511653fe4 Fixing test
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164533 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 15:19:21 +00:00
Luca Frosini df86a33f1f Fixing test
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164528 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 14:38:49 +00:00
Luca Frosini beddf36e7a Refs #11258 Added retry when inserting or deleting documents
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164527 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 14:37:04 +00:00
Luca Frosini 243c1cd6c7 Refs #11258: Add possibility to force to rerun an already completed aggregation
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164526 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 14:32:06 +00:00
Luca Frosini f0332ebd4d Refs #11258 Added retry when inserting or deleting documents
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164525 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 14:31:35 +00:00
Luca Frosini a6a5302227 Refs #11258: Add possibility to force aggregation (already made or after the allowed range)
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164522 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-02-22 13:49:54 +00:00