gCubeSystem
/
accounting-aggregator-se-plugin
16
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
153 Commits 2 Branches 2 Tags 362 KiB
Commit Graph

98 Commits

Author SHA1 Message Date
Luca Frosini bf5acae417 fixing test 2021-04-18 21:28:06 +02:00
Luca Frosini 8d0ebb19a2 fixed test 2021-04-15 17:59:19 +02:00
Luca Frosini ac09f0390b fixed test 2021-04-15 17:58:30 +02:00
Luca Frosini 05af440c93 fixed test data 2021-04-15 16:52:42 +02:00
Luca Frosini bc4d09aeaf added tests to investigate issues 2021-04-15 14:58:12 +02:00
Luca Frosini 752b933419 Some fixes 2021-04-12 16:50:41 +02:00
Luca Frosini ebc2dfe7ee Changed tests 2021-04-11 21:29:05 +02:00
Luca Frosini 91ce1233ed Added procedure to migrate AccountignManager documents 2021-04-08 23:08:47 +02:00
Luca Frosini f7c89321ee Fixes 2021-04-08 11:30:13 +02:00
Luca Frosini 12ca03a111 Migrating aggregator to PersistenceSQL 2021-03-25 12:38:28 +01:00
Luca Frosini cc6fea69fb Aggregator mvoe the rcords to TimeScaleDB 2021-03-12 11:24:09 +01:00
Luca Frosini c2950bd135 Switching to new smart-executor-api 2020-09-30 12:12:22 +02:00
Luca Frosini e9a3239f07 added test to analyse aggreation results 2020-04-17 17:34:13 +02:00
Luca Frosini bd213405d5 Removed white spaces 2020-04-14 18:05:29 +02:00
Luca Frosini 4477b0e735 Fixed workspace folder creation #19056 2020-04-11 00:10:02 +02:00
Luca Frosini 1f560d0b01 Improved aggregator 2020-04-03 17:59:39 +02:00
Luca Frosini 8812f66acc Fixing aggregator 2020-03-24 20:19:00 +01:00
Luca Frosini e730349f8d Added a sleep of 3 milliseconds to slow down the record read so mitigate 
the overload on couchbase
 2020-03-16 16:43:37 +01:00
Luca Frosini 653dd085ba Fixed test 2020-03-16 15:12:34 +01:00
Luca Frosini 5f7455da9a Switched form HTTP request to the old HomeLibrary Webapp to storage hub 
client
 2020-03-16 15:10:43 +01:00
Luca Frosini 3434b1e208 Added DesignId for MonthlyAggregatedServiceUsageRecord 2020-03-16 15:08:16 +01:00
Luca Frosini db6e78e252 Added 3 milliseconds between each delete/insert operation to slow down 
the access to DB.
 2020-03-16 15:07:48 +01:00
Luca Frosini 0ba72759af Using StorageHubClient in place of Home Library Webapp HTTP calls. 
Added the generation of a CSV to post analyze the calledMethods
 2020-03-12 19:42:34 +01:00
Luca Frosini e6a4dbc3a7 USing StorageHubClient in place of Home Library Webapp HTTP calls 2020-03-11 18:52:39 +01:00
Luca Frosini b26baa781a Fixing project to migrate monthly aggregated accounting records in a 
dedicated bucket #12803
 2020-03-11 15:33:39 +01:00
Luca Frosini 62664d2a51 fixed test 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164679 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-03-02 16:01:03 +00:00
Luca Frosini 19d7dc83e7 Logging every 1% elaborated rows when the total number is greatest than 1000000 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164545 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-23 09:55:54 +00:00
Luca Frosini e8b6dfcc50 Refs #11258 Add possibility to force to rerun an already completed aggregation 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164535 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 16:13:54 +00:00
Luca Frosini a511653fe4 Fixing test 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164533 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 15:19:21 +00:00
Luca Frosini df86a33f1f Fixing test 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164528 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:38:49 +00:00
Luca Frosini beddf36e7a Refs #11258 Added retry when inserting or deleting documents 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164527 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:37:04 +00:00
Luca Frosini 243c1cd6c7 Refs #11258: Add possibility to force to rerun an already completed aggregation 
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164526 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:32:06 +00:00
Luca Frosini f0332ebd4d Refs #11258 Added retry when inserting or deleting documents 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164525 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:31:35 +00:00
Luca Frosini a6a5302227 Refs #11258: Add possibility to force aggregation (already made or after the allowed range) 
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164522 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 13:49:54 +00:00
Luca Frosini 8873d8843e Refs #11233: Add Regex Rules to Accounting Aggregator 
Task-Url: https://support.d4science.org/issues/11233

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164463 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-20 17:26:37 +00:00
Luca Frosini 03c705983d Logging every 5% elaborated rows when the total number is greatest than 100000 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@163326 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-15 17:45:59 +00:00
Luca Frosini c9d6c39777 Logging every 5% elaborated rows when the total number is greatest than 100000 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@163325 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-15 17:45:41 +00:00
Luca Frosini 1b67851978 Upgraded version and changelog after release 4.10.0 refs #10903. Merged changes made directly in release branch. 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@163296 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-15 14:00:49 +00:00
Luca Frosini dedee9651f Fixed test 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@162711 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-01-29 11:48:31 +00:00
Luca Frosini a00a70e57b Fixed test 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@162697 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-01-26 17:24:34 +00:00
Luca Frosini 61359077fa Added test for fix of old records persisted using double instead of long for creationTime, startTime, endTime and instead of int for duration and fixed bugs 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@162675 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-01-26 15:02:43 +00:00
Luca Frosini f705b73ca9 Added test for fix of old records persisted using double instead of long for creationTime, startTime, endTime and instead of int for duration and fixed bugs 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@162674 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-01-26 15:02:30 +00:00
Luca Frosini 4cf6d72113 Added fix for old records persisted using double instead of long for creationTime, startTime, endTime and instead of int for duration. 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@162662 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-01-26 14:00:16 +00:00
Luca Frosini 07677541f1 Removed unneeded constant 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@160505 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-12-14 14:28:53 +00:00
Luca Frosini 13262bdb72 Fixed javadoc warning 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@157730 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-10-27 14:50:14 +00:00
Luca Frosini d7731934f5 Removed .settings folder from svn 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@157687 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-10-27 13:15:09 +00:00
Luca Frosini 26c9cf5cf2 Merged from branch 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@155053 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-10-10 10:25:13 +00:00
Luca Frosini b2e0eb62cb Merged from branch 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154647 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 16:07:54 +00:00
Luca Frosini 891d15e355 Fixing exception message 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154628 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 15:00:05 +00:00
Luca Frosini 1c7574c4f3 Fixed typo 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154626 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 14:56:44 +00:00