gCubeSystem
/
accounting-aggregator-se-plugin
16
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
117 Commits 2 Branches 2 Tags 362 KiB
Commit Graph

59 Commits

Author SHA1 Message Date
Luca Frosini 19d7dc83e7 Logging every 1% elaborated rows when the total number is greatest than 1000000 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164545 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-23 09:55:54 +00:00
Luca Frosini e8b6dfcc50 Refs #11258 Add possibility to force to rerun an already completed aggregation 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164535 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 16:13:54 +00:00
Luca Frosini beddf36e7a Refs #11258 Added retry when inserting or deleting documents 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164527 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:37:04 +00:00
Luca Frosini 243c1cd6c7 Refs #11258: Add possibility to force to rerun an already completed aggregation 
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164526 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:32:06 +00:00
Luca Frosini f0332ebd4d Refs #11258 Added retry when inserting or deleting documents 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164525 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 14:31:35 +00:00
Luca Frosini a6a5302227 Refs #11258: Add possibility to force aggregation (already made or after the allowed range) 
Task-Url: https://support.d4science.org/issues/11258

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164522 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-22 13:49:54 +00:00
Luca Frosini 8873d8843e Refs #11233: Add Regex Rules to Accounting Aggregator 
Task-Url: https://support.d4science.org/issues/11233

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@164463 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-20 17:26:37 +00:00
Luca Frosini c9d6c39777 Logging every 5% elaborated rows when the total number is greatest than 100000 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@163325 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-02-15 17:45:41 +00:00
Luca Frosini 61359077fa Added test for fix of old records persisted using double instead of long for creationTime, startTime, endTime and instead of int for duration and fixed bugs 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@162675 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-01-26 15:02:43 +00:00
Luca Frosini 4cf6d72113 Added fix for old records persisted using double instead of long for creationTime, startTime, endTime and instead of int for duration. 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@162662 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-01-26 14:00:16 +00:00
Luca Frosini 13262bdb72 Fixed javadoc warning 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@157730 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-10-27 14:50:14 +00:00
Luca Frosini d7731934f5 Removed .settings folder from svn 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@157687 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-10-27 13:15:09 +00:00
Luca Frosini 26c9cf5cf2 Merged from branch 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@155053 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-10-10 10:25:13 +00:00
Luca Frosini b2e0eb62cb Merged from branch 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154647 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 16:07:54 +00:00
Luca Frosini 891d15e355 Fixing exception message 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154628 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 15:00:05 +00:00
Luca Frosini 1c7574c4f3 Fixed typo 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154626 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 14:56:44 +00:00
Luca Frosini b1e9cfdc95 Catching the proper exception 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154624 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 14:55:56 +00:00
Luca Frosini f954b7ff03 Added guard to avoid to lose data in case of problems 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154623 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 14:55:39 +00:00
Luca Frosini d7deb6e907 Added 3 retry while elaborating row 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154566 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 13:33:39 +00:00
Luca Frosini 81ee077a94 Sincronized getInstance() method and fixed error message 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154565 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-26 13:32:32 +00:00
Luca Frosini 3d6c113185 fixed log 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154445 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-22 15:47:39 +00:00
Luca Frosini f4392280e3 fixed code 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154427 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-22 13:16:04 +00:00
Luca Frosini cfc1fb3980 Allowing elaborate only when last update is before last 8 hours. This avoid to start two recovery/elaboration while the previous is not terminated. 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154426 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-22 13:07:54 +00:00
Luca Frosini a7590738c1 Added possibility to specify range in aggregation and recovery. This allow to schedule multiple instance simultaneously 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154419 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-22 12:30:48 +00:00
Luca Frosini 6a9c463ac9 Updating LastUpdateTime before starting to execute any kind of operation when the AggregationStatus were already created on db 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154349 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-21 08:03:56 +00:00
Luca Frosini f531cd4e8c Fix to support old usage records 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@154348 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-21 07:53:53 +00:00
Luca Frosini 5c90b8b5b4 Fixed Enum 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153262 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-19 14:41:12 +00:00
Luca Frosini d4418c58a5 Improved log 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153218 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-19 08:10:08 +00:00
Luca Frosini f27a938456 Fixed log 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153206 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-18 16:44:34 +00:00
Luca Frosini a6d58dc724 Patch for old records 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153168 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-18 13:07:34 +00:00
Luca Frosini db2cb04b0f fixed log 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153110 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-15 09:20:13 +00:00
Luca Frosini 0d7235a52b Added malformed records management 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153109 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-15 09:08:52 +00:00
Luca Frosini 4466e2bbac Added malformed records management 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153108 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-15 08:40:03 +00:00
Luca Frosini 7c45f425dc Fixed bug 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153092 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-14 10:37:02 +00:00
Luca Frosini c31b08b5b4 Patch for old records 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153087 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-14 08:58:56 +00:00
Luca Frosini 5abbf6c4c3 Added patch to support old model which uses usageRecordType instead recortType field. 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153071 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-13 15:14:16 +00:00
Luca Frosini d0ce92e10a Added patch to support old model which uses usageRecordType instead recortType field. 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@153060 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-13 14:27:59 +00:00
Luca Frosini d3c44831b7 Merged from private branch. Refactored accounting-aggregator-plugin. Fixes #9419 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@152682 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-09-05 15:13:50 +00:00
Alessandro Pieve 1a019450f4 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@148567 82a268e6-3cf1-43bd-a215-b396298e98cf 2017-05-12 10:39:58 +00:00
Alessandro Pieve cdbdf8b800 Force compiler version with java 1.7 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@148565 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-05-12 10:37:19 +00:00
Alessandro Pieve 1ffe476977 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@148551 82a268e6-3cf1-43bd-a215-b396298e98cf 2017-05-12 09:56:53 +00:00
Alessandro Pieve 43290030ed Fix a problem with pathFile 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@148549 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-05-12 09:48:38 +00:00
Alessandro Pieve 42c2218ec6 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@148546 82a268e6-3cf1-43bd-a215-b396298e98cf 2017-05-12 09:16:49 +00:00
Alessandro Pieve ffd9d4a212 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@148448 82a268e6-3cf1-43bd-a215-b396298e98cf 2017-05-10 13:16:09 +00:00
Alessandro Pieve 2b16e5a527 Version 1.1.0 
add input endScriptTime 

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@148447 82a268e6-3cf1-43bd-a215-b396298e98cf
 2017-05-10 13:01:46 +00:00
Alessandro Pieve 00490b54ad git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@144319 82a268e6-3cf1-43bd-a215-b396298e98cf 2017-02-27 09:38:00 +00:00
Alessandro Pieve d3fcb61715 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@144203 82a268e6-3cf1-43bd-a215-b396298e98cf 2017-02-23 15:25:13 +00:00
Alessandro Pieve 63c4e12b57 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@144179 82a268e6-3cf1-43bd-a215-b396298e98cf 2017-02-23 10:41:08 +00:00
Alessandro Pieve 651a5b853c git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@144013 82a268e6-3cf1-43bd-a215-b396298e98cf 2017-02-21 13:17:41 +00:00
Alessandro Pieve 27c4848eeb git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-aggregator-se-plugin@141805 82a268e6-3cf1-43bd-a215-b396298e98cf 2017-01-26 08:31:00 +00:00