gCubeSystem
/
accounting-dashboard-harvester-se-plugin
16
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
236 Commits 2 Branches 16 Tags 415 KiB
Commit Graph

111 Commits

Author SHA1 Message Date
Massimiliano Assante 1ba2850a7c Fix for Bug #12454 BigG Analytics importer for accounting-dashboard wrong interpretation of ACE VRE accesses 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@171687 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-09-26 14:58:07 +00:00
Luca Frosini 99b12cfe07 Fixes #11760: Refactor accounting-dashboard-harvester-se-plugin to support new DB schema 
Task-Url: https://support.d4science.org/issues/11760

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@171294 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-09-04 09:13:16 +00:00
Luca Frosini 456f8b31b7 Added logs and fixed tests 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169689 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-07-05 16:25:05 +00:00
Luca Frosini 3ba8504488 Corrected comment typo 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169294 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-18 12:42:59 +00:00
Massimiliano Assante 6281106d7a fixed bug in counting page accesses 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169293 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-18 12:30:14 +00:00
Luca Frosini 0f5311cb91 Added test to harvest old data 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169227 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 16:17:22 +00:00
Luca Frosini 56d97e228b Added logic to exclude harvesting in some cases 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169213 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 14:22:19 +00:00
Luca Frosini 13c74dc4f9 Added logic to exclude harvesting in some cases 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169212 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 14:19:25 +00:00
Luca Frosini 248bb98b88 Integrated VREAccessesHarvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169205 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 13:30:46 +00:00
Massimiliano Assante adab0bea74 revised heuristic counting VRE accesses from page paths 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169200 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 13:15:08 +00:00
Luca Frosini 8335d11956 Added tests 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169193 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 12:50:42 +00:00
Massimiliano Assante 412e1e9264 modified condtion to match vre accesses better 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169192 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 12:35:55 +00:00
Luca Frosini 6d0c7ec0f4 Integrated VREAccessesHarvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169191 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 12:34:11 +00:00
Massimiliano Assante af5e7cb8c8 added VRE Access Harvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169190 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 10:46:50 +00:00
Luca Frosini 3d53d85865 Added logic to harvesting methods invocation by using Service Usage Records before 31/12/2017 and using JobUSageRecords from 01/01/2018 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169181 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-13 17:40:02 +00:00
Luca Frosini f27b583949 Added logic to avoid harvesting of VRE users for VO and logic to harvest VRE Accesses 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169180 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-13 17:39:01 +00:00
Luca Frosini 3630de9582 Added thread local variable 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169136 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-13 12:43:36 +00:00
Luca Frosini f0f981d197 Fixed launch 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167870 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-04 14:35:32 +00:00
Luca Frosini 3a69d5e50c Added auto creation of contexts 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167822 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-29 11:05:55 +00:00
Luca Frosini 618f18e331 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167820 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-29 09:08:24 +00:00
Luca Frosini 67ae816424 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167798 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 14:53:00 +00:00
Luca Frosini b4aa929d55 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167795 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 14:33:57 +00:00
Luca Frosini b91e31853c git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167794 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-28 14:22:44 +00:00
Luca Frosini 6e3ca2befe Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167792 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 13:34:19 +00:00
Luca Frosini 9f40118fa7 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167791 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 13:22:59 +00:00
Luca Frosini 3c6b05d00b Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167788 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 10:00:15 +00:00
Francesco Mangiacrapa 19e396d374 Ultimated fixing by Francesco 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167722 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-24 15:13:16 +00:00
Francesco Mangiacrapa cb8e1a62a5 Fixed DataMethodDownloadHarvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167721 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-24 15:10:45 +00:00
Francesco Mangiacrapa 09a8f2d2dc Updated by Francesco: 
- new Resource Catalogue Harvester created.

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167720 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-24 10:49:53 +00:00
Luca Frosini 1971f14809 Changed Method invocations from using ServiceUsageRecord to JobUsageRecords 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167658 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 16:22:17 +00:00
Luca Frosini dd9f5b8553 Changed Method invocations from using ServiceUsageRecord to JobUsageRecords 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167657 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 16:22:08 +00:00
Luca Frosini 72f29300c9 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167646 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 14:23:14 +00:00
Luca Frosini 559251fe2f Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167645 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 13:56:52 +00:00
Luca Frosini b15ba30b1d Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167644 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 13:52:19 +00:00
Luca Frosini 95284de142 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167643 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 13:37:57 +00:00
Luca Frosini 9aea29c6e1 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167642 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 12:49:01 +00:00
Luca Frosini 0de8fd20a6 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167641 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 12:15:09 +00:00
Luca Frosini 302d29a607 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167640 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 12:06:27 +00:00
Luca Frosini 5a84a04fbd git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167639 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 12:05:15 +00:00
Luca Frosini 1ef7cee987 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167636 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 10:51:17 +00:00
Luca Frosini 8edab20ef0 Getting Social Networking Service URL from IS 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167635 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 10:18:06 +00:00
Luca Frosini 085ab9e9c2 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167632 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-18 17:12:46 +00:00
Luca Frosini 0bf82648db Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167631 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 16:33:28 +00:00
Luca Frosini e2a7c69e27 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167629 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-18 16:24:53 +00:00
Luca Frosini 17d9cd9097 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167623 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 15:40:32 +00:00
Luca Frosini 40527e0fe6 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167622 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 15:39:47 +00:00
Luca Frosini 18534677ff git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167606 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-18 14:36:05 +00:00
Luca Frosini 97b1b48d46 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167603 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-18 14:26:33 +00:00
Luca Frosini 5de25d5a2b Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167601 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 14:16:05 +00:00
Luca Frosini 3c4c1a6b93 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167600 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 14:13:10 +00:00
Luca Frosini bad93fa5f7 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167599 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 14:05:11 +00:00
Luca Frosini d5cdc30748 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167598 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 12:24:27 +00:00
Luca Frosini 2cb0d8b15f Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167597 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 12:23:57 +00:00
Luca Frosini 9db4794c16 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167596 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 12:17:54 +00:00
Luca Frosini a91ece8a0f git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167586 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-18 10:00:35 +00:00
Luca Frosini 0f3b397fbd Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167585 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-18 10:00:10 +00:00
Luca Frosini 8d64022afa Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167568 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-17 15:21:08 +00:00
Luca Frosini 9dec451f4c Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167567 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-17 14:04:22 +00:00
Luca Frosini 1430fb676f Added token generations by iterating contexts read dinamically 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167556 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-17 10:52:17 +00:00
Luca Frosini 1753289cd5 Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 
Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167516 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-16 13:08:25 +00:00
Luca Frosini b69f952ce6 Refactor DataHArvesterPlugin to support scheduled execution from smart-executor refs #11756 
https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167434 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-11 15:50:37 +00:00