gCubeSystem
/
accounting-dashboard-harvester-se-plugin
16
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
182 Commits 2 Branches 14 Tags 414 KiB
Commit Graph

182 Commits

Author SHA1 Message Date
Luca Frosini 7bcad47ab7 Added distro dirtectory and fixed pom.xml 
Refs #11760: Refactor accounting-dashboard-harvester-se-plugin to support new DB schema 

Task-Url: https://support.d4science.org/issues/11760

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@171301 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-09-04 09:32:04 +00:00
Luca Frosini b5ddcd24b9 Added distro dirtectory and fixed pom.xml 
Refs #11760: Refactor accounting-dashboard-harvester-se-plugin to support new DB schema 

Task-Url: https://support.d4science.org/issues/11760

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@171300 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-09-04 09:30:47 +00:00
Luca Frosini 6cba9d5b22 Fixed pom to create uber-jar 
Refs #11760: Refactor accounting-dashboard-harvester-se-plugin to support new DB schema 

Task-Url: https://support.d4science.org/issues/11760

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@171299 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-09-04 09:24:24 +00:00
Luca Frosini 03aa4b0c42 Commented tests 
Refs #11760: Refactor accounting-dashboard-harvester-se-plugin to support new DB schema 

Task-Url: https://support.d4science.org/issues/11760

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@171296 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-09-04 09:20:11 +00:00
Luca Frosini 95bf87332f Commented test 
Refs #11760: Refactor accounting-dashboard-harvester-se-plugin to support new DB schema 

Task-Url: https://support.d4science.org/issues/11760

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@171295 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-09-04 09:14:40 +00:00
Luca Frosini 99b12cfe07 Fixes #11760: Refactor accounting-dashboard-harvester-se-plugin to support new DB schema 
Task-Url: https://support.d4science.org/issues/11760

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@171294 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-09-04 09:13:16 +00:00
Luca Frosini 456f8b31b7 Added logs and fixed tests 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169689 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-07-05 16:25:05 +00:00
Luca Frosini c6e7ad3077 Fixed test to harvest old data for VREAccessesHarvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169298 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-18 13:44:10 +00:00
Luca Frosini 87849c04b8 Added test to harvest old data for VREAccessesHarvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169295 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-18 13:15:12 +00:00
Luca Frosini 3ba8504488 Corrected comment typo 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169294 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-18 12:42:59 +00:00
Massimiliano Assante 6281106d7a fixed bug in counting page accesses 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169293 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-18 12:30:14 +00:00
Luca Frosini 85ea36fb00 commented tests to avoid unwanted launch 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169228 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 16:19:10 +00:00
Luca Frosini 0f5311cb91 Added test to harvest old data 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169227 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 16:17:22 +00:00
Luca Frosini 56d97e228b Added logic to exclude harvesting in some cases 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169213 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 14:22:19 +00:00
Luca Frosini 13c74dc4f9 Added logic to exclude harvesting in some cases 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169212 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 14:19:25 +00:00
Luca Frosini 248bb98b88 Integrated VREAccessesHarvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169205 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 13:30:46 +00:00
Luca Frosini 4b4009d99b Integrated VREAccessesHarvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169204 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 13:30:07 +00:00
Massimiliano Assante adab0bea74 revised heuristic counting VRE accesses from page paths 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169200 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 13:15:08 +00:00
Luca Frosini 8335d11956 Added tests 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169193 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 12:50:42 +00:00
Massimiliano Assante 412e1e9264 modified condtion to match vre accesses better 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169192 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 12:35:55 +00:00
Luca Frosini 6d0c7ec0f4 Integrated VREAccessesHarvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169191 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 12:34:11 +00:00
Massimiliano Assante af5e7cb8c8 added VRE Access Harvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169190 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-14 10:46:50 +00:00
Massimiliano Assante 077d0515e5 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169189 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-06-14 10:46:33 +00:00
Luca Frosini 3d53d85865 Added logic to harvesting methods invocation by using Service Usage Records before 31/12/2017 and using JobUSageRecords from 01/01/2018 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169181 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-13 17:40:02 +00:00
Luca Frosini f27b583949 Added logic to avoid harvesting of VRE users for VO and logic to harvest VRE Accesses 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169180 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-13 17:39:01 +00:00
Luca Frosini 3630de9582 Added thread local variable 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169136 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-13 12:43:36 +00:00
Luca Frosini f0f981d197 Fixed launch 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167870 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-06-04 14:35:32 +00:00
Luca Frosini 3a69d5e50c Added auto creation of contexts 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167822 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-29 11:05:55 +00:00
Luca Frosini 618f18e331 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167820 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-29 09:08:24 +00:00
Luca Frosini 67ae816424 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167798 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 14:53:00 +00:00
Luca Frosini 0d0aaf1b21 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167797 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 14:39:13 +00:00
Luca Frosini 5c4d6f5bae Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167796 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 14:34:19 +00:00
Luca Frosini b4aa929d55 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167795 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 14:33:57 +00:00
Luca Frosini b91e31853c git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167794 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-28 14:22:44 +00:00
Luca Frosini b5ac35f453 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167793 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-28 14:03:31 +00:00
Luca Frosini 6e3ca2befe Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167792 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 13:34:19 +00:00
Luca Frosini 9f40118fa7 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167791 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 13:22:59 +00:00
Luca Frosini 3c6b05d00b Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167788 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-28 10:00:15 +00:00
Francesco Mangiacrapa 19e396d374 Ultimated fixing by Francesco 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167722 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-24 15:13:16 +00:00
Francesco Mangiacrapa cb8e1a62a5 Fixed DataMethodDownloadHarvester 
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167721 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-24 15:10:45 +00:00
Francesco Mangiacrapa 09a8f2d2dc Updated by Francesco: 
- new Resource Catalogue Harvester created.

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167720 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-24 10:49:53 +00:00
Luca Frosini deb7890ea1 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167660 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-22 10:05:30 +00:00
Luca Frosini 1971f14809 Changed Method invocations from using ServiceUsageRecord to JobUsageRecords 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167658 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 16:22:17 +00:00
Luca Frosini dd9f5b8553 Changed Method invocations from using ServiceUsageRecord to JobUsageRecords 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167657 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 16:22:08 +00:00
Luca Frosini 72f29300c9 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167646 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 14:23:14 +00:00
Luca Frosini 559251fe2f Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167645 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 13:56:52 +00:00
Luca Frosini b15ba30b1d Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167644 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 13:52:19 +00:00
Luca Frosini 95284de142 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167643 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 13:37:57 +00:00
Luca Frosini 9aea29c6e1 Code redesign 
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167642 82a268e6-3cf1-43bd-a215-b396298e98cf
 2018-05-21 12:49:01 +00:00
Luca Frosini 0de8fd20a6 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167641 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 12:15:09 +00:00