Commit Graph

70 Commits

Author SHA1 Message Date
Luca Frosini 0f5311cb91 Added test to harvest old data
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169227 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 16:17:22 +00:00
Luca Frosini 56d97e228b Added logic to exclude harvesting in some cases
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169213 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 14:22:19 +00:00
Luca Frosini 13c74dc4f9 Added logic to exclude harvesting in some cases
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169212 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 14:19:25 +00:00
Luca Frosini 248bb98b88 Integrated VREAccessesHarvester
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169205 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 13:30:46 +00:00
Luca Frosini 4b4009d99b Integrated VREAccessesHarvester
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169204 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 13:30:07 +00:00
Massimiliano Assante adab0bea74 revised heuristic counting VRE accesses from page paths
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169200 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 13:15:08 +00:00
Luca Frosini 8335d11956 Added tests
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169193 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 12:50:42 +00:00
Massimiliano Assante 412e1e9264 modified condtion to match vre accesses better
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169192 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 12:35:55 +00:00
Luca Frosini 6d0c7ec0f4 Integrated VREAccessesHarvester
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169191 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 12:34:11 +00:00
Massimiliano Assante af5e7cb8c8 added VRE Access Harvester
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169190 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-14 10:46:50 +00:00
Massimiliano Assante 077d0515e5 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169189 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-06-14 10:46:33 +00:00
Luca Frosini 3d53d85865 Added logic to harvesting methods invocation by using Service Usage Records before 31/12/2017 and using JobUSageRecords from 01/01/2018
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169181 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-13 17:40:02 +00:00
Luca Frosini f27b583949 Added logic to avoid harvesting of VRE users for VO and logic to harvest VRE Accesses
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169180 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-13 17:39:01 +00:00
Luca Frosini 3630de9582 Added thread local variable
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@169136 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-13 12:43:36 +00:00
Luca Frosini f0f981d197 Fixed launch
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167870 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-06-04 14:35:32 +00:00
Luca Frosini 3a69d5e50c Added auto creation of contexts
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167822 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-29 11:05:55 +00:00
Luca Frosini 618f18e331 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167820 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-29 09:08:24 +00:00
Luca Frosini 67ae816424 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167798 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-28 14:53:00 +00:00
Luca Frosini 0d0aaf1b21 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167797 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-28 14:39:13 +00:00
Luca Frosini 5c4d6f5bae Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167796 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-28 14:34:19 +00:00
Luca Frosini b4aa929d55 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167795 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-28 14:33:57 +00:00
Luca Frosini b91e31853c git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167794 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-28 14:22:44 +00:00
Luca Frosini b5ac35f453 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167793 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-28 14:03:31 +00:00
Luca Frosini 6e3ca2befe Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167792 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-28 13:34:19 +00:00
Luca Frosini 9f40118fa7 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167791 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-28 13:22:59 +00:00
Luca Frosini 3c6b05d00b Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167788 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-28 10:00:15 +00:00
Francesco Mangiacrapa 19e396d374 Ultimated fixing by Francesco
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167722 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-24 15:13:16 +00:00
Francesco Mangiacrapa cb8e1a62a5 Fixed DataMethodDownloadHarvester
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167721 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-24 15:10:45 +00:00
Francesco Mangiacrapa 09a8f2d2dc Updated by Francesco:
- new Resource Catalogue Harvester created.

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167720 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-24 10:49:53 +00:00
Luca Frosini deb7890ea1 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167660 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-22 10:05:30 +00:00
Luca Frosini 1971f14809 Changed Method invocations from using ServiceUsageRecord to JobUsageRecords
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167658 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 16:22:17 +00:00
Luca Frosini dd9f5b8553 Changed Method invocations from using ServiceUsageRecord to JobUsageRecords
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167657 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 16:22:08 +00:00
Luca Frosini 72f29300c9 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167646 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 14:23:14 +00:00
Luca Frosini 559251fe2f Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167645 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 13:56:52 +00:00
Luca Frosini b15ba30b1d Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167644 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 13:52:19 +00:00
Luca Frosini 95284de142 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167643 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 13:37:57 +00:00
Luca Frosini 9aea29c6e1 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167642 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 12:49:01 +00:00
Luca Frosini 0de8fd20a6 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167641 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 12:15:09 +00:00
Luca Frosini 302d29a607 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167640 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 12:06:27 +00:00
Luca Frosini 5a84a04fbd git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167639 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-21 12:05:15 +00:00
Luca Frosini 4dfd0b9c2a Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167638 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 10:53:30 +00:00
Luca Frosini 8db98c92cd Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167637 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 10:52:52 +00:00
Luca Frosini 1ef7cee987 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167636 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 10:51:17 +00:00
Luca Frosini 8edab20ef0 Getting Social Networking Service URL from IS
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167635 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-21 10:18:06 +00:00
Luca Frosini 085ab9e9c2 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167632 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-18 17:12:46 +00:00
Luca Frosini 0bf82648db Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167631 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-18 16:33:28 +00:00
Luca Frosini e2a7c69e27 git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167629 82a268e6-3cf1-43bd-a215-b396298e98cf 2018-05-18 16:24:53 +00:00
Luca Frosini 17d9cd9097 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167623 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-18 15:40:32 +00:00
Luca Frosini 40527e0fe6 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167622 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-18 15:39:47 +00:00
Luca Frosini 9a7434ad54 Code redesign
Refs #11756: Refactor DataHArvesterPlugin to support scheduled execution from smart-executor 

Task-Url: https://support.d4science.org/issues/11756

git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/accounting/accounting-dashboard-harvester-se-plugin@167614 82a268e6-3cf1-43bd-a215-b396298e98cf
2018-05-18 15:10:48 +00:00