Commit Graph

164 Commits

Author SHA1 Message Date
Alessia Bardi 66360e6d20 browse by Ariadne subject 2020-02-06 12:14:41 +01:00
Enrico Ottonello ff357e728b modified context properties name because of update to springboot 2.1.3 2020-01-29 16:43:25 +01:00
Enrico Ottonello 019bbd2f6a new classes to graphdb querying via sparql exewcution, data retrieving, feeding to elastic search 2020-01-28 16:53:59 +01:00
Enrico Ottonello edf2ff563b removing log files 2020-01-24 11:04:47 +01:00
Enrico Ottonello 17552bafa0 foreach published api, the datasource name is stored into graph datasourceApis 2020-01-24 10:52:04 +01:00
Enrico Ottonello d3b4e6c864 added ads apis 2020-01-24 10:37:00 +01:00
Enrico Ottonello 15cc87456c before any api publishing all named graph related to previous aggregation for that api are dropped 2020-01-15 12:30:18 +01:00
Enrico Ottonello 8530e488d0 all records related to a datasource api are now published on graphdb into n named graphs because of out of memory issue 2020-01-14 16:55:45 +01:00
Enrico Ottonello e748d3d802 added progress status data on publishToGraphDB workflow node ui 2019-12-18 15:55:53 +01:00
Enrico Ottonello 813c8dcacf eu.dnetlib and x3m transform log level reset to INFO 2019-12-17 15:51:02 +01:00
Enrico Ottonello 7980449ac0 CloseableHttpClient instance has to be closed after all post has been executed, same handling for PoolingHttpClientConnectionManager instance shutdown 2019-12-17 15:35:36 +01:00
Alessia Bardi 11e3992ab4 slow down the task producer to avoid OOM errors. See here for more: https://stackoverflow.com/questions/42108351/executorservice-giving-out-of-memory-error 2019-12-16 18:52:08 +01:00
Alessia Bardi c770fc40e0 cleaning up: let's remove the classes we do not need anymore, like Virtuoso-related classes and specific plugins that we have created for Parthenos 2019-12-16 18:34:08 +01:00
Enrico Ottonello 5087750f96 rdf handling move away from this node 2019-12-16 15:32:20 +01:00
Enrico Ottonello 98b452c59a new node to elastic search index 2019-12-16 15:25:55 +01:00
Enrico Ottonello b3d8a9193b moved graphdb repository name and other properties in application.properties 2019-12-16 14:46:42 +01:00
Enrico Ottonello 0f6f2e7b75 after records publishing the datasourceApi informations are saved on GraphDB 2019-12-13 14:55:51 +01:00
Enrico Ottonello 3f8a4e9a46 new rest method to save datasourceApi information after records publishing on graphDB 2019-12-13 14:53:15 +01:00
Enrico Ottonello 2f5fb6fcb5 new module for graphdb publishing 2019-12-12 12:58:30 +01:00
Enrico Ottonello a50520525f unused module 2019-12-09 13:21:19 +01:00
Alessia Bardi 69778c19c9 INFO logging 2019-11-15 11:11:31 +01:00
Alessia Bardi 2ed3a388ac cleaned up pom and testing Ariadne mapping via URL 2019-11-15 10:44:10 +01:00
Enrico Ottonello d78122c64d removed unused wf parameter 2019-10-31 15:18:46 +01:00
Enrico Ottonello b3a8f05c26 x3m mapping is now only taken from url; ads policy aligned to aggregator instance; removed wf parameter unused 2019-10-31 14:08:37 +01:00
Miriam Baglioni 1dab575b58 Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2019-10-23 16:15:13 +03:00
Miriam Baglioni eaa3992227 changed the schema for the date element. added year as possible provided date. Now date fields have type year || date_optional_time 2019-10-23 16:14:46 +03:00
Enrico Ottonello 45f5b9abba removed unused folder, removed unused parameters from ads repository profile, modified ads xpath identifier, modified default base url on ads access protocol 2019-10-22 15:51:09 +02:00
Enrico Ottonello e968c5faa5 mapping url downloaded from remote url set in workflow parameters 2019-10-22 13:45:17 +02:00
Enrico Ottonello 4047d32587 all files under Access Protocol > Base URL folder are collected together 2019-10-21 15:43:29 +02:00
Miriam Baglioni fc43b5a85d Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2019-10-18 17:54:48 +02:00
Miriam Baglioni c7289ad497 added new schema for elasticsearch 7 2019-10-18 17:52:44 +02:00
Enrico Ottonello d5a631a138 ads policy updated 2019-10-08 16:10:54 +02:00
Enrico Ottonello 9e54f9b3a6 renamed policy and mapping files for ads 2019-10-08 16:08:02 +02:00
Enrico Ottonello 658b2880ff modified version of dnet-data-provision-services used 2019-09-26 16:44:14 +02:00
Enrico Ottonello 1280702100 added mapping and policy for ads, added ads schema for solr, added ads datasource; removed not used profiles 2019-09-25 15:47:30 +02:00
Alessia Bardi 07759bdd6b no need to show errors and minimal metadata for now 2019-09-22 18:23:43 +02:00
Alessia Bardi 90b6a4c1f3 fixed content checker config 2019-09-22 17:39:36 +02:00
Alessia Bardi d7a8e8ca9c closed dep range and using /tmp folder 2019-09-22 17:12:58 +02:00
Alessia Bardi 52ba86ad0e fixed dependencies for solr772 2019-09-21 16:33:26 +02:00
Alessia Bardi 0eae456ff8 fixed dependencies for solr772 2019-09-21 16:29:19 +02:00
Enrico Ottonello 329a636090 schema to ads indexing 2019-09-20 20:11:31 +02:00
Enrico Ottonello 75fb3752dc deleted publish/unpublish wf 2019-09-20 20:04:14 +02:00
Enrico Ottonello 1aa345559d added namespace 2019-09-20 20:03:45 +02:00
Enrico Ottonello b55e28d7ee changed version 2019-09-20 12:08:12 +02:00
Enrico Ottonello b5ed4396c6 added ads repository profile 2019-09-20 12:07:02 +02:00
Enrico Ottonello bd69676fde added vocabularies 2019-09-20 12:03:13 +02:00
Enrico Ottonello f9005a2e87 added mapping url parameter to workflow 2019-09-19 15:10:43 +02:00
Enrico Ottonello 05209e8393 added custom plugin to ads datasource 2019-09-19 15:09:44 +02:00
Enrico Ottonello c06c0cb7a1 updated version 2019-09-10 15:34:55 +02:00
Enrico Ottonello f7e972191c removed unused profiles and oai nodes from workflows 2019-09-10 14:35:23 +02:00