Commit Graph

96 Commits

Author SHA1 Message Date
Enrico Ottonello 17552bafa0 foreach published api, the datasource name is stored into graph datasourceApis 2020-01-24 10:52:04 +01:00
Enrico Ottonello d3b4e6c864 added ads apis 2020-01-24 10:37:00 +01:00
Enrico Ottonello 8530e488d0 all records related to a datasource api are now published on graphdb into n named graphs because of out of memory issue 2020-01-14 16:55:45 +01:00
Enrico Ottonello e748d3d802 added progress status data on publishToGraphDB workflow node ui 2019-12-18 15:55:53 +01:00
Enrico Ottonello 7980449ac0 CloseableHttpClient instance has to be closed after all post has been executed, same handling for PoolingHttpClientConnectionManager instance shutdown 2019-12-17 15:35:36 +01:00
Alessia Bardi 11e3992ab4 slow down the task producer to avoid OOM errors. See here for more: https://stackoverflow.com/questions/42108351/executorservice-giving-out-of-memory-error 2019-12-16 18:52:08 +01:00
Alessia Bardi c770fc40e0 cleaning up: let's remove the classes we do not need anymore, like Virtuoso-related classes and specific plugins that we have created for Parthenos 2019-12-16 18:34:08 +01:00
Enrico Ottonello 5087750f96 rdf handling move away from this node 2019-12-16 15:32:20 +01:00
Enrico Ottonello 98b452c59a new node to elastic search index 2019-12-16 15:25:55 +01:00
Enrico Ottonello 0f6f2e7b75 after records publishing the datasourceApi informations are saved on GraphDB 2019-12-13 14:55:51 +01:00
Enrico Ottonello 2f5fb6fcb5 new module for graphdb publishing 2019-12-12 12:58:30 +01:00
Alessia Bardi 69778c19c9 INFO logging 2019-11-15 11:11:31 +01:00
Alessia Bardi 2ed3a388ac cleaned up pom and testing Ariadne mapping via URL 2019-11-15 10:44:10 +01:00
Enrico Ottonello d78122c64d removed unused wf parameter 2019-10-31 15:18:46 +01:00
Enrico Ottonello b3a8f05c26 x3m mapping is now only taken from url; ads policy aligned to aggregator instance; removed wf parameter unused 2019-10-31 14:08:37 +01:00
Miriam Baglioni 1dab575b58 Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2019-10-23 16:15:13 +03:00
Miriam Baglioni eaa3992227 changed the schema for the date element. added year as possible provided date. Now date fields have type year || date_optional_time 2019-10-23 16:14:46 +03:00
Enrico Ottonello 45f5b9abba removed unused folder, removed unused parameters from ads repository profile, modified ads xpath identifier, modified default base url on ads access protocol 2019-10-22 15:51:09 +02:00
Enrico Ottonello e968c5faa5 mapping url downloaded from remote url set in workflow parameters 2019-10-22 13:45:17 +02:00
Enrico Ottonello 4047d32587 all files under Access Protocol > Base URL folder are collected together 2019-10-21 15:43:29 +02:00
Miriam Baglioni fc43b5a85d Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2019-10-18 17:54:48 +02:00
Miriam Baglioni c7289ad497 added new schema for elasticsearch 7 2019-10-18 17:52:44 +02:00
Enrico Ottonello d5a631a138 ads policy updated 2019-10-08 16:10:54 +02:00
Enrico Ottonello 9e54f9b3a6 renamed policy and mapping files for ads 2019-10-08 16:08:02 +02:00
Enrico Ottonello 1280702100 added mapping and policy for ads, added ads schema for solr, added ads datasource; removed not used profiles 2019-09-25 15:47:30 +02:00
Alessia Bardi 07759bdd6b no need to show errors and minimal metadata for now 2019-09-22 18:23:43 +02:00
Alessia Bardi 90b6a4c1f3 fixed content checker config 2019-09-22 17:39:36 +02:00
Alessia Bardi 0eae456ff8 fixed dependencies for solr772 2019-09-21 16:29:19 +02:00
Enrico Ottonello 329a636090 schema to ads indexing 2019-09-20 20:11:31 +02:00
Enrico Ottonello 75fb3752dc deleted publish/unpublish wf 2019-09-20 20:04:14 +02:00
Enrico Ottonello 1aa345559d added namespace 2019-09-20 20:03:45 +02:00
Enrico Ottonello b55e28d7ee changed version 2019-09-20 12:08:12 +02:00
Enrico Ottonello b5ed4396c6 added ads repository profile 2019-09-20 12:07:02 +02:00
Enrico Ottonello bd69676fde added vocabularies 2019-09-20 12:03:13 +02:00
Enrico Ottonello f9005a2e87 added mapping url parameter to workflow 2019-09-19 15:10:43 +02:00
Enrico Ottonello 05209e8393 added custom plugin to ads datasource 2019-09-19 15:09:44 +02:00
Enrico Ottonello c06c0cb7a1 updated version 2019-09-10 15:34:55 +02:00
Enrico Ottonello f7e972191c removed unused profiles and oai nodes from workflows 2019-09-10 14:35:23 +02:00
Enrico Ottonello 302d1cfb2b cleaned profiles on bootstrap folder 2019-09-10 11:51:47 +02:00
Enrico Ottonello 53717cf8b1 added idnamespace and mongo collecion name for oai 2019-09-06 16:19:23 +02:00
Enrico Ottonello 8c3045729c not correct for initial import 2019-09-06 16:17:36 +02:00
Enrico Ottonello 5c61aa5563 added email 2019-09-03 12:06:37 +02:00
Enrico Ottonello acc7a8d120 updated profiles 2019-07-12 18:43:11 +02:00
Enrico Ottonello 2b2a7d9cc8 updated profiles 2019-07-12 18:38:42 +02:00
Enrico Ottonello 8b3ec5f8e6 bootstrap resources refreshed 2019-07-12 18:12:49 +02:00
Enrico Ottonello a9f6a0f6eb added modules related to ariadneplus 2019-06-18 16:15:23 +02:00