Commit Graph

105 Commits

Author SHA1 Message Date
Alessia Bardi b220b9de4e fixed tests so they do not fail 2020-06-05 15:10:17 +02:00
Enrico Ottonello 819ef88520 new workflow to import periodo from url 2020-06-01 12:29:48 +02:00
Enrico Ottonello 30b3fa2140 New JobNode and workflow to enrich content on GraphDB 2020-05-29 16:19:55 +02:00
Enrico Ottonello 996150a315 modified access protocol parameter name (mandatory for aat and periodo), it is the name of the root node, inside the metadata record, that is generated converting original json record 2020-04-03 11:58:04 +02:00
Enrico Ottonello 7d6aa5de5e aat json collector that works on a folder 2020-02-19 16:22:22 +01:00
Enrico Ottonello 226cdde77d all records related to an api are published into the same graph 2020-02-19 14:33:54 +01:00
Enrico Ottonello a6b5a80984 modified generated xml according to new mapping 2020-02-14 16:56:34 +01:00
Enrico Ottonello c5945c386b plugin to collect one json file 2020-02-14 13:00:09 +01:00
Alessia Bardi 66360e6d20 browse by Ariadne subject 2020-02-06 12:14:41 +01:00
Enrico Ottonello 17552bafa0 foreach published api, the datasource name is stored into graph datasourceApis 2020-01-24 10:52:04 +01:00
Enrico Ottonello d3b4e6c864 added ads apis 2020-01-24 10:37:00 +01:00
Enrico Ottonello 8530e488d0 all records related to a datasource api are now published on graphdb into n named graphs because of out of memory issue 2020-01-14 16:55:45 +01:00
Enrico Ottonello e748d3d802 added progress status data on publishToGraphDB workflow node ui 2019-12-18 15:55:53 +01:00
Enrico Ottonello 7980449ac0 CloseableHttpClient instance has to be closed after all post has been executed, same handling for PoolingHttpClientConnectionManager instance shutdown 2019-12-17 15:35:36 +01:00
Alessia Bardi 11e3992ab4 slow down the task producer to avoid OOM errors. See here for more: https://stackoverflow.com/questions/42108351/executorservice-giving-out-of-memory-error 2019-12-16 18:52:08 +01:00
Alessia Bardi c770fc40e0 cleaning up: let's remove the classes we do not need anymore, like Virtuoso-related classes and specific plugins that we have created for Parthenos 2019-12-16 18:34:08 +01:00
Enrico Ottonello 5087750f96 rdf handling move away from this node 2019-12-16 15:32:20 +01:00
Enrico Ottonello 98b452c59a new node to elastic search index 2019-12-16 15:25:55 +01:00
Enrico Ottonello 0f6f2e7b75 after records publishing the datasourceApi informations are saved on GraphDB 2019-12-13 14:55:51 +01:00
Enrico Ottonello 2f5fb6fcb5 new module for graphdb publishing 2019-12-12 12:58:30 +01:00
Alessia Bardi 69778c19c9 INFO logging 2019-11-15 11:11:31 +01:00
Alessia Bardi 2ed3a388ac cleaned up pom and testing Ariadne mapping via URL 2019-11-15 10:44:10 +01:00
Enrico Ottonello d78122c64d removed unused wf parameter 2019-10-31 15:18:46 +01:00
Enrico Ottonello b3a8f05c26 x3m mapping is now only taken from url; ads policy aligned to aggregator instance; removed wf parameter unused 2019-10-31 14:08:37 +01:00
Miriam Baglioni 1dab575b58 Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2019-10-23 16:15:13 +03:00
Miriam Baglioni eaa3992227 changed the schema for the date element. added year as possible provided date. Now date fields have type year || date_optional_time 2019-10-23 16:14:46 +03:00
Enrico Ottonello 45f5b9abba removed unused folder, removed unused parameters from ads repository profile, modified ads xpath identifier, modified default base url on ads access protocol 2019-10-22 15:51:09 +02:00
Enrico Ottonello e968c5faa5 mapping url downloaded from remote url set in workflow parameters 2019-10-22 13:45:17 +02:00
Enrico Ottonello 4047d32587 all files under Access Protocol > Base URL folder are collected together 2019-10-21 15:43:29 +02:00
Miriam Baglioni fc43b5a85d Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2019-10-18 17:54:48 +02:00
Miriam Baglioni c7289ad497 added new schema for elasticsearch 7 2019-10-18 17:52:44 +02:00
Enrico Ottonello d5a631a138 ads policy updated 2019-10-08 16:10:54 +02:00
Enrico Ottonello 9e54f9b3a6 renamed policy and mapping files for ads 2019-10-08 16:08:02 +02:00
Enrico Ottonello 1280702100 added mapping and policy for ads, added ads schema for solr, added ads datasource; removed not used profiles 2019-09-25 15:47:30 +02:00
Alessia Bardi 07759bdd6b no need to show errors and minimal metadata for now 2019-09-22 18:23:43 +02:00
Alessia Bardi 90b6a4c1f3 fixed content checker config 2019-09-22 17:39:36 +02:00
Alessia Bardi 0eae456ff8 fixed dependencies for solr772 2019-09-21 16:29:19 +02:00
Enrico Ottonello 329a636090 schema to ads indexing 2019-09-20 20:11:31 +02:00
Enrico Ottonello 75fb3752dc deleted publish/unpublish wf 2019-09-20 20:04:14 +02:00
Enrico Ottonello 1aa345559d added namespace 2019-09-20 20:03:45 +02:00
Enrico Ottonello b55e28d7ee changed version 2019-09-20 12:08:12 +02:00
Enrico Ottonello b5ed4396c6 added ads repository profile 2019-09-20 12:07:02 +02:00
Enrico Ottonello bd69676fde added vocabularies 2019-09-20 12:03:13 +02:00
Enrico Ottonello f9005a2e87 added mapping url parameter to workflow 2019-09-19 15:10:43 +02:00
Enrico Ottonello 05209e8393 added custom plugin to ads datasource 2019-09-19 15:09:44 +02:00
Enrico Ottonello c06c0cb7a1 updated version 2019-09-10 15:34:55 +02:00
Enrico Ottonello f7e972191c removed unused profiles and oai nodes from workflows 2019-09-10 14:35:23 +02:00
Enrico Ottonello 302d1cfb2b cleaned profiles on bootstrap folder 2019-09-10 11:51:47 +02:00
Enrico Ottonello 53717cf8b1 added idnamespace and mongo collecion name for oai 2019-09-06 16:19:23 +02:00
Enrico Ottonello 8c3045729c not correct for initial import 2019-09-06 16:17:36 +02:00
Enrico Ottonello 5c61aa5563 added email 2019-09-03 12:06:37 +02:00
Enrico Ottonello acc7a8d120 updated profiles 2019-07-12 18:43:11 +02:00
Enrico Ottonello 2b2a7d9cc8 updated profiles 2019-07-12 18:38:42 +02:00
Enrico Ottonello 8b3ec5f8e6 bootstrap resources refreshed 2019-07-12 18:12:49 +02:00
Enrico Ottonello a9f6a0f6eb added modules related to ariadneplus 2019-06-18 16:15:23 +02:00