Commit Graph

98 Commits

Author SHA1 Message Date
Enrico Ottonello af2eb7bb91 added sparql query folder 2020-06-09 11:44:48 +02:00
Enrico Ottonello aa1c6c2fda added query to generate aat and periodo enriched graphs 2020-06-09 11:39:56 +02:00
Alessia Bardi 4d68ecad58 the job fails if the endpoint returns client errors 4xx 2020-06-05 16:19:54 +02:00
Alessia Bardi 30410e8cca need to enclose policy in CDATA, otherwise we get an error from the X3ML engine 'only whitespace content allowed before start tag and not C' 2020-06-05 16:02:31 +02:00
Alessia Bardi fa3707a56f updated policy 2020-06-05 15:47:25 +02:00
Alessia Bardi e5cfbd01af ADS plugin now able to process one single remote file 2020-06-05 15:20:21 +02:00
Alessia Bardi b220b9de4e fixed tests so they do not fail 2020-06-05 15:10:17 +02:00
Enrico Ottonello 819ef88520 new workflow to import periodo from url 2020-06-01 12:29:48 +02:00
Enrico Ottonello 9814069fb2 new rest method to import data into graphDB from url 2020-05-30 17:21:03 +02:00
Enrico Ottonello 30b3fa2140 New JobNode and workflow to enrich content on GraphDB 2020-05-29 16:19:55 +02:00
Enrico Ottonello 739dcc6b82 added rest method to execute sparql insert query on graphdb 2020-05-27 23:07:08 +02:00
Enrico Ottonello d23f08f750 removed BIND not necessary 2020-04-03 15:53:52 +02:00
Enrico Ottonello 996150a315 modified access protocol parameter name (mandatory for aat and periodo), it is the name of the root node, inside the metadata record, that is generated converting original json record 2020-04-03 11:58:04 +02:00
Enrico Ottonello a005328dfe fix resource type variable name 2020-03-31 11:10:41 +02:00
Enrico Ottonello d52ad32f68 added narrow and broad for aat match 2020-03-20 17:46:55 +01:00
Enrico Ottonello 7ae6d400b6 temporal coverage joined with periodO data that must be directly imported in graphDb in turtle format together with periodO mapping 2020-03-20 13:01:54 +01:00
Enrico Ottonello ef42eb551a fix spatial subselect: region, region point and region bounding box data must be referenced by 3 different variables inside the query 2020-03-17 16:27:14 +01:00
Enrico Ottonello 32b91c277d all not madatory sets of conditions must be set as optional 2020-03-16 19:16:42 +01:00
Enrico Ottonello 5c3d50f309 originalId set to mandatory 2020-03-06 13:11:35 +01:00
Enrico Ottonello 2b85674659 modified prefix mine: <http://www.myprefix/> into aoprop: <https://www.ariadne-infrastructure.eu/property/> 2020-03-06 12:22:51 +01:00
Enrico Ottonello 3e230e98be added bounding box info, modified output predicates 2020-03-05 16:24:22 +01:00
Enrico Ottonello a8aa5ec6ed added legalResponsible, owner 2020-03-04 13:27:31 +01:00
Enrico Ottonello 7bd85b6946 retrieved contributor on collection sub-select 2020-03-03 16:57:07 +01:00
Enrico Ottonello 7d65ba2a0c matching with aat and fix spatial coverage 2020-02-27 17:19:12 +01:00
Enrico Ottonello 7f93ce6358 from named condition modified to from because of wrong triples in results 2020-02-25 16:16:06 +01:00
Enrico Ottonello 7d6aa5de5e aat json collector that works on a folder 2020-02-19 16:22:22 +01:00
Enrico Ottonello bf862f20f2 fix wrong matches on native subjects 2020-02-19 16:13:07 +01:00
Enrico Ottonello 226cdde77d all records related to an api are published into the same graph 2020-02-19 14:33:54 +01:00
Enrico Ottonello f12eb7eb52 added aat collection clause 2020-02-18 16:05:51 +01:00
Enrico Ottonello a6b5a80984 modified generated xml according to new mapping 2020-02-14 16:56:34 +01:00
Enrico Ottonello c5945c386b plugin to collect one json file 2020-02-14 13:00:09 +01:00
Enrico Ottonello ae91617d1b added optional surrounding union conditions, in case all those conditions do not match any statements 2020-02-11 12:04:45 +01:00
Enrico Ottonello 911ea12ac3 query with union 2020-02-07 15:31:47 +01:00
Enrico Ottonello 5d8cbece81 graphdb query 2020-02-07 14:44:26 +01:00
Alessia Bardi 66360e6d20 browse by Ariadne subject 2020-02-06 12:14:41 +01:00
Enrico Ottonello ff357e728b modified context properties name because of update to springboot 2.1.3 2020-01-29 16:43:25 +01:00
Enrico Ottonello 019bbd2f6a new classes to graphdb querying via sparql exewcution, data retrieving, feeding to elastic search 2020-01-28 16:53:59 +01:00
Enrico Ottonello edf2ff563b removing log files 2020-01-24 11:04:47 +01:00
Enrico Ottonello 17552bafa0 foreach published api, the datasource name is stored into graph datasourceApis 2020-01-24 10:52:04 +01:00
Enrico Ottonello d3b4e6c864 added ads apis 2020-01-24 10:37:00 +01:00
Enrico Ottonello 15cc87456c before any api publishing all named graph related to previous aggregation for that api are dropped 2020-01-15 12:30:18 +01:00
Enrico Ottonello 8530e488d0 all records related to a datasource api are now published on graphdb into n named graphs because of out of memory issue 2020-01-14 16:55:45 +01:00
Enrico Ottonello e748d3d802 added progress status data on publishToGraphDB workflow node ui 2019-12-18 15:55:53 +01:00
Enrico Ottonello 813c8dcacf eu.dnetlib and x3m transform log level reset to INFO 2019-12-17 15:51:02 +01:00
Enrico Ottonello 7980449ac0 CloseableHttpClient instance has to be closed after all post has been executed, same handling for PoolingHttpClientConnectionManager instance shutdown 2019-12-17 15:35:36 +01:00
Alessia Bardi 11e3992ab4 slow down the task producer to avoid OOM errors. See here for more: https://stackoverflow.com/questions/42108351/executorservice-giving-out-of-memory-error 2019-12-16 18:52:08 +01:00
Alessia Bardi c770fc40e0 cleaning up: let's remove the classes we do not need anymore, like Virtuoso-related classes and specific plugins that we have created for Parthenos 2019-12-16 18:34:08 +01:00
Enrico Ottonello 5087750f96 rdf handling move away from this node 2019-12-16 15:32:20 +01:00
Enrico Ottonello 98b452c59a new node to elastic search index 2019-12-16 15:25:55 +01:00
Enrico Ottonello b3d8a9193b moved graphdb repository name and other properties in application.properties 2019-12-16 14:46:42 +01:00