Commit Graph

349 Commits

Author SHA1 Message Date
Enrico Ottonello 0bee268468 merging placename data with geopoint data and duplicate removing also for collection (MIBAC case) 2022-06-21 11:58:56 +02:00
Enrico Ottonello b7ed14928d Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2022-06-20 15:21:29 +02:00
Enrico Ottonello 544b45a21c enrichment for hes 2022-06-20 15:21:25 +02:00
Alessia Bardi 600f80317c enrichment queries for THANADOS 2022-06-16 20:08:10 +02:00
Alessia Bardi b55c9f352f enrichment queries for CNRS Humanum 2022-06-16 20:07:45 +02:00
Enrico Ottonello d0f763f33e test for ads 1 2022-06-16 11:12:15 +02:00
Enrico Ottonello ae13edb870 added aat mappings to bm pas 2022-06-14 13:02:01 +02:00
Enrico Ottonello 2c34545405 enrichment for inp ran 2022-05-20 09:54:14 +02:00
Enrico Ottonello 9ca687828b enrichment for inrap full 2022-05-18 09:37:09 +02:00
Alessia Bardi 30e0b930ea SPARQL enrich query for non-test THANADOS 2022-05-10 15:33:10 +02:00
Enrico Ottonello ca95568062 fixed periodO URI 2022-05-06 11:58:25 +02:00
Enrico Ottonello 10df6d7c83 Merge branch 'master' into thanados 2022-05-06 11:03:51 +02:00
Enrico Ottonello ab1b52a3c5 temporal from/until taken from native data for bmpas 2022-05-06 10:13:42 +02:00
Alessia Bardi c90d30bfa8 Merge branch 'master' into thanados 2022-05-05 16:18:44 +02:00
Enrico Ottonello 455e4b0f8a enrichment for British Museum 2022-05-04 12:17:09 +02:00
Alessia Bardi 6a1b6767b9 Allow collections in collections 2022-04-15 12:05:20 +02:00
Alessia Bardi f1d3e5a022 enrichment queries: test for THANADOS' 2022-04-15 12:01:50 +02:00
Enrico Ottonello 17b80c59c3 old collection cenieh 171, no more used 2022-03-29 12:55:46 +02:00
Enrico Ottonello ef1de72687 enrichment for iavp farms 2022-03-29 12:16:13 +02:00
Enrico Ottonello 9851afe6e0 added sites and sediments collections for cenieh 2022-03-24 14:55:26 +01:00
Enrico Ottonello 12114f5f1d enrichment for mibac 2022-03-11 14:39:29 +01:00
Enrico Ottonello 14e7228068 removed email from the class that binds responsible, contributor, owner and creator data, added new class that binds publisher data with email; updated properties and queries according to the new model 2022-03-09 16:57:31 +01:00
Enrico Ottonello e74e5713a6 added spatial_coverage and creator missing into a few inrap records 2022-02-21 13:41:49 +01:00
Enrico Ottonello 93d9870e9d removing unused queries for inrap 2022-02-18 15:01:33 +01:00
Enrico Ottonello d12d88667d fix added property retrieving temporal label 2022-02-18 15:00:32 +01:00
Enrico Ottonello a1c1100790 added NARA periodO matching from different rdf property 2022-02-17 15:47:24 +01:00
Enrico Ottonello 286321b118 added homepage also for responsible 2022-02-15 18:22:24 +01:00
Enrico Ottonello ce33e07337 added primary image url to enable visualization; records inherit agent urls from collection 2022-02-15 11:49:27 +01:00
Enrico Ottonello 145f0e5a1c enrichment for testing INP 2022-02-15 09:37:47 +01:00
Enrico Ottonello a2ab5d7478 enrichment for LNEC 2022-02-11 15:07:54 +01:00
Enrico Ottonello c11ed1bd3f enrichment for cyi 2022-02-10 11:08:57 +01:00
Enrico Ottonello 8ba227e685 added periodO matching for nara also from time:year rdf property 2022-02-10 11:07:59 +01:00
Enrico Ottonello 8469482e83 enrichment for dolia all data 2022-02-07 10:56:34 +01:00
Enrico Ottonello ab28d393b5 final enrichment for conicet 2022-02-03 15:34:23 +01:00
Enrico Ottonello 4b94935f17 added rdfs:label to native period for collection query; fix iavp enrichment; added date formatter for es publishing 2022-02-01 14:19:13 +01:00
Enrico Ottonello 4abe06904b added aat matching - NARA patched to NABUNKEN on aat subject 2022-01-31 16:24:46 +01:00
Enrico Ottonello b2a54f4204 added periodo matching 2022-01-26 19:46:01 +01:00
Enrico Ottonello 5823916782 iavp enrichment 2021-12-20 17:40:14 +01:00
Enrico Ottonello e3c2451e5a fix cenieh periodo matching 2021-12-20 10:58:43 +01:00
Enrico Ottonello 98cccc4442 removed GZIPCompression on request, currently it is not needed 2021-12-17 11:44:16 +01:00
Enrico Ottonello a90f02487a record to publish now are sent to spring module inside body request, because of htmlsimple harvesting can produce large record (>10MB) 2021-12-17 11:39:37 +01:00
Enrico Ottonello 0ab59c10f4 fix for temporal informations 2021-12-15 15:06:40 +01:00
Enrico Ottonello 201f02eb9d fix for aat and temporal informations 2021-12-15 15:06:15 +01:00
Enrico Ottonello 385afcaaac fixed aat graph name 2021-11-26 15:24:30 +01:00
Alessia Bardi 58e292e734 enrichment queries for IAVP (to be revised) and fixed AAT for DIME 2021-11-25 16:17:59 +01:00
Enrico Ottonello b592dcbc9e added skos:prefLabel to native_period concept 2021-11-15 10:46:37 +01:00
Enrico Ottonello 259d12d260 enrichment for dime oai 2021-11-08 16:57:19 +01:00
Enrico Ottonello 5d9ce6a5fd fix geopoint on collection 2021-11-08 16:56:28 +01:00
Enrico Ottonello 9d778bf75b Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2021-10-26 17:57:40 +02:00
Enrico Ottonello c7673f7ba1 lowercase to period name on native and temporal fields 2021-10-26 17:49:22 +02:00
Alessia Bardi af33f3ce0e provenance tripels mapped to PAV ontology 2021-10-25 15:24:59 +02:00
Alessia Bardi 0d0ebc4d77 testing DIME 2021-10-25 15:24:23 +02:00
Enrico Ottonello 0010458a23 modified log level for a few message 2021-10-22 12:32:04 +02:00
Enrico Ottonello 4a4da01d6b added titlecase on temporal and native period name 2021-10-22 11:38:19 +02:00
Enrico Ottonello 0f7e7de918 handling for title as elastic search object with text and language fields, same handling for description 2021-10-07 11:55:57 +02:00
Enrico Ottonello 0693645c68 added precision information to spatial data 2021-10-04 15:13:16 +02:00
Enrico Ottonello 25a6433809 case fix for native and derived subject 2021-09-29 17:02:45 +02:00
Enrico Ottonello 05b685e0aa fixed concept label case problem and limited to 10 the about list elements retrieved 2021-09-10 17:15:21 +02:00
Enrico Ottonello 3510d7d1be Merge branch 'new_es_mapping'
# Conflicts:
#	dnet-ariadneplus-graphdb-publisher/src/main/resources/eu/dnetlib/ariadneplus/sparql/read_collection_data_template.sparql
#	dnet-ariadneplus-graphdb-publisher/src/main/resources/eu/dnetlib/ariadneplus/sparql/read_record_data_template.sparql
#	dnet-ariadneplus-graphdb-publisher/test/java/eu/dnetlib/ariadneplus/GraphDbReaderAndESIndexTest.java
2021-09-08 15:56:12 +02:00
Enrico Ottonello 8a68c098fb added creator enrichment for nara 2021-09-08 15:22:03 +02:00
Enrico Ottonello 0689ae6b08 enrichment for conicet records 2021-09-07 12:40:07 +02:00
Enrico Ottonello 5e4b1a87b9 fix periodo name for native period 2021-09-07 12:39:43 +02:00
Enrico Ottonello 61abf9b51e fix native period informations for collection 2021-09-06 16:39:19 +02:00
Enrico Ottonello 239d7afc41 added periodo matching rule for nara 2021-09-06 15:42:01 +02:00
Enrico Ottonello 5f4e1e2819 initial enrichment for conicet 2021-09-06 13:40:31 +02:00
Enrico Ottonello e106393e07 restored query template used for retrieving record from graphDB 2021-09-01 17:21:22 +02:00
Alessia Bardi d169e1fad8 Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2021-08-26 17:59:35 +02:00
Alessia Bardi ea3b749792 test with read-only mode connection 2021-08-26 17:59:32 +02:00
Enrico Ottonello c2e9a4650d patched aat mappings original concept uri inside aat graph 2021-08-12 17:04:06 +02:00
Enrico Ottonello 6c6cfcf648 added inheritance from a few collection fields 2021-08-10 16:34:49 +02:00
Enrico Ottonello 087b240e05 enrichment for all infn api 2021-08-10 12:23:49 +02:00
Enrico Ottonello 4cae23f264 enrichment for nara 2021-08-09 14:41:08 +02:00
Enrico Ottonello 6789abca49 enrichment for infn torino 2021-08-09 14:40:49 +02:00
Enrico Ottonello 42eb9604a5 new class to handle publish on graphdb operation, transaction throws OOM so currently one write operation at time is executed without transaction 2021-07-27 14:58:00 +02:00
Enrico Ottonello 405f623a4c added aat mappings 2021-07-23 12:05:13 +02:00
Enrico Ottonello d584b932e8 removed temporal propagation for fieldwork on happens_during relation 2021-07-23 12:04:49 +02:00
Enrico Ottonello 9e17c18c2f updated graphdb-free-runtime to version 9.8.0, updated publisher version 2021-07-20 12:43:09 +02:00
Enrico Ottonello 21c6eb06fd fix polygon retrieving for dans and snd 2021-07-16 18:58:48 +02:00
Enrico Ottonello 8944977a17 added digitalImage support 2021-06-28 12:50:39 +02:00
Enrico Ottonello 6c8c9fcba3 added fields has_type and is_about 2021-06-23 14:56:25 +02:00
Enrico Ottonello 4882e38d64 added new fields from es mapping: agent (homepage,institution,agentIdentifier) and wasCreated 2021-06-23 11:26:56 +02:00
Enrico Ottonello 89f309feaa added mapping for polygon data when aocat:has_polygonal_representation is in wkt format (snd::zip) 2021-06-22 11:06:56 +02:00
Enrico Ottonello 41896d312b fix for from and until values on temporal and native period fields 2021-06-21 15:20:39 +02:00
Enrico Ottonello 54b76c79a0 added polygon support; the correct order of the geopoints describing the polygon is needed 2021-06-18 19:32:12 +02:00
Enrico Ottonello 8ed4b8b08d added spatial boundingbox support using a 4 sides polygon wkt format 2021-06-17 17:59:51 +02:00
Alessia Bardi 9598827e1a enrichment SPARQL commands divided for FASTI collection and records, since they come from different APIs anyway and, therefore, they belong to different named graphs 2021-06-16 17:47:23 +02:00
Enrico Ottonello e91d82f32c model classes according to new es mapping; creation and indexing of a record with geopoint data 2021-06-15 23:34:59 +02:00
Alessia Bardi c60a41aa32 Aarhus DIME: enrichment queries merged into one single file 2021-06-04 17:31:28 +02:00
Alessia Bardi e0d8a0ac11 Inrap DOLIA: enrich query with AAT merged into one file 2021-06-04 15:58:55 +02:00
Alessia Bardi 699dc0c214 updated enrichment query for Inrap Dolia 2021-06-04 14:22:30 +02:00
Alessia Bardi cd8d6cdc54 INRAP draft enrich queries for Dolia 2021-06-04 14:15:52 +02:00
Alessia Bardi ae9f8e23ce now really moved to proper folder 2021-06-04 12:07:11 +02:00
Alessia Bardi 15941c029e move Aarhus enrichment queries to the right folder 2021-06-04 12:03:45 +02:00
Alessia Bardi 42ee40eff0 Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2021-06-03 18:51:21 +02:00
Alessia Bardi c72c7eac3f updated template for default additions - provided record 2021-06-03 18:51:10 +02:00
Alessia Bardi 1b9e7cbc67 enrich SPARQL statement for DIME (Aarhus University) 2021-06-03 18:31:55 +02:00
Enrico Ottonello 1083d4e723 set new elastic search index on staging 2021-05-31 16:44:34 +02:00
Enrico Ottonello 1545f3900f get specific error for elastic search record parsing error 2021-05-31 16:43:21 +02:00
Enrico Ottonello a9a0526bcf sparql insert for pp 2021-05-27 22:16:39 +02:00
Enrico Ottonello bd44bc6fa5 sparql insert for road 2021-05-26 18:50:11 +02:00