Commit Graph

328 Commits

Author SHA1 Message Date
Enrico Ottonello a90f02487a record to publish now are sent to spring module inside body request, because of htmlsimple harvesting can produce large record (>10MB) 2021-12-17 11:39:37 +01:00
Enrico Ottonello 0ab59c10f4 fix for temporal informations 2021-12-15 15:06:40 +01:00
Enrico Ottonello 201f02eb9d fix for aat and temporal informations 2021-12-15 15:06:15 +01:00
Enrico Ottonello 385afcaaac fixed aat graph name 2021-11-26 15:24:30 +01:00
Alessia Bardi 58e292e734 enrichment queries for IAVP (to be revised) and fixed AAT for DIME 2021-11-25 16:17:59 +01:00
Enrico Ottonello b592dcbc9e added skos:prefLabel to native_period concept 2021-11-15 10:46:37 +01:00
Enrico Ottonello 259d12d260 enrichment for dime oai 2021-11-08 16:57:19 +01:00
Enrico Ottonello 5d9ce6a5fd fix geopoint on collection 2021-11-08 16:56:28 +01:00
Enrico Ottonello 66a5677e88 added record for testing normalizer on dating filter 2021-10-27 09:42:30 +02:00
Enrico Ottonello 9d778bf75b Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2021-10-26 17:57:40 +02:00
Enrico Ottonello c7673f7ba1 lowercase to period name on native and temporal fields 2021-10-26 17:49:22 +02:00
Alessia Bardi af33f3ce0e provenance tripels mapped to PAV ontology 2021-10-25 15:24:59 +02:00
Alessia Bardi 0d0ebc4d77 testing DIME 2021-10-25 15:24:23 +02:00
Enrico Ottonello 0010458a23 modified log level for a few message 2021-10-22 12:32:04 +02:00
Enrico Ottonello 4a4da01d6b added titlecase on temporal and native period name 2021-10-22 11:38:19 +02:00
Enrico Ottonello 0f7e7de918 handling for title as elastic search object with text and language fields, same handling for description 2021-10-07 11:55:57 +02:00
Enrico Ottonello 0693645c68 added precision information to spatial data 2021-10-04 15:13:16 +02:00
Enrico Ottonello 25a6433809 case fix for native and derived subject 2021-09-29 17:02:45 +02:00
Enrico Ottonello 905226390c test class merged
Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus
2021-09-10 17:15:25 +02:00
Enrico Ottonello 05b685e0aa fixed concept label case problem and limited to 10 the about list elements retrieved 2021-09-10 17:15:21 +02:00
Alessia Bardi 5d2dec864c use read only connection 2021-09-10 15:44:34 +02:00
Enrico Ottonello f4e15dbf89 graphdb now handles request from external api client only on https 2021-09-10 12:40:59 +02:00
Enrico Ottonello acc04b0ace merged test cases 2021-09-08 17:02:16 +02:00
Enrico Ottonello c5241e3181 updated major version after merging with new_es_mapping branch 2021-09-08 16:06:30 +02:00
Enrico Ottonello 3510d7d1be Merge branch 'new_es_mapping'
# Conflicts:
#	dnet-ariadneplus-graphdb-publisher/src/main/resources/eu/dnetlib/ariadneplus/sparql/read_collection_data_template.sparql
#	dnet-ariadneplus-graphdb-publisher/src/main/resources/eu/dnetlib/ariadneplus/sparql/read_record_data_template.sparql
#	dnet-ariadneplus-graphdb-publisher/test/java/eu/dnetlib/ariadneplus/GraphDbReaderAndESIndexTest.java
2021-09-08 15:56:12 +02:00
Enrico Ottonello 8a68c098fb added creator enrichment for nara 2021-09-08 15:22:03 +02:00
Enrico Ottonello 0689ae6b08 enrichment for conicet records 2021-09-07 12:40:07 +02:00
Enrico Ottonello 5e4b1a87b9 fix periodo name for native period 2021-09-07 12:39:43 +02:00
Enrico Ottonello 61abf9b51e fix native period informations for collection 2021-09-06 16:39:19 +02:00
Enrico Ottonello 239d7afc41 added periodo matching rule for nara 2021-09-06 15:42:01 +02:00
Enrico Ottonello 5f4e1e2819 initial enrichment for conicet 2021-09-06 13:40:31 +02:00
Enrico Ottonello e106393e07 restored query template used for retrieving record from graphDB 2021-09-01 17:21:22 +02:00
Alessia Bardi ac01750580 ignore test that uses remote db 2021-08-26 18:00:37 +02:00
Alessia Bardi d169e1fad8 Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2021-08-26 17:59:35 +02:00
Alessia Bardi ea3b749792 test with read-only mode connection 2021-08-26 17:59:32 +02:00
Enrico Ottonello c2e9a4650d patched aat mappings original concept uri inside aat graph 2021-08-12 17:04:06 +02:00
Enrico Ottonello 6c6cfcf648 added inheritance from a few collection fields 2021-08-10 16:34:49 +02:00
Enrico Ottonello 087b240e05 enrichment for all infn api 2021-08-10 12:23:49 +02:00
Enrico Ottonello 4cae23f264 enrichment for nara 2021-08-09 14:41:08 +02:00
Enrico Ottonello 6789abca49 enrichment for infn torino 2021-08-09 14:40:49 +02:00
Enrico Ottonello 42eb9604a5 new class to handle publish on graphdb operation, transaction throws OOM so currently one write operation at time is executed without transaction 2021-07-27 14:58:00 +02:00
Enrico Ottonello 405f623a4c added aat mappings 2021-07-23 12:05:13 +02:00
Enrico Ottonello d584b932e8 removed temporal propagation for fieldwork on happens_during relation 2021-07-23 12:04:49 +02:00
Enrico Ottonello 9e17c18c2f updated graphdb-free-runtime to version 9.8.0, updated publisher version 2021-07-20 12:43:09 +02:00
Enrico Ottonello 21c6eb06fd fix polygon retrieving for dans and snd 2021-07-16 18:58:48 +02:00
Enrico Ottonello 9a3d380186 graphdb reader test 2021-07-07 12:37:55 +02:00
Enrico Ottonello 8944977a17 added digitalImage support 2021-06-28 12:50:39 +02:00
Enrico Ottonello 6c8c9fcba3 added fields has_type and is_about 2021-06-23 14:56:25 +02:00
Enrico Ottonello 4882e38d64 added new fields from es mapping: agent (homepage,institution,agentIdentifier) and wasCreated 2021-06-23 11:26:56 +02:00
Enrico Ottonello 89f309feaa added mapping for polygon data when aocat:has_polygonal_representation is in wkt format (snd::zip) 2021-06-22 11:06:56 +02:00
Enrico Ottonello 41896d312b fix for from and until values on temporal and native period fields 2021-06-21 15:20:39 +02:00
Enrico Ottonello 54b76c79a0 added polygon support; the correct order of the geopoints describing the polygon is needed 2021-06-18 19:32:12 +02:00
Enrico Ottonello 8ed4b8b08d added spatial boundingbox support using a 4 sides polygon wkt format 2021-06-17 17:59:51 +02:00
Alessia Bardi 9598827e1a enrichment SPARQL commands divided for FASTI collection and records, since they come from different APIs anyway and, therefore, they belong to different named graphs 2021-06-16 17:47:23 +02:00
Enrico Ottonello e91d82f32c model classes according to new es mapping; creation and indexing of a record with geopoint data 2021-06-15 23:34:59 +02:00
Alessia Bardi c60a41aa32 Aarhus DIME: enrichment queries merged into one single file 2021-06-04 17:31:28 +02:00
Alessia Bardi e0d8a0ac11 Inrap DOLIA: enrich query with AAT merged into one file 2021-06-04 15:58:55 +02:00
Alessia Bardi 699dc0c214 updated enrichment query for Inrap Dolia 2021-06-04 14:22:30 +02:00
Alessia Bardi cd8d6cdc54 INRAP draft enrich queries for Dolia 2021-06-04 14:15:52 +02:00
Alessia Bardi ae9f8e23ce now really moved to proper folder 2021-06-04 12:07:11 +02:00
Alessia Bardi 15941c029e move Aarhus enrichment queries to the right folder 2021-06-04 12:03:45 +02:00
Alessia Bardi 42ee40eff0 Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2021-06-03 18:51:21 +02:00
Alessia Bardi c72c7eac3f updated template for default additions - provided record 2021-06-03 18:51:10 +02:00
Alessia Bardi 1b9e7cbc67 enrich SPARQL statement for DIME (Aarhus University) 2021-06-03 18:31:55 +02:00
Enrico Ottonello 1083d4e723 set new elastic search index on staging 2021-05-31 16:44:34 +02:00
Enrico Ottonello 1545f3900f get specific error for elastic search record parsing error 2021-05-31 16:43:21 +02:00
Enrico Ottonello a9a0526bcf sparql insert for pp 2021-05-27 22:16:39 +02:00
Enrico Ottonello bd44bc6fa5 sparql insert for road 2021-05-26 18:50:11 +02:00
Enrico Ottonello 495d617c23 optimized query for retrieving collection using named graph 2021-04-22 18:11:27 +02:00
Enrico Ottonello 698828dcfc enrichment for arup collection record 2021-04-22 16:52:17 +02:00
Enrico Ottonello 49d698a532 optimized query using named graph 2021-04-22 16:51:44 +02:00
Enrico Ottonello ce8bca3a44 patch aat mapping triples replacing %2F with / (ticket #21027) 2021-04-16 17:14:31 +02:00
Enrico Ottonello 3e6a07e57c added name for contributor if missing 2021-04-14 10:43:43 +02:00
Enrico Ottonello 86d2b8d7a0 has_ARIADNE_subject inherited from collection only if missing 2021-04-12 16:07:51 +02:00
Enrico Ottonello 5682cc4bd2 added multiple descriptions for arup 2021-04-02 12:46:07 +02:00
Enrico Ottonello a3cb6201dc added periodo query to rockart 2021-04-02 12:43:59 +02:00
Enrico Ottonello 811cd03fdc sparql insert for snd rockart 2021-03-17 10:11:52 +01:00
Enrico Ottonello 4878d2131e sparql insert for rockart collection 2021-03-15 11:00:50 +01:00
Enrico Ottonello d77a1d86a4 enrichment for collectionInfo must be executed before records enrichment 2021-03-12 12:38:44 +01:00
Enrico Ottonello 742bd6fa96 added bounding box handling to configuration 2021-03-11 13:13:50 +01:00
Enrico Ottonello 2e1ec740f5 addictional sparql insert for native subjects for ads archive 2021-03-11 12:22:05 +01:00
Enrico Ottonello f2a695e9a4 ads archives sparql insert 2021-03-09 12:45:01 +01:00
Enrico Ottonello 725c596213 aligned temporal data retrieving for collection with working record one 2021-03-05 12:34:15 +01:00
Enrico Ottonello ae6abb9873 fix has_native_subject propagation 2021-03-05 11:28:57 +01:00
Enrico Ottonello f2425ffa2d removed spatial with empty data; removed duplicates on spatial list 2021-03-04 10:59:54 +01:00
Enrico Ottonello 61f0d6877d from/until retrieved also for native period 2021-03-02 17:13:33 +01:00
Enrico Ottonello 7358dd1f1f removed periodO insert from old Ariadne periodO 2021-02-22 10:52:09 +01:00
Enrico Ottonello 510161b3df further propagation for arup document and site 2021-02-17 12:56:40 +01:00
Enrico Ottonello 84993ffaba matching periodo name (if any) overwrites native period name 2021-02-16 18:19:30 +01:00
Enrico Ottonello 2d01f321d1 added propagation of temporal data for document 2021-02-16 18:16:21 +01:00
Enrico Ottonello b86195ea71 added propagation queries for has_native_subject 2021-02-16 16:01:30 +01:00
Enrico Ottonello e5b833169b fix multiple has_spatial_coverage issue 2021-02-16 10:51:14 +01:00
Enrico Ottonello 3df2befb52 fix periodo matching with upper case 2021-02-11 11:53:55 +01:00
Enrico Ottonello 512a731527 propagation of informations from deep entities 2021-02-08 10:21:31 +01:00
Enrico Ottonello 4c7f610daa fix spatial section 2021-02-05 19:53:41 +01:00
Enrico Ottonello 7c2a037dcd fix spatial section for arup collection 2021-02-05 19:44:09 +01:00
Enrico Ottonello 7ae52c1f4b added temporal data relation 2021-02-03 11:06:09 +01:00
Enrico Ottonello 2ab94d8fc2 fix has_landing_page missing for DANS 2021-02-03 11:05:14 +01:00
Enrico Ottonello 95e4d672be fix has_name for creator, enriched with rdfs:label 2021-01-31 18:12:31 +01:00
Enrico Ottonello 18801c68cc fix language code label, now retrieved parsing has_language property value 2021-01-31 16:38:47 +01:00