Commit Graph

160 Commits (8e5938777abcf0c62a499fb362a492b25553be57)

Author SHA1 Message Date
Enrico Ottonello c83c8bf931 sparql insert for ads 1786 4 years ago
Alessia Bardi a9749ffbf2 INSERT for SND zip API - preliminary 4 years ago
Alessia Bardi a0b3e27645 updated construct query for temporals 4 years ago
Enrico Ottonello 47f46009e1 sparql insert for ads 272_event 4 years ago
Enrico Ottonello c2d13f1f4d sparql insert for ads 292 4 years ago
Enrico Ottonello 101b6261f1 sparql insert for ads 367 4 years ago
Enrico Ottonello ab3086c70c sparql insert for ads 3 4 years ago
Enrico Ottonello 8612438e86 added native subject and temporal coverage generation from about section 4 years ago
Enrico Ottonello e0729986f8 added temporal coverage generation from about section 4 years ago
Enrico Ottonello d65252873e added native_subject generation from about section 4 years ago
Enrico Ottonello 95270ef3f7 sparql insert for ads 321 4 years ago
Enrico Ottonello 05c3682e0d fix HNM periodo graph creation with all needed information, fix HNM periodoplus graph creation retrieving from/until date in year format; 858 sparql insert queries 4 years ago
Enrico Ottonello 0d44e18674 added optional fields for collection 4 years ago
Enrico Ottonello e5d0fa5254 added has_native_subject insert with uppercase; added aatplus graph creation 4 years ago
Enrico Ottonello e36e1a0080 enriched query for 420_event collection 4 years ago
Enrico Ottonello 142a296166 changed exception type, if collection indexing failes 4 years ago
Enrico Ottonello 814c908663 collection is now indexed before records, if there is an error on collection indexing, wf failed immediately; enriched query for 397 collection 4 years ago
Enrico Ottonello 12bbcdd8be Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 4 years ago
Enrico Ottonello e5e7d85996 added ns declaration in template; enriched query for 1091 collection 4 years ago
Alessia Bardi f0509be5aa Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 4 years ago
Enrico Ottonello 6976a35611 has_spatial_coverage data set to optional for collection 4 years ago
Enrico Ottonello b4476f6ee7 sparql insert set for 272_monument; test for retrieving collection records for 272_monument, that does not retrieve any records, because of spatial_region data are not found 4 years ago
Alessia Bardi ea4ed22b4d Collection 272 does not exist, we have 272_monument and 272_event 4 years ago
Alessia Bardi be31a772a1 SPARQL INSERT for HNM 4 years ago
Alessia Bardi 12c80713d7 indexing result per record logged in debug mode instead of info 4 years ago
Alessia Bardi 832b95f064 parse must succeed if the date is already in the expected format 4 years ago
Alessia Bardi 19ebb63d88 fixed log 4 years ago
Alessia Bardi f1e3de1b07 avoid null pointer exception 4 years ago
Alessia Bardi 4fb5bb2941 it is legal to have no individual resources or no collections: let's index what we have 4 years ago
Alessia Bardi f55699a324 sparql insert for HNM (AAT missing) 4 years ago
Alessia Bardi 420e31d866 preparing sparql inserts for ADS 271 and 272 4 years ago
Alessia Bardi e63f25217c Insert defaults for collections of HNM 4 years ago
Alessia Bardi ca2f6dbb21 updated labels 4 years ago
Alessia Bardi 1b11d0ee1c default for collection has_type (needed by HNM) 4 years ago
Alessia Bardi 7338a759c8 removed duplicate check on access rights 4 years ago
Enrico Ottonello db2ad3f97e multithreads http client not needed on indexjobnode, maybe avoid 404 response after a few minutes, added log on each indexing operation 4 years ago
Alessia Bardi 56088d7779 need to add info from the collSubjects graph -- ARIADNE subject and collection id 4 years ago
Alessia Bardi ca42e0d01e fixed SPARQL INSERT for PeriodO enrichment 4 years ago
Alessia Bardi 23f1feb44a updated SPARQL inserts for ADS 4 years ago
Alessia Bardi 8329f6e9dc useless if removed 4 years ago
Alessia Bardi c49d6ce109 added query for spatial region of collections 4 years ago
Alessia Bardi 02c5014fd5 removed redundand isPart 4 years ago
Alessia Bardi e8d65287cc check additional mandatory fields 4 years ago
Alessia Bardi 3e2e9ff372 Insert default creator also for collections 4 years ago
Alessia Bardi ca4ad7ea3b Need to split the multiple inserts and perform separate transactions in GraphDB Free edition. See https://stackoverflow.com/questions/54428161/graphdb-read-check-and-update-in-a-transaction 4 years ago
Alessia Bardi 587887abd6 sparql inserts for ADS 836 4 years ago
Alessia Bardi 2c282d31b2 sparql inserts for ADS 836 4 years ago
Alessia Bardi 223c304702 sparql inserts for ADS 273 4 years ago
Alessia Bardi 69ca7eaade removed redundand lines of code 4 years ago
Alessia Bardi b3f5f38c02 sparql query to get the records without mandatory fields 4 years ago
Alessia Bardi f8a3bc5a0e sparql query to get the collections without mandatory fields 4 years ago
Alessia Bardi e82043d9eb added comments 4 years ago
Alessia Bardi 7040ad741b moved SPARQL query for ADS 270 in dedicated folder 4 years ago
Alessia Bardi 6365fa583d sparql templates for the different fix and enrichment phases 4 years ago
Alessia Bardi cf2f2e6f8b organised templates and prepared folders for ADS SPARQL inserts 4 years ago
Enrico Ottonello 54458be7f5 order in sparql insert execution is important, this query contains all sparql insert in the correct order 4 years ago
Enrico Ottonello 220c6be6db report returned to wf node 4 years ago
Enrico Ottonello 214502cc11 removed test publisher 4 years ago
Enrico Ottonello f61f794c25 removed a few logs 4 years ago
Enrico Ottonello 11e00c806d reset json parser status on each record 4 years ago
Enrico Ottonello b29b4e1fd7 added log on json parser 4 years ago
Enrico Ottonello eb61aebcd5 added other check on parsing json from rdf statements 4 years ago
Enrico Ottonello 5eaa655f01 added other check on es return code 4 years ago
Enrico Ottonello 173b0c289e to avoid overload on graphdb heap it is better to slowing down query execution 4 years ago
Enrico Ottonello 5bb65a8854 added response code from es; added sparql insert for copying ariadne_subject value into collection for ads; fix sparql insert for copying collection data into records, collection id condition is needed 4 years ago
Enrico Ottonello 766f8199f2 removed empty values/structures from record/collection to es 4 years ago
Enrico Ottonello d6aafdf97d es _id only for collection type record must be numeric format, for now we prepend 10000 to originalId value 4 years ago
Enrico Ottonello 6a804f176b removed extent and audience fields, empty values cause error on portal 4 years ago
Enrico Ottonello 9358f1eaf2 collection data are now indexed with all required fields by es mapping 4 years ago
Enrico Ottonello 364d25f2b7 archeologicalResourceType.id mapped 4 years ago
Enrico Ottonello e689623994 all ES fields are now mapped 4 years ago
Enrico Ottonello 9737184b1e start aligning es json fields to es mapping 4 years ago
Enrico Ottonello db9b70feb0 new node and workflow to index on ES 4 years ago
Enrico Ottonello 42c3f5e885 added indexing of collection data with dedicated query 4 years ago
Enrico Ottonello 06995feefa added rest method indexOnES(datasource,collectionId) to retrieve records data from graphDB and index to ES 4 years ago
Enrico Ottonello 064f298329 added query to retrieve record ids collection; datasource, collection id and record id are now paramters on a query template from file 4 years ago
Enrico Ottonello b80274fff3 added graphDB reader and ES indexer 4 years ago
Enrico Ottonello fa1d268b36 added query to link data from collection level to records level 4 years ago
Enrico Ottonello af2eb7bb91 added sparql query folder 4 years ago
Enrico Ottonello aa1c6c2fda added query to generate aat and periodo enriched graphs 4 years ago
Enrico Ottonello 9814069fb2 new rest method to import data into graphDB from url 4 years ago
Enrico Ottonello 30b3fa2140 New JobNode and workflow to enrich content on GraphDB 4 years ago
Enrico Ottonello 739dcc6b82 added rest method to execute sparql insert query on graphdb 4 years ago
Enrico Ottonello d23f08f750 removed BIND not necessary 4 years ago
Enrico Ottonello a005328dfe fix resource type variable name 4 years ago
Enrico Ottonello d52ad32f68 added narrow and broad for aat match 4 years ago
Enrico Ottonello 7ae6d400b6 temporal coverage joined with periodO data that must be directly imported in graphDb in turtle format together with periodO mapping 4 years ago
Enrico Ottonello ef42eb551a fix spatial subselect: region, region point and region bounding box data must be referenced by 3 different variables inside the query 4 years ago
Enrico Ottonello 32b91c277d all not madatory sets of conditions must be set as optional 4 years ago
Enrico Ottonello 5c3d50f309 originalId set to mandatory 4 years ago
Enrico Ottonello 2b85674659 modified prefix mine: <http://www.myprefix/> into aoprop: <https://www.ariadne-infrastructure.eu/property/> 4 years ago
Enrico Ottonello 3e230e98be added bounding box info, modified output predicates 4 years ago
Enrico Ottonello a8aa5ec6ed added legalResponsible, owner 4 years ago
Enrico Ottonello 7bd85b6946 retrieved contributor on collection sub-select 4 years ago
Enrico Ottonello 7d65ba2a0c matching with aat and fix spatial coverage 4 years ago
Enrico Ottonello 7f93ce6358 from named condition modified to from because of wrong triples in results 4 years ago
Enrico Ottonello bf862f20f2 fix wrong matches on native subjects 4 years ago
Enrico Ottonello 226cdde77d all records related to an api are published into the same graph 4 years ago
Enrico Ottonello f12eb7eb52 added aat collection clause 4 years ago
Enrico Ottonello ae91617d1b added optional surrounding union conditions, in case all those conditions do not match any statements 4 years ago