Commit Graph

258 Commits

Author SHA1 Message Date
Enrico Ottonello a14c66f36e added default values for has_temporal_coverage and has_spatial_coverage 2021-01-09 00:53:33 +01:00
Enrico Ottonello 9565265f3d added Rock Art mapping; fixed Site/monument mapping 2021-01-08 15:32:46 +01:00
Enrico Ottonello b8d0e3f741 enrichment queries set is now splitted on workflow node side, because of timeout error on very large collection 2021-01-07 23:40:47 +01:00
Enrico Ottonello 4673c143ce curl command to create catalog index with mapping for elastic search on production 2021-01-07 11:48:00 +01:00
Enrico Ottonello 1ca29a2ebf alignment with current elastic-test instance mapping 2021-01-07 11:35:33 +01:00
Enrico Ottonello 5e8c38cc0b removed include because of default log to /tmp/spring.log 2020-12-22 19:33:40 +01:00
Enrico Ottonello a05d8e97da replicated with a new id for having different execution dates with aggregation_to_graphdb_wf.xml 2020-12-18 17:39:15 +01:00
Enrico Ottonello 3e68138b81 new wf to publish a collection on staging graphdb and then on public one 2020-12-18 16:20:38 +01:00
Enrico Ottonello dc6bd40d1e let isStart true only for collection node, avoiding parallelism on multiple nodes 2020-12-18 16:19:43 +01:00
Enrico Ottonello 0d6e69e3eb Merge pull request 'staging-public-wf' (#2) from staging-public-wf into master
New workflow works fine, so we can merge into master.
2020-12-18 11:57:03 +01:00
Alessia Bardi 5f695ee538 fixed worng copy&paste, probably from an st file...again 2020-12-17 20:15:51 +01:00
Alessia Bardi 0e30eccbae fixed worng copy&paste, probably from an st file 2020-12-17 17:56:13 +01:00
Alessia Bardi 6c150be5b2 added missing param 2020-12-17 13:53:26 +01:00
Alessia Bardi e5eefef411 fixed param name 2020-12-16 16:09:40 +01:00
Alessia Bardi fa3592b1b3 added missing wf node 2020-12-15 17:06:52 +01:00
Alessia Bardi 3e28f8fd57 increasing mid version number 2020-12-14 18:57:36 +01:00
Alessia Bardi 4edfc4af05 new_agg_wf.xml annotated with comments to guide the (manual) migration of old workflows to the new one 2020-12-14 18:56:49 +01:00
Alessia Bardi 687d5ab9ec only one start node 2020-12-14 18:27:23 +01:00
Alessia Bardi be64ce5dcf changed workflow name ad description 2020-12-14 18:22:13 +01:00
Alessia Bardi 8a9782cb1e re-organising workflows and templates for staging/public instances of graphdb and elasticsearch 2020-12-14 17:49:53 +01:00
Enrico Ottonello 8a341add4c sparql insert for 1972 2020-12-01 11:29:37 +01:00
Enrico Ottonello 8baf2d7941 added BST date format handling parsing, before creating es record 2020-11-30 13:27:28 +01:00
Enrico Ottonello fbc4fc8717 added has_creator field mandatory for records 2020-11-27 12:41:11 +01:00
Enrico Ottonello 4a9a5301b3 sparql insert for 304, fix for 1093 2020-11-27 11:00:03 +01:00
Enrico Ottonello f1b1f55ae5 sparql insert for 1093 2020-11-25 13:34:18 +01:00
Enrico Ottonello 1fb0a95ada added check on record mandatory field place_name 2020-11-02 14:57:54 +01:00
Enrico Ottonello d9ca483855 added a default value for record mandatory field has_spatial_coverage 2020-11-02 14:55:18 +01:00
Enrico Ottonello eb775fc787 sparql insert for ads 4 2020-10-30 18:22:17 +01:00
Enrico Ottonello 075490f4da removed duplicated log 2020-10-30 17:29:18 +01:00
Enrico Ottonello 529151828f when IRI created from periodo url is wrong, wf has to fail 2020-10-30 17:08:46 +01:00
Enrico Ottonello 7044bcdca4 sparql insert for ads 328 2020-10-28 17:04:25 +01:00
Enrico Ottonello 991df8d4d1 sparql insert for ads 324 2020-10-28 16:41:31 +01:00
Enrico Ottonello 665a717ca0 added check on identifier, before indexing 2020-10-23 12:18:58 +02:00
Enrico Ottonello 899f3eb4d9 added has_temporal_coverage check 2020-10-22 11:26:33 +02:00
Enrico Ottonello 292f3000c4 added temporal_coverage default, if not found 2020-10-22 10:45:39 +02:00
Enrico Ottonello 5d29077a43 added counter on wf progress information 2020-10-20 19:34:40 +02:00
Enrico Ottonello 8073ac7131 the node retrieves resources identifier list for collection and record, then loops on the 2 identifiers lists and request indexing to rest module 2020-10-20 17:43:27 +02:00
Enrico Ottonello 1398c2495e test for new indexing methods on rest module 2020-10-20 16:42:44 +02:00
Enrico Ottonello 240be91c5e added rest method to index single record by its identifier 2020-10-19 12:20:56 +02:00
Enrico Ottonello 9174f4df14 add graphdb connection setup 2020-10-16 19:56:14 +02:00
Enrico Ottonello f88231ba18 added new methods to retrieve resource identifiers and to start indexing by resource identifiers 2020-10-16 19:37:21 +02:00
Enrico Ottonello 0e96774895 changed http request method for indexing 2020-10-15 17:09:35 +02:00
Enrico Ottonello f5cd3cdce5 sparql insert for ads 1054 2020-10-15 13:51:02 +02:00
Enrico Ottonello ba5632f783 added has_temporal_coverage default as not provided for all ads collection, because of is a mandatory field for the query 2020-10-15 12:19:29 +02:00
Enrico Ottonello 72d37b4238 sparql insert for ads 1787, 269, fix for date on 1786 2020-10-14 19:10:24 +02:00
Enrico Ottonello 57e0470aee sparql insert for ads 1788, 388 2020-10-14 17:43:55 +02:00
Enrico Ottonello cb595f2c1c sparql insert for ads 420_monument 2020-10-14 16:30:04 +02:00
Enrico Ottonello 78818738b9 sparql insert for ads 801, 1970, 276 2020-10-14 13:11:14 +02:00
Enrico Ottonello bc99ce87f6 Merge branch 'master' of https://code-repo.d4science.org/D-Net/AriadnePlus 2020-10-13 15:34:47 +02:00
Enrico Ottonello 25de647504 set KeepAlive true on used socket; replaced SimpleJobNode with AsyncJobNode 2020-10-13 15:34:43 +02:00