David Read
01536873b9
#276 Coupled Resource table now gets updated during harvest.
2013-01-31 18:05:48 +00:00
David Read
2cef9d6dae
#noticket Tests added to clarify license URL extraction.
2013-01-31 14:32:19 +00:00
David Read
ecd6036efe
#276 Coupled resources - second iteration. Just need to update harvester now.
2013-01-28 23:56:12 +00:00
David Read
91e547a622
#276 Coupled resources - first iteration.
2013-01-28 21:53:15 +00:00
David Read
775a57d1f5
Latest schematron added. FCSC is a good test of it.
2013-01-24 11:30:23 +00:00
David Read
70c3eccdf5
Relaxed "Multiplicity Check" so that it does not raise Exceptions any more - just log errors. This is because they are simply duplicates of the Gemini Schematron. Adria agreed these will be deleted anyway in 2.0.
2013-01-21 17:22:24 +00:00
amercader
461607f06f
Merge branch 'release-v2.0' into 2.0-validation-changes
2013-01-21 16:30:59 +00:00
amercader
fd1071959e
[ #6 ] Move to Leaflet for dataset map widget
...
For this particular use case Leaflet offered the best option. Also
solves the issue when showing extent covering the whole world.
2013-01-18 15:12:09 +00:00
amercader
66b72163d5
Remove stuff from html.py
...
The rest will eventually go when we migrate the spatial search snippet.
2013-01-18 15:11:06 +00:00
amercader
70f7f6144b
Factor out DGU code from the dataset map
...
It now lives in the DGU extension:
https://github.com/datagovuk/ckanext-dgu/blob/master/ckanext/dgu/theme/public/scripts/dgu-dataset-map.js
2013-01-18 13:32:30 +00:00
amercader
0991841eaf
Update README
...
WMS preview, dataset map snippets, formatting fixes.
2013-01-18 13:08:33 +00:00
amercader
3da5807eb4
[ #6 ] Update dataset map to be a pure snippet
...
No need to load an extension.
2013-01-18 13:07:26 +00:00
David Read
1622223a38
[xs] Improve docstrings and error messages.
2013-01-16 22:22:39 +00:00
David Read
7841691fc3
More debug logging added to WAF harvester.
2013-01-16 13:10:32 +00:00
David Read
348c1c4dc1
Add XSL for converting Gemini XML to nice HTML, used in controllers/api.py.
2013-01-16 13:08:28 +00:00
amercader
21a85a6b3f
[ #4 ] Register resources only once for all plugins
...
spatial_metadata will load the resources (public, templates and
resources) for all plugins to use, as it needs to be loaded anyway.
2013-01-15 20:00:46 +00:00
amercader
7abfb4eb61
Use plugins toolkit whenver possible on plugin.py
2013-01-15 19:57:31 +00:00
amercader
da7bb48eb5
Merge branch 'release-v2.0' into 2.0-validation-changes
2013-01-14 14:03:04 +00:00
amercader
711391e971
[ #4 ] Rewrtie WMS preview plugin for ResourcePreview interface
...
Much simplified plugin for previewing WMS. It requires the
resource_proxy plugin to work.
Also clean up public and template dir to mimic core layout.
2013-01-14 13:59:15 +00:00
kindly
4e47141717
add extra resource locator
2012-12-24 10:43:44 +00:00
amercader
c927d8b6ab
Add method for adding custom validators
...
This probably needs to be done properly, adding them once on startup
somehow.
2012-12-20 18:26:40 +00:00
David Read
6fcbf878c2
Spatial query can now be ordered. Does not play nicely with SOLR options - just uses that to get the facets counts and return each result. Have added performance tests for two alternative queries.
2012-12-06 18:17:45 +00:00
David Read
36905eed17
Adding Parslow constraints schema previously missed.
2012-12-05 15:02:27 +00:00
David Read
68f22147bc
Added lower level tests for bbox search (at the lib level), complementing the API level ones.
2012-12-05 15:01:16 +00:00
David Read
df884bdd3d
Comments about on cardinality/multiplicity.
2012-12-05 12:05:45 +00:00
David Read
20e1a59227
Added new Parslow Constraints Schematron to test. Added command to validate on the command-line.
2012-12-05 11:42:57 +00:00
amercader
615a58ce93
Reduce log level for harvest object errors
2012-11-21 16:22:55 +00:00
amercader
9ea721e256
Encode remote documents from CSW servers as unicode
2012-11-20 15:42:07 +00:00
amercader
6cf7f79942
Save line if present when storing object errors
2012-11-20 11:47:04 +00:00
amercader
7113466760
Update harvesters to new validator outputs
2012-11-19 18:12:40 +00:00
amercader
e12e38cab0
Improvements on the validation code
...
To make easier to filter and display errors on the UI, the validators
have been modified to return the message and line number separately. The
return format for validators is now:
(is_valid, [(error_message_string, error_line_number)])
Also the XSD based validators were returning only the last error found on
the document, instead of iterating the whole error log. Harvesters should
create a harvest object error for each of this validation errors.
Tests have been adapted to these changes.
2012-11-19 17:15:16 +00:00
amercader
0379852fe0
Merge branch '2641-spatial-widgets-new-theme' into release-v2.0
2012-11-12 16:44:05 +00:00
amercader
b82dd4a9c0
Merge branch 'csw-harvester-enhancements' into release-v2.0
2012-11-12 16:43:52 +00:00
David Read
ccbac9c3c5
Get the validation XML to be included in the distribution.
2012-11-07 16:23:27 +00:00
amercader
a84268abf6
Don't trust the number of records returned by the remote server
...
Sometimes, even when requesting 10 records, the CSW server returns less
of them (see eg http://goo.gl/b7Rdj , only 9 records returned). The
current check made the process stop on this case, missing other
identifiers.
2012-11-02 11:12:46 +00:00
amercader
0444c14da2
Better check for config object
2012-10-30 16:40:32 +00:00
amercader
99dc2a7c55
Allow to define the validation profiles via source config
...
The profiles used are decided as follows:
1. 'validator_profiles' property of the harvest source config
object
2. 'ckan.spatial.validator.profiles' configuration option in
the ini file
3. Default value as defined in DEFAULT_VALIDATOR_PROFILES
2012-10-30 14:18:01 +00:00
David Read
a45ff0c75f
Merge branch 'master' of github.com:okfn/ckanext-spatial
2012-10-30 09:34:48 +00:00
David Read
ee543df158
Added useful logging to the validation report. Useful to have the date (i.e. version) in the name of the Eden schema.
2012-10-30 09:34:40 +00:00
amercader
ac7947549e
Remove unused imports
2012-10-29 16:35:52 +00:00
amercader
9e9048c272
Add validator for FGDC XSD schema
2012-10-29 14:34:29 +00:00
amercader
9488ecd5a9
Add validator for ISO 19139 NGDC XSD schema
2012-10-29 14:28:58 +00:00
amercader
c1d2a479f2
Add traceback to exception when getting CSW identifiers
2012-10-23 18:57:11 +01:00
amercader
92b781d0f1
Minor model tweaks to support parsing generic ISO documents
2012-10-23 13:03:53 +01:00
amercader
aeb7d27bab
Fix failing tests
...
The WMS one is just skipped, until we have a more clear way of how the
previews will work.
2012-10-22 19:44:33 +01:00
amercader
7f58374ac7
Enable command line interface for validation, useful for debug
2012-10-22 19:39:07 +01:00
amercader
d95602eaff
Fix wrong resource paths on validation
2012-10-22 19:37:54 +01:00
amercader
019cb3b45f
Fix wrong imports and docs
2012-10-22 19:36:03 +01:00
David Read
d90114cf07
Added ability to produce report into validation errors, for when changing validation. Added report infrastructure.
2012-10-19 18:20:32 +01:00
David Read
0e8a62fe1e
Reorganise XML test files into more sensible directory names. Add lower level validation tests.
2012-10-19 14:23:34 +01:00