Commit Graph

657 Commits

Author SHA1 Message Date
amercader 869aa3a147 Merge branch '63-extend-spatial-harvesters' 2014-06-07 19:42:32 +01:00
amercader db3e418dc6 Merge branch 'master' into release-v2.0 2014-06-07 19:41:04 +01:00
amercader dbf139e732 [#63] Added extension point for defining custom validators 2014-05-13 18:07:14 +01:00
amercader 6c55aad223 [#63] Add extra stuff to the get_package_dict extension point
Moved the call to get_site_user higher on base.py so it's available to
extensions. Also added the parsed XML etree so it does not need to be
parsed from the string again.
2014-05-13 18:03:12 +01:00
amercader 5461bebb62 Merge branch 'master' into 63-extend-spatial-harvesters 2014-05-13 17:54:44 +01:00
amercader 8dc99c5ee7 [#70] Fix deletion of harvested CSW records
The object id was pushed to the list returned by gather_stage before
being saved on the db, so None was added, causing an exception in the
Redis queue
2014-05-13 17:54:36 +01:00
amercader fa4161af87 [#70] Fix deletion of harvested CSW records
The object id was pushed to the list returned by gather_stage before
being saved on the db, so None was added, causing an exception in the
Redis queue
2014-05-13 17:53:18 +01:00
amercader b25a01029a Merge branch 'master' into 63-extend-spatial-harvesters
Conflicts:
	ckanext/spatial/harvesters/base.py
2014-05-13 15:33:04 +01:00
amercader a2758a3b30 Pass defer_commit in context on get_site_user calls
See ckan/ckan#1714. Until that is fixed properly, the `defer_commit`
flag avoids some `DetachedInstanceErrors` happening during the
harvesting.
2014-05-13 15:32:21 +01:00
amercader ab241d2530 Pass defer_commit in context on get_site_user calls
See ckan/ckan#1714. Until that is fixed properly, the `defer_commit`
flag avoids some `DetachedInstanceErrors` happening during the
harvesting.
2014-05-13 15:30:34 +01:00
amercader 57b7e51e5a Merge branch '69-reindex-dataset-no-object-change' into 63-extend-spatial-harvesters 2014-04-30 18:02:15 +01:00
amercader e979d08e77 [#69] Reindex dataset if harvest object did not change
We replace the old harvest object with the new one, and if we don't
reindex the reference to the old harvest object will remain in the
dataset dict
2014-04-30 18:01:42 +01:00
amercader e9be08d8f1 Merge branch 'master' into 63-extend-spatial-harvesters 2014-04-28 18:41:38 +01:00
Tom Kralidis a17e40c83e bump pycsw requirement to 1.8.0 which eliminates the pycsw model definition issue 2014-04-28 18:41:21 +01:00
Tobias Preuss e02fcce22f Describe how to change ownership in more detail. 2014-04-28 18:41:17 +01:00
Tobias Preuss 97a84f3b3f Avoid that url is interpretated as a pattern by zsh. 2014-04-28 18:41:14 +01:00
amercader 3938a7e8a7 [#62] Fix xpath for Alternate Title 2014-04-28 18:41:10 +01:00
amercader 9eb1a2a4c4 Merge branch 'tomkralidis-master' 2014-04-28 18:39:38 +01:00
amercader 08a40fb173 Merge branch 'master' of https://github.com/tomkralidis/ckanext-spatial into tomkralidis-master 2014-04-28 18:39:23 +01:00
amercader dc7b4d91ca Merge branch 'johnjohndoe-patch-2' 2014-04-28 18:38:54 +01:00
amercader e655b7152d Merge branch 'patch-2' of https://github.com/johnjohndoe/ckanext-spatial into johnjohndoe-patch-2 2014-04-28 18:38:39 +01:00
amercader edf244ae5e Merge branch 'johnjohndoe-patch-1' 2014-04-28 17:26:59 +01:00
amercader d37f41760a Merge branch 'patch-1' of https://github.com/johnjohndoe/ckanext-spatial into johnjohndoe-patch-1 2014-04-28 17:26:29 +01:00
amercader e19ed8100f [#62] Fix xpath for Alternate Title 2014-04-28 17:25:17 +01:00
Tom Kralidis 2c87e31721 bump pycsw requirement to 1.8.0 which eliminates the pycsw model definition issue 2014-04-09 07:41:15 -04:00
Tobias Preuss d047a90a2c Describe how to change ownership in more detail. 2014-04-09 10:43:26 +02:00
Tobias Preuss b72a94de02 Avoid that url is interpretated as a pattern by zsh. 2014-04-09 10:26:07 +02:00
amercader 211f3e4a95 [#63] Tweak docs 2014-03-19 13:02:03 +00:00
amercader f960733727 Merge branch 'master' into 63-extend-spatial-harvesters 2014-03-19 12:48:49 +00:00
amercader 0513e360e9 [#63] Add previous_object check
In rare cases (eg if there was a previous error of two objects sharing
a guid) we can have a "changed" state and no previous_object
2014-03-19 12:46:01 +00:00
amercader 119c0fd40c [#63] Add user to delete context to avoid exception 2014-03-19 12:45:49 +00:00
amercader f8c5764ac1 [#65] Add individualName to ResponsibleParty 2014-03-19 11:59:41 +00:00
amercader bbe4125257 [#65] Add individualName to ResponsibleParty 2014-03-19 11:59:08 +00:00
amercader 3b1b857efd Merge branch 'master' into 63-extend-spatial-harvesters 2014-03-14 14:12:30 +00:00
amercader 8221189a4a [#62] Fix spatial-resolution parsing 2014-03-14 14:12:23 +00:00
amercader 26763218bc [#62] Fix spatial-resolution parsing 2014-03-14 14:12:05 +00:00
amercader 13f03878e2 Merge branch 'master' into 63-extend-spatial-harvesters 2014-03-14 12:36:36 +00:00
amercader 4814ad60bb [#64] Fix validation exception when resource-type was missing 2014-03-14 12:36:29 +00:00
amercader 1fa72f4c16 [#64] Fix validation exception when resource-type was missing 2014-03-14 12:36:01 +00:00
amercader badd723259 [#63] Add new ISpatialHarvest interface
Two extension points: ``get_package_dict`` and ``transform_to_iso``,
with the same expected behaviour as the old hooks meant to be overriden.

For ``get_package_dict`` we now pass, apart from the generated
package_dict, the parsed iso_values and the harvest object.

Updated docs and added autodocs.
2014-03-14 11:30:26 +00:00
Tom Kralidis 3be77f38cb editorial: identify pycsw 2014-03-14 10:52:23 +00:00
etj 82d3e1d151 [#55] Allow CSW harvesters to define CQL filters (2nd try) 2014-03-14 10:44:55 +00:00
kindly 0f00914e6d allow csw to fetch differen output schema 2014-03-14 10:44:52 +00:00
amercader 55497f037e Merge branch 'geosolutions-it-55_harvest_cql_master' 2014-03-14 10:32:51 +00:00
amercader 60828520ba Merge branch '55_harvest_cql_master' of https://github.com/geosolutions-it/ckanext-spatial into geosolutions-it-55_harvest_cql_master 2014-03-14 10:29:47 +00:00
amercader cf9ace4acf [#62] Relax multiplicities 2014-03-14 10:28:04 +00:00
amercader dc37867d7a [#62] Add new fields to the ISO parser
* Metadata standard name / version
* Unique resource identifier (reenabled and fixed)
* Presentation form
* Purpose
* Maintenance note
* Access constraints
* Distributor
* Usage
* Aggregation info
2014-03-14 10:28:04 +00:00
amercader e9c7bbcabe [#62] Clean up keywords parsing
Keywords were extracted via 3 different elements
`keyword-inspire-theme`, `keyword-controlled-other` and
`keyword-free-text`. The latter didn't actually do anything and the
second duplicated xpaths from the first and added a non-standard one.

A new `keywords` key has been added which contains all keyword objects,
including type. This is not used to modify the `tags` key right now.
2014-03-14 10:28:04 +00:00
amercader 5b29e47efb [#62] Add links to organization parties 2014-03-14 10:28:04 +00:00
amercader 959a74e630 Merge branch '62-new-iso-fields' 2014-03-14 10:27:27 +00:00