CatalogueRevamping
/
harvester-d4science
14
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Merge branch 'ogdch-79-optional-tag-munging'

This commit is contained in:
amercader 2014-02-10 13:13:48 +00:00
parent 2b803a3f66 bf11e4d330
commit 3693028009
2 changed files with 12 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
README.rst
View File

@ -206,6 +206,12 @@ field. The currently supported configuration options are:
present in the local CKAN. Setting it to 'create' will make an attempt to present in the local CKAN. Setting it to 'create' will make an attempt to
create the organizations by copying the details from the remote CKAN. create the organizations by copying the details from the remote CKAN.
* clean_tags: By default, tags are not stripped of accent characters, spaces and
capital letters for display. If this option is set to True, accent characters
will be replaced by their ascii equivalents, capital letters replaced by
lower-case ones, and spaces replaced with dashes. Setting this option to False
gives the same effect as leaving it unset.
Here is an example of a configuration object (the one that must be entered in Here is an example of a configuration object (the one that must be entered in
the configuration field):: the configuration field)::

2
ckanext/harvest/harvesters/base.py
View File

@ -20,6 +20,7 @@ from ckanext.harvest.model import HarvestJob, HarvestObject, HarvestGatherError,
from ckan.plugins.core import SingletonPlugin, implements from ckan.plugins.core import SingletonPlugin, implements
from ckanext.harvest.interfaces import IHarvester from ckanext.harvest.interfaces import IHarvester
log = logging.getLogger(__name__) log = logging.getLogger(__name__)
@ -150,6 +151,7 @@ class HarvesterBase(SingletonPlugin):
'ignore_auth': True, 'ignore_auth': True,
} }
if self.config and self.config.get('clean_tags', False):
tags = package_dict.get('tags', []) tags = package_dict.get('tags', [])
tags = [munge_tag(t) for t in tags] tags = [munge_tag(t) for t in tags]
tags = list(set(tags)) tags = list(set(tags))