Adrià Mercader
977589fdd6
Merge pull request #272 from 6aika/master
...
remove authz as they are not used and they are no longer new
2016-11-23 15:26:45 +02:00
Adrià Mercader
3836fcfd65
Merge pull request #268 from GovDataOfficial/clearsource-history-command
...
Add clearsource history command
2016-11-23 14:35:45 +02:00
Jari Voutilainen
afee362bbc
remove authz as they are not used and they are no longer new
2016-11-17 14:14:02 +02:00
rnoerenberg
ff1b861f1b
Update documentation
...
Added note with the limit of 1000 harvest sources
2016-11-16 16:02:12 +01:00
David Read
e7c03855ca
Avoid the "# dont use factory because it looks for the existing source" by copying the SOURCE_DICT each time, rather than letting tests edit the master copy.
2016-11-16 15:40:44 +01:00
seitenbau-govdata
7f76f60ec3
Fixed variable name
2016-11-16 00:34:07 +01:00
seitenbau-govdata
d511663038
Sort lists for assert
2016-11-16 00:25:19 +01:00
seitenbau-govdata
95d0c1ca41
Ignoring not existent harvest sources in harvest_sources_job_history_clear
...
Ignoring not existent harvest sources harvest_sources_job_history_clear because of a possibly corrupt search index.
2016-11-15 23:36:11 +01:00
seitenbau-govdata
f68bf323f0
Using test class wide unique harvest source url
...
Using test class wide unique harvest source url, because in a test created objects are still present in following tests.
2016-11-15 22:28:37 +01:00
seitenbau-govdata
d01a86680e
Fix creating different harvest sources
...
Fix creating different harvest sources. Different harvest sources can't be created with factory.
2016-11-15 21:56:57 +01:00
seitenbau-govdata
096e746c81
Fixed HarvestSourceObj argument
2016-11-15 21:23:20 +01:00
seitenbau-govdata
8d5ff4b4ef
Fixed harvest_sources_job_history_clear test
...
Fixed harvest_sources_job_history_clear test by creating different harvest sources.
2016-11-15 21:09:42 +01:00
rnoerenberg
cf1cfcca48
Fixed using property of object
2016-11-15 15:50:03 +01:00
rnoerenberg
1acab98026
Added tests for clearsource history command
2016-11-15 15:37:26 +01:00
seitenbau-govdata
af0e1712b9
Changed filter query for reading harvest sources
...
Changed filter query for reading harvest sources in according to the code in /ckanext/harvest/plugin.py.
2016-11-15 15:04:01 +01:00
Raphael Stolt
e8570b9e50
Add clearsource history command
2016-11-15 15:04:01 +01:00
Adrià Mercader
b78afd0302
Merge pull request #269 from GovDataOfficial/fix-missing-i18n-directory
...
Include i18n directory in package
2016-10-28 14:37:58 +01:00
Raphael Stolt
8deba079c5
Include i18n directory in package
2016-10-28 11:49:17 +02:00
David Read
f4af291754
Merge pull request #265 from argv0/patch-1
...
Change 'redirect' calls to 'h.redirect_to'
2016-09-19 11:23:29 +01:00
Andy Gross
f2e1dc512c
Change 'redirect' calls to 'h.redirect_to'
...
ckan.lib.base.redirect was removed in [1], guidance is to always use h.redirect_to instead. Manifested as 503 errors in the harvest UI against an install of CKAN master branch.
[1] 34f3f18e88
2016-09-18 03:23:29 -07:00
Adrià Mercader
57173ff9fe
Merge pull request #263 from metaodi/add-last-job-status
...
Add new parameter return_last_job_status to harvest_source_list
2016-08-31 11:23:42 +01:00
Stefan Oderbolz
4ee772f064
Use toolkit.asbool to parse given boolean parameter
2016-08-31 09:13:36 +02:00
David Read
1edb114482
Merge pull request #264 from metaodi/245-use-apgl-in-setup-py
...
Specify AGPL in setup.py in accordance with CKAN
2016-08-30 10:38:09 +01:00
Stefan Oderbolz
aa12bc9937
Specify AGPL in setup.py in accordance with CKAN [ #245 ]
2016-08-29 11:53:43 +02:00
Stefan Oderbolz
8b081e2868
Add new parameter return_last_job_status to harvest_source_list
...
In order to get a quick overview over successful/failed harvesters, a
call to harvest_source_list with return_last_job_status=true can be used
to get this information.
By default return_last_job_status is False, and hence the extra
resources to grab this information is not wasted for every call, but
only if the client requests is explicitly.
The original 'status' field stays as-is, this PR introduces a new field
called 'last_job_status' to return this information.
The returned information is gather by a call to
harvest_source_status_show.
2016-08-25 17:56:51 +02:00
Adrià Mercader
b0f2c84806
Merge pull request #261 from ckan/260-docs
...
[#260 ] Improve install docs
2016-08-08 12:21:20 +01:00
David Read
ab6a83c49a
[ #260 ] Fix the ckan ini filename
2016-08-05 16:12:59 +01:00
David Read
d0a8cab479
[ #260 ] Improve install docs
2016-07-29 12:05:12 +01:00
David Read
2208da6669
Merge pull request #258 from torfsen/257-allow-sharing-of-redis-database
...
[#257 ] Purge only our own Redis data.
2016-07-20 15:58:17 +01:00
Florian Brucker
2602de9094
[ #257 ] Purge only our own Redis data.
...
Previously purging the queue on the Redis backend would clear the whole
database, making it hard to share the same database with other parts of
CKAN. With this commit, only the keys that belong to ckanext-harvest and
the current CKAN instance are purged.
2016-07-20 16:24:13 +02:00
Adrià Mercader
f8cfc63885
Merge pull request #255 from ckan/253-default-groups
...
[#253 ] Fix default_groups
2016-07-01 20:45:46 +02:00
David Read
78933fb775
[ #253 ] Fix default_groups by saving the dicts to the config object, since saving it to the harvester object doesnt work in the real world. This is a lot more efficient than doing group_show for every dataset imported.
2016-06-27 12:01:35 +01:00
Adrià Mercader
b737a419dc
Merge pull request #252 from jweyrich/master
...
Don't let the user specify mutually exclusive configuration options
2016-06-15 10:06:02 +01:00
Jardel Weyrich
e8f539a45e
Don't let the user specify mutually exclusive configuration options:
...
- organizations_filter_include
- organizations_filter_exclude
2016-06-14 11:35:38 -03:00
Adrià Mercader
f2d8a5f8cc
Merge pull request #251 from ckan/249-default-tag
...
Fix default_groups, plus fix docs for default_tags
2016-06-13 13:59:54 +01:00
David Read
9d1c20fc44
[ #249 ] Slight README improvement.
2016-06-13 10:28:18 +00:00
David Read
836605097f
Fix test_queue2 tests
2016-06-13 10:12:30 +00:00
David Read
18a506a112
[ #249 ] Add test for default_extras.
2016-06-10 09:51:17 +00:00
David Read
f1742fb51a
Fix default_groups. It accepted a list of package_name/ids and was trying to add this to the package, but the package needs a dict. Added test.
2016-06-10 09:16:32 +00:00
David Read
bfc9b8e0d9
[ #249 ] Test and fix docs for default_tags. Needed to improve error handling when saving ValidationError in a HOE.
2016-06-09 22:11:03 +00:00
Adrià Mercader
aeab60ece6
Merge pull request #247 from keitaroinc/change-db-logger-pagination-param-name
...
Change db logger pagination param name
2016-06-06 09:45:57 +01:00
Petar Efnushev
1ba5c4389b
Merge branch 'master' into change-db-logger-pagination-param-name
2016-06-06 10:29:55 +02:00
Petar Efnushev
1fda3c0255
Change db logger pagination param name
2016-06-06 10:27:05 +02:00
Petar Efnushev
92120ca47e
Change db logger pagination limit param name
2016-06-06 10:23:57 +02:00
Petar Efnushev
34dedf3869
Add harvest log API usage documentation
2016-06-03 13:55:34 +02:00
amercader
13d5395bf0
Bump version
2016-05-23 16:00:23 +01:00
David Read
a5c3d2a92c
Merge pull request #243 from ckan/240-dont-reuse-contexts
...
Don't reuse contexts on ckan harvester
2016-05-23 14:59:08 +01:00
amercader
5e1512f717
Don't reuse contexts on ckan harvester
...
Reusing the same context on all calls can lead to hard to debug failures
like
Action function organization_show did not call its auth function
In this case that was caused because the first organization/group_show
raised a NotFound so the auth audit was still in the context. When
organization/group_show was called again at the end of
organization/group_create the auth audit exception was raised.
This commit makes sure that each call has its own context.
2016-05-23 12:20:08 +01:00
amercader
3ddce922e0
Merge branch 'keitaroinc-240-fix-groups-import'
2016-05-23 10:21:02 +01:00
amercader
16a6e9fbf6
Add tests for group creation during harvesting
2016-05-23 10:20:52 +01:00