Commit Graph

1126 Commits

Author SHA1 Message Date
David Read f9eedcac4e
Merge pull request #382 from ckan/fix-travis-requirements-py2
Fix for Travis build, now requirements.txt on master is for python3
2019-11-22 13:47:28 +00:00
David Read 90a0d4bfb5 Fix for Travis build, now requirements.txt on master is for python3 2019-11-22 12:16:42 +00:00
Stefan Oderbolz 83c483dc06
Add #381 to CHANGELOG 2019-11-14 17:22:57 +01:00
Stefan Oderbolz 6100839809
Re-add Unreleased section 2019-11-14 17:20:23 +01:00
Stefan Oderbolz f80564301e
Merge pull request #381 from stefina/fix-error-mail-for-harvest-object-error
get message from harvest_object_error-dict
2019-11-14 17:17:55 +01:00
Stefanie Taepke 27fbd0caad add test for error mail when HarvestObjectError occurs 2019-11-14 16:01:00 +01:00
Stefanie Taepke 56dd067e5b get message from harvest_object_error-dict 2019-11-13 18:14:06 +01:00
amercader 142731a3ca Make revision_id optional in schema, as it has been removed in CKAN master 2019-11-08 10:12:51 +01:00
amercader 7b251f0e3b Actually skip the log tests 2019-11-01 16:41:44 +01:00
amercader 98206669da Update version number and changelog 2019-11-01 16:37:22 +01:00
amercader 34517193fe Merge branch '369-broken-tests' 2019-11-01 16:33:53 +01:00
amercader 3030a58a79 [#369] Test ckan 2.6 to master 2019-11-01 16:32:03 +01:00
amercader ba9a870eb9 [#369] Disable harvest db log in tests as it causes recursion problems 2019-11-01 16:31:44 +01:00
amercader 60e7717d2d [#369] Test 2.8 2019-10-18 14:54:38 +02:00
amercader 3742ea61de [#369] Test master 2019-10-18 14:41:50 +02:00
amercader d18079fe40 [#369] Verbose tests 2019-10-18 14:41:38 +02:00
amercader 12196268d8 Merge branch 'master' into 369-broken-tests 2019-10-18 14:40:12 +02:00
Adrià Mercader 30e8ec4395
Merge pull request #373 from wood-chris/patch-1
Updated README.rst
2019-10-18 14:25:44 +02:00
amercader 3be2d6acd0 Update CHANGELOG 2019-10-03 11:52:40 +02:00
amercader 3793480a91 Fix Flake8 warnings 2019-10-03 11:50:15 +02:00
amercader 57718973ce Add exit-zero to the flake8 command for pep8 2019-10-03 11:39:24 +02:00
amercader 5ffe6d4bfa Resend awaiting objects in the DB that are not present in Redis
This happens when there is an ongoing harvest job and the keys on redis
are deleted for some reason (eg not persistent container)
2019-10-03 11:32:48 +02:00
amercader 5ad6d866ed Mark early errored job as finished
Otherwise it's displayed as Running forever
2019-10-03 11:22:23 +02:00
amercader 8e862c8f04 Fix wrong toolkit reference 2019-10-03 11:21:44 +02:00
Adrià Mercader 5c9c093803
Merge pull request #376 from ckan/remove-old-migrations
Remove old database migrations that targeted ancient versions
2019-10-02 15:58:00 +02:00
amercader 72591e83ad Add changelog notice 2019-10-01 12:08:29 +02:00
amercader 7ac70cd58e Remove old database migrations that targeted ancient versions
For this version it is safe to assume that is these migrations are no
longer needed. They could introduce hard to track errors as part of the
startup work they did.
2019-10-01 12:04:16 +02:00
amercader 819706ae5d Add further notes on extending ckan harvester 2019-08-26 13:48:09 +02:00
amercader 30f19713fa Add hook to extend the package dict in CKAN harvester 2019-08-26 13:38:30 +02:00
amercader 51bf79a626 Revert back to StrictRedis client 2019-08-26 12:26:05 +02:00
amercader 8b2f2f9a24 Merge branch 'default-to-ckan.redis.url' 2019-08-23 15:46:37 +02:00
amercader 18e8f5ce13 Merge branch 'master' into 369-broken-tests 2019-08-23 14:40:50 +02:00
Adrià Mercader 25775ffa7b
Merge pull request #358 from ckan/ckantoolkit
Use ckantoolkit to clean up imports
2019-08-23 14:39:54 +02:00
amercader a8b1b211e1 [#369] [#369] Remove dodgy patching 2019-08-23 14:21:24 +02:00
amercader b1b284a810 Default to the ckan.redis.url setting
99.9% of cases you probably want to use the same redis instance that
CKAN core uses so it makes sense to default to that setting. If it's not
set if will default to the hardcoded values (localhost:6379/0) which is
the same default as CKAN core. If there is an existing legacy setting
(ckan.harvest.mq.hostname) those will be used.
2019-08-23 13:34:17 +02:00
Chris Wood 17868b28dc
Updated README.rst
Updated README.rst to clarify that dev-requirements needs to be installed for ``run_test``
2019-07-31 17:30:27 +01:00
Stefan Oderbolz b8cf47bb91
Merge pull request #365 from usingsky/fix-SAWarning
Fix SAWarning when tracking update from ckan
2019-07-09 07:58:49 +02:00
amercader 62d1843962 [#369] Fix conditional imports 2019-07-02 12:27:19 +02:00
Stefan Oderbolz 9eee08b034
Merge pull request #367 from GovDataOfficial/fix-broken-abort-job-in-ui
Fix abort job from ui
2019-07-01 17:16:20 +02:00
seitenbau-govdata b206c4cf36 Fix abort job from ui
* Fix abort job from ui which was broken by commit
ed288dca63
2019-07-01 12:19:36 +02:00
Jinil Lee 7e006e8c9e Fix SAWarning when tracking update from ckan
Warnings emitted when coercing full SQL fragments into text()
2019-06-01 18:08:11 +09:00
David Read 3a72337f1e
Merge pull request #359 from ckan/fix-model-codestyle
Code style changes to model and plugin
2019-03-18 19:55:31 +00:00
Stefan Oderbolz 5335d66316 Changelog entry for ckantoolkit 2019-03-18 17:48:25 +01:00
Stefan Oderbolz 8be627a454 Use ckantoolkit to avoid imports from new_test 2019-03-18 17:48:25 +01:00
Stefan Oderbolz 2c8a909c66
Add #357 to CHANGELOG 2019-03-18 14:22:46 +01:00
Stefan Oderbolz ecf578648b
Merge pull request #357 from alphagov/add-test-error-raise
Fix harvest request exceptions
2019-03-18 14:21:20 +01:00
Ken Tsang dfc147e6d7 Fixed codestyle in test_ckanharvester.py 2019-03-18 11:16:50 +00:00
Ken Tsang 95e6e934ac Add tests for raised errors during _get_content 2019-03-18 10:53:57 +00:00
Ken Tsang 1b609eeb60 import HTTPError to ckanharvester.py 2019-03-18 10:53:57 +00:00
Bruce Bolt 730b476c08 Fix harvest requests exceptions 2019-03-18 10:53:57 +00:00