ad9e513c0d
mock ckan.lib.mailer
2018-06-13 13:12:14 +02:00
00911a6924
test harvest-error-mail
2018-06-13 10:53:36 +02:00
431d202d4e
Add tests and documentation for dataset name suffix config
2018-06-01 21:45:29 +02:00
717fdb35dd
move _last_error_free_job from CKANHarvester to HarvesterBase
2017-11-10 12:19:25 +01:00
d1dd4eb227
303: fix clean_tags with tags dict (fixes requested by review)
2017-11-08 13:46:44 +01:00
881a9581d5
Fix url_for depending tests
2017-07-27 16:09:00 +01:00
cc438786de
More explicit checks of the exception thrown when checking harvest config. Also the default_groups test was checking the wrong thing completely.
2017-05-02 20:39:49 +00:00
e7c03855ca
Avoid the "# dont use factory because it looks for the existing source" by copying the SOURCE_DICT each time, rather than letting tests edit the master copy.
2016-11-16 15:40:44 +01:00
7f76f60ec3
Fixed variable name
2016-11-16 00:34:07 +01:00
d511663038
Sort lists for assert
2016-11-16 00:25:19 +01:00
f68bf323f0
Using test class wide unique harvest source url
...
Using test class wide unique harvest source url, because in a test created objects are still present in following tests.
2016-11-15 22:28:37 +01:00
d01a86680e
Fix creating different harvest sources
...
Fix creating different harvest sources. Different harvest sources can't be created with factory.
2016-11-15 21:56:57 +01:00
096e746c81
Fixed HarvestSourceObj argument
2016-11-15 21:23:20 +01:00
8d5ff4b4ef
Fixed harvest_sources_job_history_clear test
...
Fixed harvest_sources_job_history_clear test by creating different harvest sources.
2016-11-15 21:09:42 +01:00
cf1cfcca48
Fixed using property of object
2016-11-15 15:50:03 +01:00
1acab98026
Added tests for clearsource history command
2016-11-15 15:37:26 +01:00
2602de9094
[ #257 ] Purge only our own Redis data.
...
Previously purging the queue on the Redis backend would clear the whole
database, making it hard to share the same database with other parts of
CKAN. With this commit, only the keys that belong to ckanext-harvest and
the current CKAN instance are purged.
2016-07-20 16:24:13 +02:00
18a506a112
[ #249 ] Add test for default_extras.
2016-06-10 09:51:17 +00:00
f1742fb51a
Fix default_groups. It accepted a list of package_name/ids and was trying to add this to the package, but the package needs a dict. Added test.
2016-06-10 09:16:32 +00:00
bfc9b8e0d9
[ #249 ] Test and fix docs for default_tags. Needed to improve error handling when saving ValidationError in a HOE.
2016-06-09 22:11:03 +00:00
16a6e9fbf6
Add tests for group creation during harvesting
2016-05-23 10:20:52 +01:00
cc6cb3e389
Changed default config params for the database logger
...
Added database logger test case
README updates
2016-05-16 13:15:12 +02:00
3d519ce0b2
Partial fixes
2016-04-25 19:53:49 +02:00
a1968e4c63
Check if harvest_log table is populated on source creation
2016-04-12 19:28:43 +02:00
49faa0ae6c
Tests for CKANHarvester._last_error_free_job
2016-02-15 13:30:28 +00:00
385b369148
Error-free jobs now include ones where an object was not modified.
2016-02-15 13:16:23 +00:00
52c071dbe9
Improved error handling. e.g. if the site it harvests just returns errors.
2016-02-15 12:10:44 +00:00
331ad84272
Deal with worry about datasets on the remote CKAN being added/removed during harvest.
2016-02-12 18:00:00 +00:00
7096b7ddf2
Merge branch 'master' of github.com:ckan/ckanext-harvest into 157-version-three-apify
2016-02-12 16:51:26 +00:00
5bf0ac9b86
[ #219 ] Fix tests auth
2016-01-14 11:23:17 +00:00
497dfeea02
Add test for missing form
2016-01-14 10:15:46 +00:00
e0c3316531
Add legacy import for CreateTestData
2016-01-11 22:35:11 +01:00
c141cf44fa
Swap import statements to make sure `run_test` works on CKAN 2.3
2016-01-11 22:13:25 +01:00
6b23208b2a
Merge branch '212-module-import-error'
2015-12-11 13:38:32 +00:00
6ef58addbc
Fix tests for ckan 2.2 again with amercaders suggestion.
2015-12-11 11:52:00 +00:00
f0ba0c865c
Fix tests for ckan 2.2
2015-12-10 16:36:27 +00:00
5ff3ef9d17
Merge branch '205-inconsistent-stats'
2015-12-10 13:36:15 +00:00
82fe2d0e53
Merge branch 'fetch_unchanged'
2015-12-10 13:19:45 +00:00
80b82ee968
Merge branch 'factory-job'
2015-12-10 13:18:19 +00:00
4cc39e5ef4
Merge branch 'test-guid-fix'
2015-12-10 13:15:54 +00:00
04162ce9e4
Merge branch 'munge-tag'
2015-12-10 13:15:17 +00:00
8b8086fe48
[ #212 ] Fixes #212 - auth for harvest_job_create was broken.
2015-12-09 15:50:05 +00:00
18169c5133
[ #205 ] "detailed" removed in a couple of other benign places.
2015-12-08 10:18:36 +00:00
b0780b2062
Fetch stage can also return "unchanged", same as the import stage. Used by DGU. It is useful to skip an object like this, to avoid saving the fetched content in a HarvestObject (saves disk usage).
2015-12-01 17:38:57 +00:00
414c33ac6b
Easy fix to stop test_queue.py using MockHarvester in test_queue2.py by mistake.
2015-12-01 16:55:42 +00:00
8163ec4d39
HarvestObject factory was creating a extra field containing the job, by mistake. PEP8
2015-11-27 14:21:16 +00:00
6c3efe53df
Fix job stats key - it is "errored" not "errors" - the keys are from report_status. And lots of PEP8.
2015-11-25 20:55:32 +00:00
f0a2e9fb8e
CKAN revision API returns package ids not names (for v2 of the API). This ensures harvest guid is always the ID rather than the name.
2015-11-24 16:41:43 +00:00
52f7e0dd07
Use the ckan version of munge_tag if available, but provide a fallback for older ckans.
2015-11-23 12:48:05 +00:00
e71cf35504
Fix queue tests
2015-11-20 14:25:31 +00:00
Stefanie Taepke
seitenbau-govdata
Knud Möller
etj
amercader
David Read
Florian Brucker
Petar Efnushev
Stefan Oderbolz