2fbac74c29
Fix importing assert_in
2019-03-06 14:12:27 +02:00
3aec5ed279
Fix importing, so that extensions will not break
2019-03-06 13:36:42 +02:00
98364723d7
Apply flake8
2019-03-06 13:19:05 +02:00
68bf4893c4
Add an 'owner_org' to the v3 package migration
...
The auto-migration fails because the new package does not have an
owner organisation ID assigned, so fails validation
2018-12-03 14:13:04 +00:00
e66362d113
Merge pull request #344 from alphagov/tls-patches
...
Fix SSL problems for old versions of Python 2.7.x
2018-11-12 09:17:28 +01:00
685843e583
Restore missing import
2018-11-01 14:00:38 +00:00
6f82f19049
Simplify exception handling
2018-10-30 09:52:38 +00:00
c21c162799
Merge pull request #338 from brucebolt/fix-attribute-error
...
A harvester may not have an info method
2018-10-29 16:08:13 +01:00
6b6458f2ea
Use requests lib instead of urllib2
2018-10-29 11:50:39 +00:00
204b1f301a
One more fix for 2.9
2018-10-26 14:11:20 +02:00
ed288dca63
Reduce usage of c vars, add more tests
2018-10-26 13:38:09 +02:00
dea0bd09ad
Remove unused controller
2018-10-25 15:48:42 +02:00
cb5186962e
Support for CKAN 2.9
...
Use objects from toolkit, remove old checks using missing c properties,
Add legacy routes
2018-10-25 15:39:57 +02:00
7bad691415
Add tests and docs for include/exclude groups
2018-10-25 13:04:37 +02:00
753d29d5ff
Merge branch 'master' of https://github.com/etri-odp/ckanext-harvest into etri-odp-master
2018-10-25 12:47:26 +02:00
b51c5f119e
Merge branch 'master' of github.com:ckan/ckanext-harvest
2018-10-25 12:19:47 +02:00
bdbf53caea
Fix styling issues on Bootstrap 3
2018-10-25 12:19:43 +02:00
3808d52487
Merge pull request #332 from gavinpc-mindgrub/use-redis-password
...
Use Redis password from configuration when present.
2018-10-25 12:18:56 +02:00
e7384106c3
A harvester may not have an info method
...
This fixes the error `AttributeError: 'HarvesterBase' object has
no attribute 'info'` which prevents new harvest sources from
being created.
2018-10-25 10:32:50 +01:00
1a63250e4b
Ensures the AND operator for fq in solr
2018-08-30 16:33:55 +02:00
9f8b98e54f
Use Redis password from configuration when present.
2018-07-12 10:14:24 -04:00
cd6f75251f
test if error-mails are only sent to respective org’s admins
2018-06-14 14:45:26 +02:00
304bbcec06
send harvest-error-mails to organization-admins
2018-06-14 11:07:49 +02:00
a6cb710127
Merge branch 'error-mail' of https://github.com/stefina/ckanext-harvest into stefina-error-mail
2018-06-13 14:17:42 +02:00
e1e6b44a44
extend TestHarvestErrorMail from FunctionalTestBase
...
This prevents failing tests for older versions.
2018-06-13 13:31:03 +02:00
ad9e513c0d
mock ckan.lib.mailer
2018-06-13 13:12:14 +02:00
00911a6924
test harvest-error-mail
2018-06-13 10:53:36 +02:00
f965751bd5
send error-mail to sys-admins
2018-06-13 10:46:35 +02:00
20c9235270
use logic-actions instead of DB-Calls
2018-06-13 09:09:36 +02:00
5f414e2c99
add error-notifications in case of harvest-failure
...
requires configuration-values:
ckan.harvest.status_mail.errored = true
email_to = %comma seperated list of emails to receive the email%
error_email_from = %sender of email%
ckan.site_title = %will be included in the email%
2018-06-11 13:38:38 +02:00
fff9800266
Fix print statements to be Py3 friendly
...
Fixes the print statements where they were doung to use print as a
function, and also to switch to .format() rather than %.
Also contains some flake8 whitespace changes as I suspect making this
PEP8ish will take several PRs.
2018-06-08 09:53:13 +01:00
431d202d4e
Add tests and documentation for dataset name suffix config
2018-06-01 21:45:29 +02:00
938d0322f5
Add config option for dataset name append type
2018-06-01 21:43:37 +02:00
0f8d448864
feat: add groups filter config
2018-04-17 13:22:26 +09:00
65e3163015
Merge pull request #315 from maxious/fix-solr-erase-all
...
Don't delete all solr documents/fail to index harvesters when harvest config blank
2018-03-03 09:55:36 +01:00
c89ddc02a3
Don't delete all solr documents when harvest config blank
2018-03-03 19:19:54 +11:00
2464dd27b3
Add the CSS classes for FontAwesome 4.x
...
CKAN 2.7.x upgrades to FontAwesome 4.x, so the CSS classes need to be
updated in order to work. But because this extension is used in older
CKAN versions as well, we simply add the new classes, while keeping the
old ones for backwards compatibility.
2018-02-13 16:26:29 +01:00
717fdb35dd
move _last_error_free_job from CKANHarvester to HarvesterBase
2017-11-10 12:19:25 +01:00
d1dd4eb227
303: fix clean_tags with tags dict (fixes requested by review)
2017-11-08 13:46:44 +01:00
41aa9c121f
303: fix clean_tags with tags dict
2017-11-07 14:14:50 +01:00
7bb9a2b5e4
Catch sqlalchemy's DatabaseError in fetch and gather callback
...
I sometimes see "connection timed out" message which are reported as
sqlalchemy.exc.DatabaseError, so by catching the latter exception, it'd
avoid the harvester to be stuck in "limbo" state.
As DatabaseError is a super-class of OperationalError, the latter would
still be catched.
2017-11-02 17:20:31 +01:00
cc44d03a41
Drop log.error() call redundant with prior log.exception() call
...
logging.exception() already logs an ERROR message with exception
information, so there's no need to call both log.exception() and
log.error().
Along the way, make messages uniform in fetch_callback() and
gather_callback().
2017-11-02 17:17:00 +01:00
c1661442c9
Merge pull request #298 from ckan/use-api-to-get-dataset-count
...
Use the package_search API for the count of datasets
2017-11-02 10:31:36 +00:00
9bfd5866fb
Use package_search to display package count of harvester
2017-11-01 08:24:32 +01:00
6714d4de58
Move Stop Button
2017-10-26 16:06:48 +00:00
0d877bf768
Abort Jobs from UI
2017-10-26 14:42:39 +00:00
b589797c47
Merge branch 'master' of github.com:ckan/ckanext-harvest
2017-07-27 16:09:19 +01:00
881a9581d5
Fix url_for depending tests
2017-07-27 16:09:00 +01:00
207ac81d70
[289] Fix default_extras
2017-05-29 20:11:49 +02:00
cc438786de
More explicit checks of the exception thrown when checking harvest config. Also the default_groups test was checking the wrong thing completely.
2017-05-02 20:39:49 +00:00
Jari Voutilainen
Bruce Bolt
Stefan Oderbolz
Andrea Grandi
amercader
Dennis Rupnow
Gavin Cannizzaro
Stefanie Taepke
Ross Jones
seitenbau-govdata
MinhChau
Alex Sadleir
Stefan Oderbolz
Knud Möller
etj
Denis Laxalde
Ubuntu
David Read