amercader
3489a004ad
[ui] Minor tweak to support older themes
2012-02-14 17:23:17 +00:00
amercader
2990353533
[ui,logic] Expose source state (active/inactive) in the source form
2012-02-14 14:24:32 +00:00
amercader
4d7b8143b9
[lib] Renable unique constraint in url for inactive sources
2012-02-14 11:28:11 +00:00
amercader
78b61a09e9
[doc] Quick note about the current field
2012-02-06 10:17:27 +00:00
amercader
9ed152cbea
[ckan harvester] Add support for forcing gathering of all remote packages
2012-02-03 17:54:34 +00:00
amercader
a5cf445fa6
[ #1727 ][lib] Use 'current' field in queries returning harvest objects
2012-02-02 13:20:03 +00:00
amercader
479750da09
[ #1726 ][base harvester] Set current field when importing
2012-02-02 13:18:43 +00:00
amercader
4c81c7c3a7
[ #1726 ][model] Harvest source reference compatibility
...
The 'source' property of harvest objects now comes from the actual
foreign key. For compatibility with old harvesters, an before insert
event listener has beeen added to check if the source id has been set,
and set it automatically from the job if not.
Note that this requires SQLAlchemy 0.7 (ie CKAN 1.5.1)
2012-02-01 12:52:52 +00:00
amercader
004210935a
[model] Avoid unicode warning
2012-02-01 11:10:44 +00:00
amercader
b64d97118c
[ #1726 ][model] Add scripts for populating source_id and current fields
2012-02-01 11:08:41 +00:00
amercader
d1783f5415
[model] Changes in harvest model
...
Added three changes to the harvest model:
* 'title' column in harvest_source table
* 'current' column in harvest_job table
* foreign key from harvest_object to harvest_source
Tables are checked on startup to see if they need to be updated.
TODO: populate current and harvest_source_id fields
2012-01-30 18:38:35 +00:00
amercader
f086e908bc
[model] Clearer table initialization
2012-01-30 17:09:28 +00:00
amercader
a997e45470
[lib] Ignore deleted packages in source stats
2012-01-25 17:47:35 +00:00
David Read
004ca4a4ee
[model][xs]: Avoid unicode warning.
2012-01-25 11:35:59 +00:00
amercader
3a489bbb82
[ui] Cleanup sources list and details page
2012-01-24 16:55:47 +00:00
David Read
0f8c607187
[tests]: Another test moved in wholesale from dgu repo.
2012-01-11 10:35:37 +00:00
David Read
81ed69c4da
[tests]: Moved to this repo test code from dgu repo that might be useful or might not. Completely broken, but maybe be worth something.
2012-01-11 10:29:05 +00:00
amercader
38c7742b08
[doc] Fix typos
2012-01-10 17:55:45 +00:00
amercader
eb591521ff
Merge branch 'feature-new-ckan-harvester-features'
2012-01-10 17:27:33 +00:00
amercader
a53b79c181
[ui] Show edit and refresh links in source page
2012-01-10 17:24:05 +00:00
amercader
2ad29df5c5
[lib] Fix bug: couldn't delete source conf
2012-01-10 17:15:56 +00:00
amercader
eb646b3385
[ckan harvester] Add support for defining default extras
2012-01-10 17:07:19 +00:00
amercader
ae51093213
[ckan harvester] Ignore __junk field, was causing imports to fail
2012-01-10 14:46:12 +00:00
David Read
a971f7be79
[doc]: Convert to github.
2011-12-12 11:10:11 +00:00
Adrià Mercader
ac9a9100f8
[doc] Document api_key config option
2011-11-23 11:09:16 +00:00
Adrià Mercader
da469ab08e
[base harvester] Custom tag munge function. TODO: check with flexible tags
2011-11-23 11:05:52 +00:00
Adrià Mercader
cfaba6e1e8
[ckan harvester] Add support for sending an API key
2011-11-21 17:29:10 +00:00
Adrià Mercader
0ab5c53b47
[ckan harvester] Fix typo
2011-11-18 17:53:01 +00:00
Adrià Mercader
f02ee45aae
[ui] Show config options in harvest source details page
2011-11-18 14:35:46 +00:00
Adrià Mercader
994590531e
[ckan harvester] Support for creating read-only packages
2011-11-18 14:30:10 +00:00
Adrià Mercader
c939d90dbb
[ckan harvester] Support for defining a custom user to do the harvesting
2011-11-18 14:12:30 +00:00
Adrià Mercader
2018d9e513
[ckan harvester] Support for default tags and groups
2011-11-18 13:20:41 +00:00
Adrià Mercader
8ec05bc3e3
Modify import command to avoid problems with the Session
2011-11-15 11:26:24 +00:00
Adrià Mercader
c04d80e27e
Use get_action function instead of directly calling the action functions
2011-10-26 17:26:18 +01:00
David Raznick
31dac7029a
fix to make import stage work on its own
2011-09-28 14:27:28 +01:00
Adrià Mercader
63afd199a9
Add link to source documents from object errors
2011-09-08 10:27:36 +01:00
Adrià Mercader
31c1ea1c21
Separate gather and object errors in reports. Add info about guid and object id in the object ones
2011-09-08 09:58:21 +01:00
Adrià Mercader
c36d9bdd8e
Add new command to create new jobs for all active sources
2011-09-06 18:25:17 +01:00
David Read
dd00e98d9d
[model]: More careful about creating tables, since paster db upgrade loads the envrionment and therefore runs setup() before it does the migrations, and therefore in this instance we do not want to create the db tables.
2011-08-10 16:25:57 +01:00
Adrià Mercader
7927329536
Make harvesters work with latest ckan release
2011-07-29 11:31:03 +01:00
Adrià Mercader
bbf623213e
Added tag ckanext-harvest-0.1 for changeset 9bc6d9d11f17
2011-07-29 10:47:55 +01:00
Adrià Mercader
fda4534994
Remove old tests
2011-07-19 14:18:25 +01:00
Adrià Mercader
cabbb4922d
Use API version defined in config if present
2011-07-18 17:35:32 +01:00
Adrià Mercader
c867660e7d
Add docs to base harvester functions
2011-07-18 17:35:03 +01:00
Adrià Mercader
98384021fc
Update README. Thanks to Rolf Kleef for the patch
2011-07-18 17:34:24 +01:00
Adrià Mercader
54de6759fe
Fix bug with empty config
2011-06-28 15:04:40 +01:00
Adrià Mercader
c80e68a12f
Ensure the correct configuration is used on each stage
2011-06-14 15:59:13 +01:00
Adrià Mercader
3125bb1514
Add a check to ensure sources with no packages are reharvested
2011-06-14 12:59:48 +01:00
Adrià Mercader
2ac9885150
Page packages in the harvest source details page
2011-06-14 10:27:48 +01:00
Friedrich Lindenberg
0d9d1f8096
reduce number of queries for harvest index to a less insane number. still heavy.
2011-06-13 17:36:35 +02:00