31dac7029a
fix to make import stage work on its own
2011-09-28 14:27:28 +01:00
31c1ea1c21
Separate gather and object errors in reports. Add info about guid and object id in the object ones
2011-09-08 09:58:21 +01:00
c36d9bdd8e
Add new command to create new jobs for all active sources
2011-09-06 18:25:17 +01:00
0d9d1f8096
reduce number of queries for harvest index to a less insane number. still heavy.
2011-06-13 17:36:35 +02:00
6e75d362e3
Add a simple way for harvesters to store configuration options. If form_config_interface is Text on the info dictionary, the configuration field will be enabled in the form. Harvesters can also provide a validate_config method.
2011-06-07 12:07:53 +01:00
2b98080266
[merge] from new-forms, as forms refactoring has been merged in core
2011-05-20 13:50:15 +01:00
565eaf3d0a
Add a new info method to the harvester interface so implementations can provide details. Use this to build the WUI form
2011-05-13 18:39:36 +01:00
fecee82b1a
Minor enhancements in the WUI
2011-05-13 17:02:18 +01:00
b3a88070e3
[forms] Adapt CLI commands to changes in lib
2011-05-13 16:00:36 +01:00
bbe459527f
[forms] Major refactoring of the harvest forms. Forms no longer use the DGU form
...
API, and are handled similarly to the new ones on CKAN core (logic, schema,
validators...). The UI is also more consistent with the CKAN one.
2011-05-13 14:17:58 +01:00
26cdc1089d
Change date definitions in Harvest Objects. reference_date -> metadata_modified_date, created -> gathered
2011-05-11 17:07:05 +01:00
e1080e349e
Set a flag to force harvesters to import objects
2011-05-10 17:11:12 +01:00
e320d0588f
Add command to reimport existing harvest objects
2011-05-10 16:06:57 +01:00
c697bc3350
Normalize https ports too ( #736 )
2011-05-09 18:47:30 +01:00
5594f22be7
More robust URL checking ( #736 )
2011-05-09 14:03:46 +01:00
0e56c0ab4f
Abort pending jobs when removing sources
2011-05-05 17:13:07 +01:00
43453b6938
Show GUID on object errors
2011-04-19 17:16:25 +01:00
b5aea2d863
Allow sources with existing URLs if the existing ones are inactive
2011-04-18 17:19:04 +01:00
7e75673cff
Add function to edit harvest sources
2011-04-15 18:28:58 +01:00
d92b1df8c6
Only send harvesting jobs from active sources to queue
2011-04-15 15:50:32 +01:00
aaf7885f43
[refactoring] Return default values if provided in getters. Also return dates as strings
2011-04-12 16:13:38 +01:00
842bea8433
[refactoring] Remove all geo related functions as they now have it own extension ckanext-spatial
2011-04-11 19:19:09 +01:00
280dce1626
[refactoring] Add status info to harvest sources. Updated dict functions and UI.
2011-04-11 16:30:56 +01:00
3c505693ff
[refactoring] Do not delete sources, just inactivate them. Also don't delete jobs.
2011-04-08 17:07:19 +01:00
2588352bc5
[refactoring] Simplify model relations
2011-04-08 16:48:29 +01:00
56d5acc867
[refactoring] Add code to handle queuing and the new IHarvester interface. Add
...
new commands in the CLI to start the queue consumers and fire the harvesting
process.
2011-04-06 12:45:00 +01:00
4023bb7222
[refactoring] Use the common functions in the web interface.
...
Not yet implemented in create and edit harvest source as they use the DGU forms API.
Also TODO, think of what report info is needed in the listing and details page.
2011-04-05 13:39:23 +01:00
3d32a18802
[refactoring] Return dictionaries from the common functions, and use them in the CLI"
2011-04-05 12:55:58 +01:00
e819a68f21
[refactoring] Move common functions to lib. Adapt the CLI to use these common functions.
2011-04-05 11:53:39 +01:00
d35f86f559
Stop harvesting job if the package extent could not be saved. Still shows an ugly SA exception
2011-03-29 17:23:49 +01:00
57631a8931
Use the projection from harvested documents. Add a configure option to define the database projection
2011-03-18 17:42:43 +00:00
4036858ac9
Add a CLI command to create or update the geometries for package extents
2011-03-18 15:44:40 +00:00
David Raznick
Adrià Mercader
Friedrich Lindenberg