Commit Graph

575 Commits

Author SHA1 Message Date
Adrià Mercader e3a83ea14d Source URL not unique 2011-04-15 18:28:38 +01:00
Adrià Mercader 1edf984f1b Log an error if no harvester could be found for the source 2011-04-15 16:12:47 +01:00
Adrià Mercader d92b1df8c6 Only send harvesting jobs from active sources to queue 2011-04-15 15:50:32 +01:00
Adrià Mercader f492ed9c7a Update README with harvesting interface description and instructions for running the jobs 2011-04-15 15:36:53 +01:00
Adrià Mercader 5fb6512d82 Do not output messages when running the 'run' command 2011-04-15 15:35:19 +01:00
David Raznick 9018beeedb use create_all instead of create 2011-04-15 12:19:24 +01:00
Adrià Mercader a11480aa8f [refactoring] Use ckan.harvest for options in the ini file 2011-04-13 12:46:52 +01:00
Adrià Mercader 040e4d6956 [refactoring] Add a command to create the necessary tables in the database 2011-04-13 12:39:53 +01:00
Adrià Mercader 312e9b8209 [refactoring] Update view controller and templates 2011-04-12 16:15:14 +01:00
Adrià Mercader aaf7885f43 [refactoring] Return default values if provided in getters. Also return dates as strings 2011-04-12 16:13:38 +01:00
Adrià Mercader a234d6ff6a [refactoring] Remove unneeded interface 2011-04-12 10:11:02 +01:00
Adrià Mercader 842bea8433 [refactoring] Remove all geo related functions as they now have it own extension ckanext-spatial 2011-04-11 19:19:09 +01:00
Adrià Mercader 280dce1626 [refactoring] Add status info to harvest sources. Updated dict functions and UI. 2011-04-11 16:30:56 +01:00
Adrià Mercader e2faa14b8d [refactoring] Save gathering starting and finishing time 2011-04-11 16:29:47 +01:00
Adrià Mercader 3c505693ff [refactoring] Do not delete sources, just inactivate them. Also don't delete jobs. 2011-04-08 17:07:19 +01:00
Adrià Mercader 2588352bc5 [refactoring] Simplify model relations 2011-04-08 16:48:29 +01:00
Adrià Mercader 9465d59d3a [refactoring] Remove old harvesting controller. This functionality now lives on ckanext-inspire 2011-04-08 15:54:33 +01:00
Adrià Mercader b38fc57ec5 [refactoring] Changes in the queue code and the IHarvester interface" 2011-04-07 16:59:11 +01:00
Adrià Mercader 90ae9d27db [refactoring] Tweaks in the model and a setup function to create the tables 2011-04-07 16:57:36 +01:00
Adrià Mercader 56d5acc867 [refactoring] Add code to handle queuing and the new IHarvester interface. Add
new commands in the CLI to start the queue consumers and fire the harvesting
process.
2011-04-06 12:45:00 +01:00
ww f3c84a6dba mention requirements explicitly in setup.py 2011-04-05 22:39:33 +01:00
ww adbadffcdf merge 2011-04-05 22:32:36 +01:00
ww 3ce7cf2dc5 documentation tweak 2011-04-05 22:31:49 +01:00
Adrià Mercader 4023bb7222 [refactoring] Use the common functions in the web interface.
Not yet implemented in create and edit harvest source as they use the DGU forms API.
Also TODO, think of what report info is needed in the listing and details page.
2011-04-05 13:39:23 +01:00
Adrià Mercader 3d32a18802 [refactoring] Return dictionaries from the common functions, and use them in the CLI" 2011-04-05 12:55:58 +01:00
Adrià Mercader dca4ff328f [refactoring] Add missing column in error table 2011-04-05 12:53:36 +01:00
Adrià Mercader a4d93e4ad3 [refactoring] Add a reference to objects from jobs 2011-04-05 12:36:27 +01:00
Adrià Mercader e819a68f21 [refactoring] Move common functions to lib. Adapt the CLI to use these common functions. 2011-04-05 11:53:39 +01:00
Adrià Mercader ce86cfde1b [refactoring] Clean up the model definitions 2011-04-05 11:51:59 +01:00
Adrià Mercader 4220f67507 Move Gemini tests frm ckan core to ckanext-harvest (#1030) 2011-04-04 14:34:41 +01:00
Adrià Mercader 65c81a3014 Add more information in save extent exceptions 2011-04-04 14:31:54 +01:00
Adrià Mercader d3f06b7b4f [refactoring] Changes in model 2011-03-30 16:55:42 +01:00
Adrià Mercader 0396838e36 [refactoring] First version of the new model 2011-03-30 14:42:59 +01:00
Adrià Mercader d35f86f559 Stop harvesting job if the package extent could not be saved. Still shows an ugly SA exception 2011-03-29 17:23:49 +01:00
Adrià Mercader 95623b0f7a Set format as WMS if the harvested document refers to a service 2011-03-29 16:24:14 +01:00
james gardner e855d2ad9a Moving the extension points code to package as a .deb file 2011-03-28 15:52:43 +01:00
Adrià Mercader 6a877666bd Use the URL of a WMS type resource instead of the package URL 2011-03-28 09:40:17 +01:00
David Read d6e35bc5cb [controllers,tests]: Added requirement to be sysadmin for all controller operations. Provided test for this and some useful test infrastrure. 2011-03-25 17:01:26 +00:00
Adrià Mercader 61e23196bf Better handling of unauthorized access 2011-03-23 17:02:02 +00:00
Adrià Mercader a50cae77cf Fix some design issues in IE. To make it look perfect, the OL LayerSwitcher control has to be modified 2011-03-23 13:38:01 +00:00
Adrià Mercader 0ebe3c7a07 Update README and license notices 2011-03-23 10:20:40 +00:00
Adrià Mercader 0cf2c7e7ac Nicer design for the WMS preview 2011-03-23 10:00:39 +00:00
Adrià Mercader 32a180f39c First version of the WMS viewer. The viewer is based on OpenLayers, which is used to parse the GetCapabilities response and build a map with the layers found. 2011-03-22 17:33:58 +00:00
Adrià Mercader 16641741ff Update README with srid config option 2011-03-18 17:46:47 +00:00
Adrià Mercader 57631a8931 Use the projection from harvested documents. Add a configure option to define the database projection 2011-03-18 17:42:43 +00:00
Adrià Mercader 35537bbbcb Update help in CLI 2011-03-18 15:48:08 +00:00
Adrià Mercader 4036858ac9 Add a CLI command to create or update the geometries for package extents 2011-03-18 15:44:40 +00:00
Adrià Mercader 38150cca47 Update README with the new API call 2011-03-18 13:53:25 +00:00
Adrià Mercader b83443af4a Create geometry when harvesting documents with geographic extent 2011-03-18 13:40:49 +00:00
Adrià Mercader 51102c9330 Add spatial search based on PostGIS for packages with geographic extent 2011-03-18 12:05:16 +00:00