Commit Graph

67 Commits

Author SHA1 Message Date
Adrià Mercader c697bc3350 Normalize https ports too (#736) 2011-05-09 18:47:30 +01:00
Adrià Mercader 5594f22be7 More robust URL checking (#736) 2011-05-09 14:03:46 +01:00
Adrià Mercader 0e56c0ab4f Abort pending jobs when removing sources 2011-05-05 17:13:07 +01:00
Adrià Mercader e0a1e5752d Fix redirects in view controller 2011-05-05 16:47:34 +01:00
Adrià Mercader 43453b6938 Show GUID on object errors 2011-04-19 17:16:25 +01:00
David Raznick c9d43b2e4d overide default create schema 2011-04-19 15:34:56 +01:00
Adrià Mercader e3bca3ceee Add first version of the CKAN harvester [#985] 2011-04-19 14:54:59 +01:00
Adrià Mercader b5aea2d863 Allow sources with existing URLs if the existing ones are inactive 2011-04-18 17:19:04 +01:00
james bc8caebc30 [packaging] Moved templates and publics into source 2011-04-18 08:49:25 +00:00
Adrià Mercader 7e75673cff Add function to edit harvest sources 2011-04-15 18:28:58 +01:00
Adrià Mercader e3a83ea14d Source URL not unique 2011-04-15 18:28:38 +01:00
Adrià Mercader 1edf984f1b Log an error if no harvester could be found for the source 2011-04-15 16:12:47 +01:00
Adrià Mercader d92b1df8c6 Only send harvesting jobs from active sources to queue 2011-04-15 15:50:32 +01:00
Adrià Mercader 5fb6512d82 Do not output messages when running the 'run' command 2011-04-15 15:35:19 +01:00
David Raznick 9018beeedb use create_all instead of create 2011-04-15 12:19:24 +01:00
Adrià Mercader a11480aa8f [refactoring] Use ckan.harvest for options in the ini file 2011-04-13 12:46:52 +01:00
Adrià Mercader 040e4d6956 [refactoring] Add a command to create the necessary tables in the database 2011-04-13 12:39:53 +01:00
Adrià Mercader 312e9b8209 [refactoring] Update view controller and templates 2011-04-12 16:15:14 +01:00
Adrià Mercader aaf7885f43 [refactoring] Return default values if provided in getters. Also return dates as strings 2011-04-12 16:13:38 +01:00
Adrià Mercader a234d6ff6a [refactoring] Remove unneeded interface 2011-04-12 10:11:02 +01:00
Adrià Mercader 842bea8433 [refactoring] Remove all geo related functions as they now have it own extension ckanext-spatial 2011-04-11 19:19:09 +01:00
Adrià Mercader 280dce1626 [refactoring] Add status info to harvest sources. Updated dict functions and UI. 2011-04-11 16:30:56 +01:00
Adrià Mercader e2faa14b8d [refactoring] Save gathering starting and finishing time 2011-04-11 16:29:47 +01:00
Adrià Mercader 3c505693ff [refactoring] Do not delete sources, just inactivate them. Also don't delete jobs. 2011-04-08 17:07:19 +01:00
Adrià Mercader 2588352bc5 [refactoring] Simplify model relations 2011-04-08 16:48:29 +01:00
Adrià Mercader 9465d59d3a [refactoring] Remove old harvesting controller. This functionality now lives on ckanext-inspire 2011-04-08 15:54:33 +01:00
Adrià Mercader b38fc57ec5 [refactoring] Changes in the queue code and the IHarvester interface" 2011-04-07 16:59:11 +01:00
Adrià Mercader 90ae9d27db [refactoring] Tweaks in the model and a setup function to create the tables 2011-04-07 16:57:36 +01:00
Adrià Mercader 56d5acc867 [refactoring] Add code to handle queuing and the new IHarvester interface. Add
new commands in the CLI to start the queue consumers and fire the harvesting
process.
2011-04-06 12:45:00 +01:00
Adrià Mercader 4023bb7222 [refactoring] Use the common functions in the web interface.
Not yet implemented in create and edit harvest source as they use the DGU forms API.
Also TODO, think of what report info is needed in the listing and details page.
2011-04-05 13:39:23 +01:00
Adrià Mercader 3d32a18802 [refactoring] Return dictionaries from the common functions, and use them in the CLI" 2011-04-05 12:55:58 +01:00
Adrià Mercader dca4ff328f [refactoring] Add missing column in error table 2011-04-05 12:53:36 +01:00
Adrià Mercader a4d93e4ad3 [refactoring] Add a reference to objects from jobs 2011-04-05 12:36:27 +01:00
Adrià Mercader e819a68f21 [refactoring] Move common functions to lib. Adapt the CLI to use these common functions. 2011-04-05 11:53:39 +01:00
Adrià Mercader ce86cfde1b [refactoring] Clean up the model definitions 2011-04-05 11:51:59 +01:00
Adrià Mercader d3f06b7b4f [refactoring] Changes in model 2011-03-30 16:55:42 +01:00
Adrià Mercader 0396838e36 [refactoring] First version of the new model 2011-03-30 14:42:59 +01:00
Adrià Mercader d35f86f559 Stop harvesting job if the package extent could not be saved. Still shows an ugly SA exception 2011-03-29 17:23:49 +01:00
Adrià Mercader 95623b0f7a Set format as WMS if the harvested document refers to a service 2011-03-29 16:24:14 +01:00
james gardner e855d2ad9a Moving the extension points code to package as a .deb file 2011-03-28 15:52:43 +01:00
Adrià Mercader 6a877666bd Use the URL of a WMS type resource instead of the package URL 2011-03-28 09:40:17 +01:00
David Read d6e35bc5cb [controllers,tests]: Added requirement to be sysadmin for all controller operations. Provided test for this and some useful test infrastrure. 2011-03-25 17:01:26 +00:00
Adrià Mercader 61e23196bf Better handling of unauthorized access 2011-03-23 17:02:02 +00:00
Adrià Mercader 0cf2c7e7ac Nicer design for the WMS preview 2011-03-23 10:00:39 +00:00
Adrià Mercader 32a180f39c First version of the WMS viewer. The viewer is based on OpenLayers, which is used to parse the GetCapabilities response and build a map with the layers found. 2011-03-22 17:33:58 +00:00
Adrià Mercader 57631a8931 Use the projection from harvested documents. Add a configure option to define the database projection 2011-03-18 17:42:43 +00:00
Adrià Mercader 35537bbbcb Update help in CLI 2011-03-18 15:48:08 +00:00
Adrià Mercader 4036858ac9 Add a CLI command to create or update the geometries for package extents 2011-03-18 15:44:40 +00:00
Adrià Mercader b83443af4a Create geometry when harvesting documents with geographic extent 2011-03-18 13:40:49 +00:00
Adrià Mercader 51102c9330 Add spatial search based on PostGIS for packages with geographic extent 2011-03-18 12:05:16 +00:00