docker-ckan/doc/harvesters/README.md

1018 B

Harvesters. Configuration examples

[!TIP] For more information about scheming cat harvesters, see docs.

This subdirectory contains examples of JSON configuration files for harvesters. These configurations include various settings such as API version, tags, groups, and field mappings. These JSON files are used to configure the harvesting process from different sources.

For example, a configuration might include settings like:

  • api_version
  • clean_tags
  • default_groups
  • default_tags
  • default_extras
  • override_extras
  • organizations_filter_include
  • groups_filter_include
  • allow_private_datasets
  • user
  • api_key
  • read_only
  • remote_groups
  • remote_orgs
  • default_group_dicts
  • schema
  • allow_harvest_datasets
  • field_mapping_schema_version
  • dataset_field_mapping
  • distribution_field_mapping

These settings help in defining how the data should be harvested, processed, and stored.