feat: ✨ add new CKAN extensions and environment settings

Added new extensions GoogleAnalytics and Keycloak, updated the .env example file and Dockerfile.dev to include essential configuration for CKAN extensions. These changes ensure the CKAN instance includes relevant tools for better analytics and authentication support.

.env.example

@@ -117,7 +117,7 @@ CKAN__SITE_DESCRIPTION="ckan-docker *spatial Open Data portal"
 CKAN__SITE_INTRO_TEXT="[#en#][![ckan-docker-spatial](https://img.shields.io/badge/ckan_docker_spatial-CKAN_${CKAN_VERSION}-brightgreen?style=social&logo=github#center)](https://github.com/mjanez/ckan-docker)\n[`ckan-docker *spatial`](https://github.com/mjanez/ckan-docker) is a ready-to-use development environment for [CKAN](https://github.com/ckan/ckan), the world’s leading open-source data portal platform.[#es#][![ckan-docker-spatial](https://img.shields.io/badge/ckan_docker_spatial-CKAN_${CKAN_VERSION}-brightgreen?style=social&logo=github#center)](https://github.com/mjanez/ckan-docker)\n[`ckan-docker *spatial`](https://github.com/mjanez/ckan-docker) es un entorno de desarrollo listo para usar para [CKAN](https://github.com/ckan/ckan), la plataforma de portales de datos de código abierto líder en el mundo."
 CKAN__SITE_ABOUT=${CKAN__SITE_INTRO_TEXT}
 # Custom licenses that are aligned with DCAT-AP (Also works with DEV Mode)
-LICENSES_GROUP_URL=file://${APP_DIR}/src/ckanext-schemingdcat/ckanext/schemingdcat/public/static/licenses.json
+CKAN___LICENSES_GROUP_URL=file://${APP_DIR}/src/ckanext-schemingdcat/ckanext/schemingdcat/public/static/licenses.json
 CKAN___BEAKER__SESSION__SECRET=CHANGE_ME
 # See https://docs.ckan.org/en/latest/maintaining/configuration.html#api-token-settings
 CKAN___API_TOKEN__JWT__ENCODE__SECRET=string:CHANGE_ME
@@ -168,7 +168,7 @@ CKAN__LOCALE_ORDER="en es pt_BR ja it cs_CZ ca fr el sv sr sr@latin no sk fi ru
 CKAN__LOCALES_OFFERED="en es pt_BR ja it cs_CZ ca fr el sv sr sr@latin no sk fi ru de pl nl bg ko_KR hu sa sl lv"
 
 # Extensions
-CKAN__PLUGINS="activity stats image_view video_view audio_view webpage_view text_view datatables_view resourcedictionary datastore xloader spatial_metadata spatial_query spatial_harvest_metadata_api csw_harvester waf_harvester doc_harvester resource_proxy geo_view geojson_view wmts_view shp_view dcat dcat_rdf_harvester dcat_json_harvester dcat_json_interface schemingdcat schemingdcat_datasets schemingdcat_groups schemingdcat_organizations schemingdcat_ckan_harvester schemingdcat_xls_harvester harvest pdf_view pages fluent envvars"
+CKAN__PLUGINS="activity stats image_view video_view audio_view webpage_view text_view datatables_view resourcedictionary datastore xloader spatial_metadata spatial_query spatial_harvest_metadata_api csw_harvester waf_harvester doc_harvester resource_proxy geo_view geojson_view wmts_view shp_view dcat dcat_rdf_harvester dcat_json_harvester dcat_json_interface schemingdcat schemingdcat_datasets schemingdcat_groups schemingdcat_organizations schemingdcat_ckan_harvester schemingdcat_xls_harvester harvest pdf_view pages fluent googleanalytics keycloak d4science envvars"
 
 # ckanext-harvest
 CKAN__HARVEST__MQ__TYPE=redis

ckan/Dockerfile.dev

@@ -6,54 +6,72 @@ ENV APP_DIR=/srv/app \
     TZ=UTC \
     SRC_EXTENSIONS_DIR=/srv/app/src_extensions
 
+# requirements.txt files fixed until next releases
+COPY req_fixes req_fixes
+
 # Set working directory
 WORKDIR ${APP_DIR}
+
+# CKAN configuration & extensions
+## XLoader - 1.0.1-stable (mjanez/Forked fixed version) ##
+## Harvest - v1.5.6 (Worker with supervisor) ##
+## GoogleAnalytics  ##
+## KeyCloak  ##
+## Geoview - v0.2.0 ##
+## Spatial - v2.1.1 ##
+## DCAT - v1.8.0 (Latest stable version of ckanext-dcat with minor fixes) ##
+## Scheming - release-3.0.0 ##
+## Resource dictionary - v1.0.1 (mjanez/Fixed version) ##
+## Pages - v0.5.2 ##
+## PDFView - 0.0.8 ##
+## Fluent - v1.0.1  (mjanez/Forked stable version) ##
+## Scheming DCAT - v4.0.0 (mjanez/GeoDCAT-AP/NTI-RISP extended version) ##
 RUN echo ${TZ} > /etc/timezone && \
     if ! [ /usr/share/zoneinfo/${TZ} -ef /etc/localtime ]; then cp /usr/share/zoneinfo/${TZ} /etc/localtime; fi && \
     # Install patch utility
     apt-get update && \
     apt-get install -y patch && \
+    # Install CKAN extensions
+    echo "ckan/ckanext-xloader" && \
+    pip3 install --no-cache-dir -e git+https://github.com/mjanez/ckanext-xloader.git@1.0.1-stable#egg=ckanext-xloader && \
+    pip3 install --no-cache-dir -r ${APP_DIR}/src/ckanext-xloader/requirements.txt && \
+    pip3 install --no-cache-dir -U requests[security] && \
+    echo "ckan/ckanext-harvest" && \
+    pip3 install --no-cache-dir -e git+https://github.com/ckan/ckanext-harvest.git@v1.5.6#egg=ckanext-harvest && \
+    pip3 install --no-cache-dir -r ${APP_DIR}/src/ckanext-harvest/requirements.txt && \
+    echo "ckan/ckanext-geoview" && \
+    pip3 install --no-cache-dir -e git+https://github.com/ckan/ckanext-geoview.git@v0.2.0#egg=ckanext-geoview && \
+    echo "ckan/ckanext-spatial" && \
+    pip3 install --no-cache-dir -e git+https://github.com/ckan/ckanext-spatial.git@v2.1.1#egg=ckanext-spatial && \
+    pip3 install --no-cache-dir -r ${APP_DIR}/req_fixes/ckanext-spatial/requirements.txt && \
+    echo "mjanez/ckanext-dcat (GeoDCAT-AP extended version)" && \
+    pip3 install --no-cache-dir -e git+https://github.com/mjanez/ckanext-dcat.git@v1.8.0#egg=ckanext-dcat && \
+    pip3 install --no-cache-dir -r ${APP_DIR}/src/ckanext-dcat/requirements.txt && \
+    echo "ckan/ckanext-scheming" && \
+    pip3 install --no-cache-dir -e git+https://github.com/ckan/ckanext-scheming.git@release-3.0.0#egg=ckanext-scheming && \
+    echo "mjanez/ckanext-resourcedictionary" && \
+    pip3 install --no-cache-dir -e git+https://github.com/mjanez/ckanext-resourcedictionary.git@v1.0.1#egg=ckanext-resourcedictionary && \
+    echo "ckan/ckanext-pages" && \
+    pip3 install --no-cache-dir -e git+https://github.com/ckan/ckanext-pages.git@v0.5.2#egg=ckanext-pages && \
+    echo "ckan/ckanext-pdfview" && \
+    pip3 install --no-cache-dir -e git+https://github.com/ckan/ckanext-pdfview.git@0.0.8#egg=ckanext-pdfview && \
+    echo "mjanez/ckanext-fluent" && \
+    pip3 install --no-cache-dir -e git+https://github.com/mjanez/ckanext-fluent.git@v1.0.1#egg=ckanext-fluent && \
+    echo "mjanez/ckanext-schemingdcat" && \
+    pip3 install --no-cache-dir -e git+https://github.com/mjanez/ckanext-schemingdcat.git@v4.0.0#egg=ckanext_schemingdcat && \
+    pip3 install --no-cache-dir -r ${APP_DIR}/src/ckanext-schemingdcat/requirements.txt && \
+    echo "ckan/ckanext-googleanalytics" && \
+    pip3 install --no-cache-dir -e git+https://github.com/ckan/ckanext-googleanalytics.git@master#egg=ckanext-googleanalytics && \
+    pip3 install --no-cache-dir -r ${APP_DIR}/src/ckanext-googleanalytics/requirements.txt && \
+    echo "ckan/ckanext-keycloak" && \
+    pip3 install --no-cache-dir -e git+https://github.com/keitaroinc/ckanext-keycloak.git#egg=ckanext-keycloak && \
+    pip3 install --no-cache-dir -r ${APP_DIR}/src/ckanext-keycloak/requirements.txt && \
+    echo "ckan/ckanext-geonetwork" && \
+    pip3 install --no-cache-dir -e git+https://github.com/geosolutions-it/ckanext-geonetwork#egg=ckanext-geonetwork && \
     # Remove system cache
     apt-get clean && \
     rm -rf /var/lib/apt/lists/*
 
-# Install any extensions needed by your CKAN instance
-# - Make sure to add the plugins to CKAN__PLUGINS in the .env file
-# - Also make sure all provide all extra configuration options, either by:
-#   * Adding them to the .env file (check the ckanext-envvars syntax for env vars), or
-#   * Adding extra configuration scripts to /docker-entrypoint.d folder) to update
-#      the CKAN config file (ckan.ini) with the `ckan config-tool` command
-#
-# See README > Extending the base images for more details
-#
-# For instance:
-#
-###TODO: XLoader ###
-# RUN pip3 install -e 'git+https://github.com/ckan/ckanext-xloader.git@master#egg=ckanext-xloader' && \ 
-#     pip3 install -r ${APP_DIR}/src/ckanext-xloader/requirements.txt && \
-#     pip3 install -U requests[security]
-
-###TODO: ckanext-visualize
-#https://github.com/keitaroinc/ckanext-visualize
-
-###TODO datapreview error
-# 2023-03-19 12:54:42,311 WARNI [ckan.lib.datapreview] Plugin for view t could not be found
-# 2023-03-19 12:54:42,313 WARNI [ckan.lib.datapreview] Plugin for view e could not be found
-# 2023-03-19 12:54:42,314 WARNI [ckan.lib.datapreview] Plugin for view x could not be found
-# 2023-03-19 12:54:42,315 WARNI [ckan.lib.datapreview] Plugin for view t could not be found
-# https://github.com/ckan/ckan/search?q=datapreview&type=issues
-
-# ###TODO: SPARQL Interface - Adapt to Py3###
-# RUN echo "mjanez/sparql (Fixed version)" && \
-#     pip3 install -e git+https://github.com/mjanez/ckanext-sparql.git#egg=ckanext-sparql  && \
-#     pip3 install -r ${APP_DIR}/src/ckanext-sparql/requirements.txt && \
-#         # update CKAN config with ckanext-sparql parameters
-#         ckan config-tool ${CKAN_INI} "ckanext.sparql.endpoint_url=''" && \
-#         ckan config-tool ${CKAN_INI} "ckanext.sparql.hide_endpoint_url=''"
-
-# Clone the extension(s) your are writing for your own project in the `src` folder
-# to get them mounted in this image at runtime
-
 # Used to configure the container environment by setting environment variables, creating users, running initialization scripts, .etc
 COPY docker-entrypoint.d/* /docker-entrypoint.d/