CatalogueRevamping
/
harvester-d4science
14
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update harvester to v1.5.6 #2

Merged
a.fabrizio0a806 merged 116 commits from change_logic_schema into main 2024-12-20 11:11:50 +01:00
Conversation 0 Commits 116 Files Changed 52 +568 -658
a.fabrizio0a806 commented 2024-12-20 09:17:24 +01:00
Member
Copy Link

Update harvester plugin to v1.5.6 (that is the version written inside the Dockerfile).

D4Science Customization are implemented too.

Update harvester plugin to v1.5.6 (that is the version written inside the Dockerfile). D4Science Customization are implemented too.
a.fabrizio0a806 added 116 commits 2024-12-20 09:17:25 +01:00
e8362c4616 Use unicode_safe validator in schema 
CKAN core no longer supports builtin functions as validators.
Requires ckantoolkit>=0.0.7 for CKAN 2.7 support
8a9885a04e
Merge pull request #498 from NCAR/check-email-exists 
Check 'email' field existence before use
f5e4e1c093
Update ckanext/harvest/logic/action/get.py 
Co-authored-by: Adrià Mercader <amercadero@gmail.com>
a35f095ac1 Use requirements.txt instead of pip-requirements.txt 
To match the vast majority of other extensions. pip-requiremetns.txt has
been kept as a symlink
98edcd3ad7 Bump pyopenssl 
To fix this failure on the CI tests:

```
   File "/__w/ckanext-harvest/ckanext-harvest/ckanext/harvest/harvesters/ckanharvester.py", line 7, in <module>
    from urllib3.contrib import pyopenssl
  File "/usr/lib/python3.9/site-packages/urllib3/contrib/pyopenssl.py", line 50, in <module>
    import OpenSSL.SSL
  File "/usr/lib/python3.9/site-packages/OpenSSL/__init__.py", line 8, in <module>
    from OpenSSL import crypto, SSL
  File "/usr/lib/python3.9/site-packages/OpenSSL/crypto.py", line 1550, in <module>
    class X509StoreFlags(object):
  File "/usr/lib/python3.9/site-packages/OpenSSL/crypto.py", line 1570, in X509StoreFlags
    CB_ISSUER_CHECK = _lib.X509_V_FLAG_CB_ISSUER_CHECK
AttributeError: module 'lib' has no attribute 'X509_V_FLAG_CB_ISSUER_CHECK'
```
63e55cdeb2
Apply only to versions with CSRF 
Co-authored-by: Adrià Mercader <amercadero@gmail.com>
10e50a709b
Merge pull request #517 from GSA/datagov-2022-12-21 
added unescape for email text body to avoid encoded characters
74a8b2fdfe
Merge pull request #519 from GSA/sort-ho-id 
pick the right harvest_object_id if there are multiple
10c2fecec3 Do not update extra in pkg_dict if it already exist. 
This is a responsibility of the package. We are skiping any override since users will expect the behaviour of the custom logic added in package schema and validators.
5451308316
Merge pull request #521 from ckan/support-harvest-field-root-schema 
Do not duplicate harvest_extras if exist in root schema
89a98d7ff5
Merge pull request #522 from GSA/403-forbidden 
Use 403 when actions are forbidden, not 401
8f7917fbfb
Merge pull request #523 from ckan/fix-routing-error 
Fix url_for routing to point to harvester blueprint.
47100351e7
Merge pull request #529 from GovDataOfficial/fix-search-index-rebuild 
Fix a problem with data-dictization of lists to fix search-index rebuild
02aeaf4243
Merge pull request #533 from GovDataOfficial/fix-harvest-error-dictization 
Adapt template to latest changes in harvest job error dictization
d0f70f71cd fix: ⚡ add unicode _safe 
update logic/schema.py using harvest v.1.5.6
m.battistini approved these changes 2024-12-20 09:39:20 +01:00
a.fabrizio0a806 merged commit 0ffd487ae7 into main 2024-12-20 11:11:49 +01:00
Sign in to join this conversation.
Reviewers
No reviewers
m.battistini
Labels
Clear labels
No items
No Label
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: CatalogueRevamping/harvester-d4science#2
No description provided.
Delete Branch "change_logic_schema"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?