D-Net
/
dnet-hadoop
13
4
Fork 10
Code Issues 14 Pull Requests 8 Projects 2 Releases 1 Wiki Activity

Master branch updates from beta July 2023 #317

Merged
claudio.atzori merged 9 commits from master_july23 into master 2023-07-18 18:22:05 +02:00
Conversation 0 Commits 9 Files Changed 220 +18830 -8230
claudio.atzori commented 2023-06-27 14:34:49 +02:00
Owner
Copy Link

This PR brings to the master branch a selection of changes from the beta branch

  • Graph model version to be adopted 3.17.1

Pipeline

  • stats workflows (update & promote), build the DBs on the OCEAN cluster and synch them on the Impala cluster
  • bulk tagging workflow: negative constraints & refactoring as a single step (instead of producing several sequential materialisations)
  • avoid duplicated organisation PIDs
  • graph cleaning: PID-type based cleaning rules, extended to all the entity types & refactoring as a single step (instead of producing several sequential materialisations)
  • fulltext url available at the instance level & syntactically validated
  • usage counts defined for datasources and projects
  • The DOIBoost creation workflow

Contents

  • Import the citations links also from Crossref & MAG
This PR brings to the master branch a selection of changes from the beta branch * Graph model version to be adopted `3.17.1` #### Pipeline * stats workflows (update & promote), build the DBs on the OCEAN cluster and synch them on the Impala cluster * bulk tagging workflow: negative constraints & refactoring as a single step (instead of producing several sequential materialisations) * avoid duplicated organisation PIDs * graph cleaning: PID-type based cleaning rules, extended to all the entity types & refactoring as a single step (instead of producing several sequential materialisations) * fulltext url available at the instance level & syntactically validated * usage counts defined for datasources and projects * The DOIBoost creation workflow #### Contents * Import the citations links also from Crossref & MAG
claudio.atzori added 1 commit 2023-06-27 14:34:49 +02:00
claudio.atzori added 4 commits 2023-06-28 13:34:03 +02:00
miriam.baglioni added 1 commit 2023-07-01 16:07:29 +02:00
claudio.atzori added 3 commits 2023-07-13 15:03:36 +02:00
aedd279f78 Updates Promotion DBs 
- Add a step for promoting the splitted monitor DBs
claudio.atzori merged commit 373a5f2c83 into master 2023-07-18 18:22:05 +02:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature / refactoring

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
RDGraph

EOSC Research Discovery Graph

  
RSAC

EOSC Research Software APIs and Connectors

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
RDGraph
RSAC
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#317
No description provided.
Delete Branch "master_july23"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?