D-Net
/
dnet-hadoop
15
4
Fork 10
Code Issues 14 Pull Requests 10 Projects 2 Releases 1 Wiki Activity

Add sparkExecutorMemoryOverhead workflow config to set off-heap memory for Spark actions. If not explicitly set it is defaulted to 1Gb #331

Merged
claudio.atzori merged 1 commits from consistencywf_memoryoverhead_conf into beta 2023-08-29 16:31:37 +02:00
Conversation 0 Commits 1 Files Changed 2 +16 -4
giambattista.bloisi commented 2023-08-29 16:21:50 +02:00
Member
Copy Link

This allows the consistency workflow to execute spark actions with configurable off-heap memory

This allows the consistency workflow to execute spark actions with configurable off-heap memory
giambattista.bloisi added 1 commit 2023-08-29 16:21:51 +02:00
giambattista.bloisi requested review from claudio.atzori 2023-08-29 16:22:00 +02:00
claudio.atzori merged commit 488d9a1cea into beta 2023-08-29 16:31:37 +02:00
claudio.atzori deleted branch consistencywf_memoryoverhead_conf 2023-08-29 16:31:37 +02:00
Sign in to join this conversation.
Reviewers
No reviewers
claudio.atzori
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature / refactoring

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
RDGraph

EOSC Research Discovery Graph

  
RSAC

EOSC Research Software APIs and Connectors

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
RDGraph
RSAC
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#331
No description provided.
Delete Branch "consistencywf_memoryoverhead_conf"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?