Add sparkExecutorMemoryOverhead workflow config to set off-heap memory for Spark actions. If not explicitly set it is defaulted to 1Gb #331

Merged
claudio.atzori merged 1 commits from consistencywf_memoryoverhead_conf into beta 2023-08-29 16:31:37 +02:00

This allows the consistency workflow to execute spark actions with configurable off-heap memory

This allows the consistency workflow to execute spark actions with configurable off-heap memory
giambattista.bloisi added 1 commit 2023-08-29 16:21:51 +02:00
giambattista.bloisi requested review from claudio.atzori 2023-08-29 16:22:00 +02:00
claudio.atzori merged commit 488d9a1cea into beta 2023-08-29 16:31:37 +02:00
claudio.atzori deleted branch consistencywf_memoryoverhead_conf 2023-08-29 16:31:37 +02:00
Sign in to join this conversation.
No reviewers
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#331
No description provided.