GroupEntities and DispatchEntites are now merged in GroupEntitiesSparkJob #334

Manually merged
claudio.atzori merged 0 commits from merge_entities_job into beta 2023-10-02 11:25:28 +02:00

This is just a mere rewrite with no functional changes.
The layout of the intermediate checkpoint table with all grouped entities has been changed to exploit Parquet column pruning when generating per entity type tables.

This is just a mere rewrite with no functional changes. The layout of the intermediate checkpoint table with all grouped entities has been changed to exploit Parquet column pruning when generating per entity type tables.
giambattista.bloisi added 1 commit 2023-09-04 11:50:09 +02:00
giambattista.bloisi requested review from claudio.atzori 2023-09-04 11:50:16 +02:00
claudio.atzori manually merged commit dc86018a5f into beta 2023-10-02 11:25:28 +02:00
claudio.atzori deleted branch merge_entities_job 2023-10-02 11:25:33 +02:00
Sign in to join this conversation.
No reviewers
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#334
No description provided.