You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/04/08 18:48:00 UTC
[jira] [Created] (HUDI-3829) We need to revisit MOR block merging sequence
Alexey Kudinkin created HUDI-3829:
-------------------------------------
Summary: We need to revisit MOR block merging sequence
Key: HUDI-3829
URL: https://issues.apache.org/jira/browse/HUDI-3829
Project: Apache Hudi
Issue Type: Bug
Reporter: Alexey Kudinkin
Assignee: Alexey Kudinkin
Fix For: 0.12.0
We need to revisit MOR block merging sequence and make sure that following invariants are upheld
# Block have to be merged backward-pass (ie we first fetch all the blocks, and merge them in the reverse order of their timeline)
# We should try to avoid having 2 merging sequences and instead consolidate on just one: right now we have "block + block", and "base + block", but we should be able to just get away with just the latter (this will simplify merging sequence quite substantially, for ex in respect to handling of deletions)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)