You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/04/08 18:48:00 UTC

[jira] [Created] (HUDI-3833) We need to revisit MOR block merging sequence

Alexey Kudinkin created HUDI-3833:
-------------------------------------

             Summary: We need to revisit MOR block merging sequence
                 Key: HUDI-3833
                 URL: https://issues.apache.org/jira/browse/HUDI-3833
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Alexey Kudinkin
            Assignee: Alexey Kudinkin
             Fix For: 0.12.0


We need to revisit MOR block merging sequence and make sure that following invariants are upheld
 # Block have to be merged backward-pass (ie we first fetch all the blocks, and merge them in the reverse order of their timeline)
 # We should try to avoid having 2 merging sequences and instead consolidate on just one: right now we have "block + block", and "base + block", but we should be able to just get away with just the latter (this will simplify merging sequence quite substantially, for ex in respect to handling of deletions) 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)