You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/04/08 18:49:00 UTC

[jira] [Closed] (HUDI-3830) We need to revisit MOR block merging sequence

     [ https://issues.apache.org/jira/browse/HUDI-3830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Kudinkin closed HUDI-3830.
---------------------------------
    Resolution: Duplicate

> We need to revisit MOR block merging sequence
> ---------------------------------------------
>
>                 Key: HUDI-3830
>                 URL: https://issues.apache.org/jira/browse/HUDI-3830
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Alexey Kudinkin
>            Assignee: Alexey Kudinkin
>            Priority: Blocker
>             Fix For: 0.12.0
>
>
> We need to revisit MOR block merging sequence and make sure that following invariants are upheld
>  # Block have to be merged backward-pass (ie we first fetch all the blocks, and merge them in the reverse order of their timeline)
>  # We should try to avoid having 2 merging sequences and instead consolidate on just one: right now we have "block + block", and "base + block", but we should be able to just get away with just the latter (this will simplify merging sequence quite substantially, for ex in respect to handling of deletions) 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)