You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2023/01/12 01:36:00 UTC

[jira] [Closed] (HUDI-5430) Fix multi-writer handling w/ rollback blocks in MOR table (log record reader)

     [ https://issues.apache.org/jira/browse/HUDI-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan closed HUDI-5430.
-------------------------------------
    Resolution: Not A Problem

> Fix multi-writer handling w/ rollback blocks in MOR table (log record reader)
> -----------------------------------------------------------------------------
>
>                 Key: HUDI-5430
>                 URL: https://issues.apache.org/jira/browse/HUDI-5430
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: reader-core
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Blocker
>             Fix For: 0.13.0
>
>
> Sample log blocks and commits
>  
> lb1_c1, lb2_c2, lb3_c3, lb4_c4, lb5_rb_c3, lb6_c5.
>  
> lb3 is expected to be considered invalid. but our current scan does not treat it as invalid. While parsing the rollback block, we just check for the previous log block for matching timestamp. since it does not match, we treat lb5_rb block as invalid and move on.
>  
> in case of multi-writer this is definitely feasible. so we should fix this.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)