[jira] [Assigned] (HUDI-9341) Add ordering value to RLI partition

["sivabalan narayanan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan reassigned HUDI-9341:
-----------------------------------------

    Assignee: sivabalan narayanan

> Add ordering value to RLI partition
> -----------------------------------
>
>                 Key: HUDI-9341
>                 URL: https://issues.apache.org/jira/browse/HUDI-9341
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: metadata, writer-core
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Major
>             Fix For: 1.1.0
>
>
> For now, when we add records to log files in data table, to generate RLI records, we avoid reading older log files/entire file slice to account for deletes w/ lower ordering value. 
> One way we could solve this is to store the ordering value in RLI partition. And so, while reading records from log file, while merging w/ previous value in RLI we can use that to determine the final resolved state. 
>  
> this means, we have to upgrade the schema for RLI. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)