You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Sagar Sumit (Jira)" <ji...@apache.org> on 2024/10/01 16:43:00 UTC

[jira] [Updated] (HUDI-7581) Handle multi-writer index update

     [ https://issues.apache.org/jira/browse/HUDI-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sagar Sumit updated HUDI-7581:
------------------------------
    Reviewers: Jonathan Vexler, Y Ethan Guo

> Handle multi-writer index update
> --------------------------------
>
>                 Key: HUDI-7581
>                 URL: https://issues.apache.org/jira/browse/HUDI-7581
>             Project: Apache Hudi
>          Issue Type: Task
>            Reporter: Sagar Sumit
>            Assignee: Sagar Sumit
>            Priority: Blocker
>             Fix For: 1.0.0
>
>   Original Estimate: 16h
>          Time Spent: 7h
>  Remaining Estimate: 9h
>
> [https://github.com/apache/hudi/pull/10860#discussion_r1534943496]
> It's possible that the log files due to the instant for which index is being updated got cleaned up by another writer (very aggressive cleaning policy). Without handling this scenario, update could fail with FileNotFoundException and block MDT update.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)