You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2023/02/17 00:40:00 UTC

[jira] [Assigned] (HUDI-5817) Fix async indexer metadata writer to avoid eager rollback / cleaning

     [ https://issues.apache.org/jira/browse/HUDI-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo reassigned HUDI-5817:
-------------------------------

    Assignee: Ethan Guo

> Fix async indexer metadata writer to avoid eager rollback / cleaning
> --------------------------------------------------------------------
>
>                 Key: HUDI-5817
>                 URL: https://issues.apache.org/jira/browse/HUDI-5817
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: Ethan Guo
>            Assignee: Ethan Guo
>            Priority: Major
>
> Even though the async indexer metadata writer is configured to use LAZY failed write cleaning policy, there is other logic that can potentially roll back the delta commits from regular metadata writer, e.g., since heartbeats are disabled for regular MDT writes, failed write cleaning is going to rollback commits regardless.  We need to fix this so that the async indexer metadata writer does not touch other delta commits in the MDT.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)