You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Prashant Wason (Jira)" <ji...@apache.org> on 2020/10/14 08:31:00 UTC

[jira] [Assigned] (HUDI-1319) Async Clean and Async Compaction - how will they work with metadata table updates - check multi writer

     [ https://issues.apache.org/jira/browse/HUDI-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prashant Wason reassigned HUDI-1319:
------------------------------------

    Assignee: Prashant Wason

> Async Clean and Async Compaction - how will they work with metadata table updates - check multi writer
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-1319
>                 URL: https://issues.apache.org/jira/browse/HUDI-1319
>             Project: Apache Hudi
>          Issue Type: Sub-task
>            Reporter: Prashant Wason
>            Assignee: Prashant Wason
>            Priority: Major
>
> Two cases:
> 1. Async process / pipeline (Handle out-of-process Clean and Compaction)
> 2. AsyncClean service
> NOTE: We need to decide where to log update for async operations. If we do it at Async operation completion then we may end up in multi writer scenario.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)