You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2020/11/03 15:28:00 UTC

[jira] [Updated] (HUDI-1319) Make Async Operations (Clean, Compaction, Replace) work with metadata table

     [ https://issues.apache.org/jira/browse/HUDI-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinoth Chandar updated HUDI-1319:
---------------------------------
    Summary: Make Async Operations (Clean, Compaction, Replace) work with metadata table  (was: Async Clean and Async Compaction - how will they work with metadata table updates - check multi writer)

> Make Async Operations (Clean, Compaction, Replace) work with metadata table
> ---------------------------------------------------------------------------
>
>                 Key: HUDI-1319
>                 URL: https://issues.apache.org/jira/browse/HUDI-1319
>             Project: Apache Hudi
>          Issue Type: Sub-task
>            Reporter: Prashant Wason
>            Assignee: Vinoth Chandar
>            Priority: Major
>
> Two cases:
> 1. Async process / pipeline (Handle out-of-process Clean and Compaction)
> 2. AsyncClean service
> NOTE: We need to decide where to log update for async operations. If we do it at Async operation completion then we may end up in multi writer scenario.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)