You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2020/10/28 18:38:00 UTC

[jira] [Comment Edited] (HUDI-1319) Async Clean and Async Compaction - how will they work with metadata table updates - check multi writer

    [ https://issues.apache.org/jira/browse/HUDI-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222343#comment-17222343 ] 

Vinoth Chandar edited comment on HUDI-1319 at 10/28/20, 6:37 PM:
-----------------------------------------------------------------

We need some parts of HUDI-845 for this? 


was (Author: vc):
We need some parts of HUDI-845 for this. 

> Async Clean and Async Compaction - how will they work with metadata table updates - check multi writer
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-1319
>                 URL: https://issues.apache.org/jira/browse/HUDI-1319
>             Project: Apache Hudi
>          Issue Type: Sub-task
>            Reporter: Prashant Wason
>            Assignee: Prashant Wason
>            Priority: Major
>
> Two cases:
> 1. Async process / pipeline (Handle out-of-process Clean and Compaction)
> 2. AsyncClean service
> NOTE: We need to decide where to log update for async operations. If we do it at Async operation completion then we may end up in multi writer scenario.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)