You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2020/10/28 18:37:00 UTC
[jira] [Commented] (HUDI-1319) Async Clean and Async Compaction -
how will they work with metadata table updates - check multi writer
[ https://issues.apache.org/jira/browse/HUDI-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222343#comment-17222343 ]
Vinoth Chandar commented on HUDI-1319:
--------------------------------------
We need some parts of HUDI-845 for this.
> Async Clean and Async Compaction - how will they work with metadata table updates - check multi writer
> ------------------------------------------------------------------------------------------------------
>
> Key: HUDI-1319
> URL: https://issues.apache.org/jira/browse/HUDI-1319
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Prashant Wason
> Assignee: Prashant Wason
> Priority: Major
>
> Two cases:
> 1. Async process / pipeline (Handle out-of-process Clean and Compaction)
> 2. AsyncClean service
> NOTE: We need to decide where to log update for async operations. If we do it at Async operation completion then we may end up in multi writer scenario.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)