You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2020/10/28 18:38:00 UTC
[jira] [Comment Edited] (HUDI-1319) Async Clean and Async
Compaction - how will they work with metadata table updates - check multi
writer
[ https://issues.apache.org/jira/browse/HUDI-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222343#comment-17222343 ]
Vinoth Chandar edited comment on HUDI-1319 at 10/28/20, 6:37 PM:
-----------------------------------------------------------------
We need some parts of HUDI-845 for this?
was (Author: vc):
We need some parts of HUDI-845 for this.
> Async Clean and Async Compaction - how will they work with metadata table updates - check multi writer
> ------------------------------------------------------------------------------------------------------
>
> Key: HUDI-1319
> URL: https://issues.apache.org/jira/browse/HUDI-1319
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Prashant Wason
> Assignee: Prashant Wason
> Priority: Major
>
> Two cases:
> 1. Async process / pipeline (Handle out-of-process Clean and Compaction)
> 2. AsyncClean service
> NOTE: We need to decide where to log update for async operations. If we do it at Async operation completion then we may end up in multi writer scenario.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)