You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Raymond Xu (Jira)" <ji...@apache.org> on 2022/08/20 00:37:00 UTC
[jira] [Commented] (HUDI-3614) Fix Flink/JavaDeleteHelper deduplication logic
[ https://issues.apache.org/jira/browse/HUDI-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17582087#comment-17582087 ]
Raymond Xu commented on HUDI-3614:
----------------------------------
This was put on-hold due to perf concern from the refactoring.
> Fix Flink/JavaDeleteHelper deduplication logic
> ----------------------------------------------
>
> Key: HUDI-3614
> URL: https://issues.apache.org/jira/browse/HUDI-3614
> Project: Apache Hudi
> Issue Type: Bug
> Components: writer-core
> Reporter: Raymond Xu
> Assignee: liujinhui
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.13.0
>
>
> The logic in org.apache.hudi.table.action.commit.FlinkDeleteHelper#deduplicateKeys does not dedup correctly.
>
> Flink/JavaDeleteHelper should merge with HoodieDeleteHelper and change API to use HoodieData. The dedup logic will be fixed along the way.
> Have dedicated test class for HoodieDeleteHelper will be great.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)