You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "leesf (Jira)" <ji...@apache.org> on 2019/09/04 03:25:00 UTC
[jira] [Commented] (HUDI-139) Compaction running twice due to
duplicate "map" transformation while finalizing compaction
[ https://issues.apache.org/jira/browse/HUDI-139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921918#comment-16921918 ]
leesf commented on HUDI-139:
----------------------------
Fixed via master: d860fb18b6248abfa911e6188d1105f2afc4e582
> Compaction running twice due to duplicate "map" transformation while finalizing compaction
> -------------------------------------------------------------------------------------------
>
> Key: HUDI-139
> URL: https://issues.apache.org/jira/browse/HUDI-139
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: Compaction
> Reporter: BALAJI VARADARAJAN
> Assignee: BALAJI VARADARAJAN
> Priority: Blocker
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Compaction is running twice due to duplicate map transformation that was added for finalization.
>
> The effect of this issue will be:
> 1.Potentially doubling compaction time
> 2.Metadata files ".commit" pointing to wrong data-files. Incremental-fsync is broken because of this.
>
> Another issue found by running deltastreamer in continuous mode.
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)