You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Eugene Koifman (JIRA)" <ji...@apache.org> on 2018/11/21 19:15:00 UTC
[jira] [Comment Edited] (HIVE-20941) Compactor produces a
delete_delta_x_y even if there are no input delete events
[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16695124#comment-16695124 ]
Eugene Koifman edited comment on HIVE-20941 at 11/21/18 7:14 PM:
-----------------------------------------------------------------
Actually, I just realized that there may some assumptions about delta and delete delta write ID ranges matching. Let me check on that first.
Specifically somewhere in {{AcidUtils.getAcidState()}} or somewhere in {{CompactorMR}} where it figures out what files to include in compaction.
was (Author: ekoifman):
Actually, I just realized that there may some assumptions about delta and delete delta write ID ranges matching. Let me check on that first.
> Compactor produces a delete_delta_x_y even if there are no input delete events
> ------------------------------------------------------------------------------
>
> Key: HIVE-20941
> URL: https://issues.apache.org/jira/browse/HIVE-20941
> Project: Hive
> Issue Type: Bug
> Components: Transactions
> Affects Versions: 3.0.0
> Reporter: Eugene Koifman
> Assignee: Igor Kryvenko
> Priority: Major
> Attachments: HIVE-20941.01.patch, HIVE-20941.02.patch
>
>
> see example in HIVE-20901
>
> Probably change logic in CompactorMR.CompactorMap.map() which creates delete event writer
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)