You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2018/06/08 23:02:00 UTC

[jira] [Commented] (HIVE-19838) simplify & fix ColumnizedDeleteEventRegistry load loop

    [ https://issues.apache.org/jira/browse/HIVE-19838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506667#comment-16506667 ] 

Sergey Shelukhin commented on HIVE-19838:
-----------------------------------------

[~ekoifman] [~teddy.choi] can you take a look? thnx

> simplify & fix ColumnizedDeleteEventRegistry load loop
> ------------------------------------------------------
>
>                 Key: HIVE-19838
>                 URL: https://issues.apache.org/jira/browse/HIVE-19838
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>            Priority: Major
>         Attachments: HIVE-19838.patch
>
>
> Apparently sometimes the delete count in ACID stats doesn't match what merger actually returns.
> It could be due to some deltas having duplicate deletes from parallel queries (I guess?) that are being squashed by the merger or some other reasons beyond my mortal comprehension.
> The loop assumes the merger will return the exact number of records, so it fails with array index exception. Also, it could actually be done in a single loop.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)