[jira] [Updated] (HIVE-22122) TxnHandler.getValidWriteIdsForTable optimization for compacted tables

["Peter Vary (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-22122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Peter Vary updated HIVE-22122:
------------------------------
    Fix Version/s: 4.0.0
       Resolution: Fixed
           Status: Resolved  (was: Patch Available)

Pushed to master.
Thanks for the patch [~dkuzmenko]!

> TxnHandler.getValidWriteIdsForTable optimization for compacted tables
> ---------------------------------------------------------------------
>
>                 Key: HIVE-22122
>                 URL: https://issues.apache.org/jira/browse/HIVE-22122
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>            Reporter: Peter Vary
>            Assignee: Denys Kuzmenko
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>         Attachments: HIVE-22122.1.patch, HIVE-22122.2.patch
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> When we do not find open writes for the given validTxnList then we either:
>  # do not have any writes on the table - we can return writeIdHwm = 0, and no invalid/aborted writes;
>  # we have only compacted writes on the table - we can return writeIdHwm = nextWriteId -1, and no invalid/aborted;
>  # we have compacted writes and some invalid writes on the table - we can return the lowest invalid write as a writeIdHwm and set it as invalid.
> What the current code does instead is sending writeIdHwm = nextWriteId -1, and sending every write as invalid. This results the same response in case 1-2, but probably a longer list in case 3.
> So we have place for some optimizations



--
This message was sent by Atlassian Jira
(v8.3.4#803005)