You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Stamatis Zampetakis (Jira)" <ji...@apache.org> on 2022/06/01 11:18:00 UTC

[jira] [Resolved] (HIVE-25936) ValidWriteIdList & table id are sometimes missing when requesting partitions by name via HS2

     [ https://issues.apache.org/jira/browse/HIVE-25936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stamatis Zampetakis resolved HIVE-25936.
----------------------------------------
    Fix Version/s: 4.0.0-alpha-1
       Resolution: Fixed

The bug reported here was fixed by the cleanup done in HIVE-25935 so I am marking this JIRA as fixed.

The PR contains some useful refactoring and tests but I will track them down under new PRs/JIRAs.

> ValidWriteIdList & table id are sometimes missing when requesting partitions by name via HS2
> --------------------------------------------------------------------------------------------
>
>                 Key: HIVE-25936
>                 URL: https://issues.apache.org/jira/browse/HIVE-25936
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Stamatis Zampetakis
>            Assignee: Stamatis Zampetakis
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0-alpha-1
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> According to HIVE-24743 the table id and {{ValidWriteIdList}} are important for keeping HMS remote metadata cache consistent. Although HIVE-24743 attempted to pass the write id list and table id in every call to HMS it failed to do so completely. For those partitions not handled in the batch logic, the [metastore call|https://github.com/apache/hive/blob/4b7a948e45fd88372fef573be321cda40d189cc7/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L4161] in {{Hive#getPartitionsByName}} method does not pass the table id and write id list.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)