You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Krisztian Kasa (Jira)" <ji...@apache.org> on 2021/12/10 10:57:00 UTC

[jira] [Resolved] (HIVE-25768) Extend query-level HMS cache lifetime beyond analysis stage

     [ https://issues.apache.org/jira/browse/HIVE-25768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Krisztian Kasa resolved HIVE-25768.
-----------------------------------
    Resolution: Fixed

Pushed to master. Thanks [~jfs] for the patch and [~scarlin] for review.

> Extend query-level HMS cache lifetime beyond analysis stage
> -----------------------------------------------------------
>
>                 Key: HIVE-25768
>                 URL: https://issues.apache.org/jira/browse/HIVE-25768
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>            Reporter: John Sherman
>            Assignee: John Sherman
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> HIVE-24176 added a HMS response cache to improve compilation times when metadata is requested multiple times. The cache gets destroyed after analysis. If we extend the lifetime of the cache beyond analysis it could be used to reduce HMS communication for other areas such as various exec hooks that inspect the metadata for a query.
> The impetus that motivated this change is specifically the Atlas hook which generates lineage information and makes HMS calls. These calls to HMS can add latency to query results.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)