You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Toshihiko Uchida (Jira)" <ji...@apache.org> on 2019/11/04 19:20:00 UTC

[jira] [Commented] (HIVE-22453) Describe table unnecessarily fetches partitions

    [ https://issues.apache.org/jira/browse/HIVE-22453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966935#comment-16966935 ] 

Toshihiko Uchida commented on HIVE-22453:
-----------------------------------------

HIVE-21485 also reports a performance issue on the describe table command, and tries to resolve it by introducing a runtime parameter that determines whether partition statistics are displayed or not.
In the case of the describe table command without EXTENDED and FORMATTED, however, partitions should not be fetched regardless of the parameter.

> Describe table unnecessarily fetches partitions
> -----------------------------------------------
>
>                 Key: HIVE-22453
>                 URL: https://issues.apache.org/jira/browse/HIVE-22453
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 3.1.2, 2.3.6
>            Reporter: Toshihiko Uchida
>            Assignee: Toshihiko Uchida
>            Priority: Minor
>         Attachments: HIVE-22453.patch
>
>
> The simple describe table command without EXTENDED and FORMATTED (i.e., DESCRIBE table_name) fetches all partitions when no partition is specified, although it does not display partition statistics in nature.
> The command should not fetch partitions since it can take a long time for a large amount of partitions.
> For instance, in our environment, the command takes around 8 seconds for a table with 8760 (24 * 365) partitions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)