[jira] [Updated] (HIVE-28200) Improve get_partitions_by_filter/expr when partition limit enabled

["Zhihua Deng (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-28200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhihua Deng updated HIVE-28200:
-------------------------------
    Labels: hive-4.0.1-must pull-request-available  (was: pull-request-available)

> Improve get_partitions_by_filter/expr when partition limit enabled
> ------------------------------------------------------------------
>
>                 Key: HIVE-28200
>                 URL: https://issues.apache.org/jira/browse/HIVE-28200
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>            Reporter: Wechar
>            Assignee: Wechar
>            Priority: Major
>              Labels: hive-4.0.1-must, pull-request-available
>             Fix For: 4.1.0
>
>
> When {{hive.metastore.limit.partition.request}} is configured, HMS would get the matching partition counts before get the real partition objects. The count  could be a slow query if the input filter or expr is too complex.
> In this case, such slow filter will be executed in both counting partition numbers and fetching real partition objects, which harms the performance and backend DBMS.
> We can make an improvement by getting matched partition names firstly, and then check limit through the size of partition names, and finally get the partitions by the partition names.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)