You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Vihang Karajgaonkar (Jira)" <ji...@apache.org> on 2021/10/18 20:30:00 UTC

[jira] [Commented] (HIVE-25616) Backport HIVE-24741 to Hive 2, 3

    [ https://issues.apache.org/jira/browse/HIVE-25616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430210#comment-17430210 ] 

Vihang Karajgaonkar commented on HIVE-25616:
--------------------------------------------

Makes sense to backport to hive 2 and hive 3. The patch is pretty straight-forward and low-risk.

> Backport HIVE-24741 to Hive 2, 3 
> ---------------------------------
>
>                 Key: HIVE-25616
>                 URL: https://issues.apache.org/jira/browse/HIVE-25616
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Neelesh Srinivas Salian
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> HIVE-24741 adds a major improvement to the `{{get_partitions_ps_with_auth}}` API that is used by Spark to retrieve all partitions of the table.
> This has caused problems in Spark 3 - running on a Hive 2.3.x metastore. 
> Patched this in my org and it helped get past large partitioned tables having problems reading metadata through Spark.
> [~vihangk1], thoughts?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)