[jira] [Resolved] (HIVE-24838) Reduce FS creation in Warehouse::getDnsPath for object stores

["Rajesh Balamohan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-24838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rajesh Balamohan resolved HIVE-24838.
-------------------------------------
    Fix Version/s: 4.0.0
       Resolution: Fixed

Merged the PR. Thanks [~amagyar] .

> Reduce FS creation in Warehouse::getDnsPath for object stores
> -------------------------------------------------------------
>
>                 Key: HIVE-24838
>                 URL: https://issues.apache.org/jira/browse/HIVE-24838
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>            Assignee: Attila Magyar
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>         Attachments: Screenshot 2021-03-02 at 11.09.01 AM.png
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/master/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/Warehouse.java#L143]
>  
> Warehouse::getDnsPath gets invoked from multiple places (e.g getDatabase() etc). In certain cases like dynamic partition loads, lot of calls FS instantiation calls can be avoided for object stores.
> It would be good to check for BlobStorages and if so, it should be possible to avoid FS creation.
> [https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/common/BlobStorageUtils.java#L33]
>  
> !Screenshot 2021-03-02 at 11.09.01 AM.png|width=372,height=296!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)