You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Rajesh Balamohan (Jira)" <ji...@apache.org> on 2021/03/02 06:05:00 UTC

[jira] [Created] (HIVE-24838) Reduce FS creation in Warehouse::getDnsPath for object stores

Rajesh Balamohan created HIVE-24838:
---------------------------------------

             Summary: Reduce FS creation in Warehouse::getDnsPath for object stores
                 Key: HIVE-24838
                 URL: https://issues.apache.org/jira/browse/HIVE-24838
             Project: Hive
          Issue Type: Improvement
            Reporter: Rajesh Balamohan
         Attachments: Screenshot 2021-03-02 at 11.09.01 AM.png

[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/Warehouse.java#L143]

 

Warehouse::getDnsPath gets invoked from multiple places (e.g getDatabase() etc). In certain cases like dynamic partition loads, lot of calls FS instantiation calls can be avoided for object stores.

It would be good to check for BlobStorages and if so, it should be possible to avoid FS creation.

[https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/common/BlobStorageUtils.java#L33]

 

!Screenshot 2021-03-02 at 11.09.01 AM.png|width=372,height=296!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)