[jira] [Created] (HIVE-23282) Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal

["Rajesh Balamohan (Jira)" <ji...@apache.org>]

Rajesh Balamohan created HIVE-23282:
---------------------------------------

             Summary: Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal
                 Key: HIVE-23282
                 URL: https://issues.apache.org/jira/browse/HIVE-23282
             Project: Hive
          Issue Type: Improvement
          Components: Metastore
            Reporter: Rajesh Balamohan
         Attachments: image-2020-04-23-14-07-06-077.png

ObjectStore::getPartitionsByExprInternal internally uses Table information for getting partitionKeys, table, catalog name.

 

For this, it ends up populating entire table data from DB (including skew column, parameters, sort, bucket cols etc). This makes it a lot more expensive call. It would be good to either have a lightweight object to have basic information or reduce the payload on Table object itself.

[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java#L3327]

[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java#L3669]

 

!image-2020-04-23-14-07-06-077.png|width=665,height=592!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)