You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Rajesh Balamohan (Jira)" <ji...@apache.org> on 2020/04/23 08:27:00 UTC
[jira] [Updated] (HIVE-23281)
ObjectStore::convertToStorageDescriptor can be optimised to reduce calls to
DB for ACID tables
[ https://issues.apache.org/jira/browse/HIVE-23281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajesh Balamohan updated HIVE-23281:
------------------------------------
Description:
[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java#L1980]
[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java#L1982]
SkewInfo, bucketCols, ordering etc are not needed for ACID tables. It may be good to check for transactional tables and get rid these calls in table lookups.
This should help in reducing DB calls.
!image-2020-04-23-13-56-17-210.png|width=669,height=485!
was:
[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java#L1980]
[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java#L1982]
SkewInfo, bucketCols, ordering etc are not needed for ACID tables. It may be good to check for transactional tables and get rid these calls in table lookups.
This should help in reducing DB calls.
> ObjectStore::convertToStorageDescriptor can be optimised to reduce calls to DB for ACID tables
> ----------------------------------------------------------------------------------------------
>
> Key: HIVE-23281
> URL: https://issues.apache.org/jira/browse/HIVE-23281
> Project: Hive
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Priority: Major
> Attachments: image-2020-04-23-13-56-17-210.png
>
>
> [https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java#L1980]
>
> [https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java#L1982]
>
> SkewInfo, bucketCols, ordering etc are not needed for ACID tables. It may be good to check for transactional tables and get rid these calls in table lookups.
>
> This should help in reducing DB calls.
> !image-2020-04-23-13-56-17-210.png|width=669,height=485!
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)