You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Vineet Garg (Jira)" <ji...@apache.org> on 2020/01/14 10:57:00 UTC
[jira] [Commented] (HIVE-22366) Multiple metastore calls for same
table and constraints during planning
[ https://issues.apache.org/jira/browse/HIVE-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015006#comment-17015006 ]
Vineet Garg commented on HIVE-22366:
------------------------------------
This patch should prevent multiple unnecessary calls
* multiple calls to get_table
* multiple calls to get_table_statistics
> Multiple metastore calls for same table and constraints during planning
> -----------------------------------------------------------------------
>
> Key: HIVE-22366
> URL: https://issues.apache.org/jira/browse/HIVE-22366
> Project: Hive
> Issue Type: Improvement
> Components: Query Planning
> Reporter: Vineet Garg
> Assignee: Vineet Garg
> Priority: Major
> Attachments: HIVE-22366.1.patch, HIVE-22366.2.patch, HIVE-22366.3.patch, HIVE-22366.4.patch
>
>
> e.g. for a simple query like
> {code:sql}
> explain select count(i) from test2 group by j limit 3;
> {code}
> planner makes the following calls:
> {code}
> 2019-10-17T22:44:49,892 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : tbl=hive.default.test2
> 2019-10-17T22:44:49,908 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.test2
> 2019-10-17T22:44:49,910 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=test2
> 2019-10-17T22:44:49,911 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive.default.test2
> 2019-10-17T22:44:49,913 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.test2
> 2019-10-17T22:44:49,979 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_partitions : tbl=hive.default.test2
> 2019-10-17T22:44:49,997 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_aggr_stats_for: table=hive.default.test2
> 2019-10-17T22:44:50,014 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_table : tbl=hive.default.test2
> 2019-10-17T22:44:50,023 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.test2
> 2019-10-17T22:44:50,024 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=test2
> 2019-10-17T22:44:50,025 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive.default.test2
> 2019-10-17T22:44:50,026 INFO [812910d4-bc6a-450c-aa8b-3487b4edceab main] HiveMetaStore.audit: ugi=vgarg ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.test2
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)