You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2022/03/31 21:40:00 UTC
[jira] [Commented] (IMPALA-11181) Improving performance of compaction checking
[ https://issues.apache.org/jira/browse/IMPALA-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515604#comment-17515604 ]
ASF subversion and git services commented on IMPALA-11181:
----------------------------------------------------------
Commit 38efbee29d1d225d0a68eb5a6216325e12e81acd in impala's branch refs/heads/master from Yu-Wen Lai
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=38efbee ]
IMPALA-11181: Improving performance of compaction checking
After HIVE-25753, we don't need to explicitly set all partitions' name
to get the latest compaction id. Besides, we can also send the last
compaction id over to HMS so that HMS will send back compaction info
only if there are newer compactions. In this way, we can avoid
unnecessary data transmitted between HMS and Catalogd.
Testing:
existing tests
Change-Id: I32e30ec418ad09bef862e61163539a910c96c44c
Reviewed-on: http://gerrit.cloudera.org:8080/18324
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Improving performance of compaction checking
> --------------------------------------------
>
> Key: IMPALA-11181
> URL: https://issues.apache.org/jira/browse/IMPALA-11181
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Yu-Wen Lai
> Assignee: Yu-Wen Lai
> Priority: Major
>
> After HIVE-25753, we don't need to explicitly set all partitions names for a table. Furthermore, we can send the last compaction id over to HMS and HMS will only send back information if there any newer compaction. In this way, we should be able to avoid unnecessary data be sent between HMS and Catalogd.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org