You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2019/08/29 12:45:00 UTC
[jira] [Commented] (IMPALA-8579) Ignore trivial alter events
[ https://issues.apache.org/jira/browse/IMPALA-8579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918568#comment-16918568 ]
ASF subversion and git services commented on IMPALA-8579:
---------------------------------------------------------
Commit 08ecb6d28cd7794a654f66fe41bb8ae727bc1a3e in impala's branch refs/heads/master from Anurag Mantripragada
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=08ecb6d ]
IMPALA-8579: Ignore trivial alter table/partition events.
Hive generates certain trivial alter events for eg: change only
"transient_lastDdlTime". This is seen in the alter events
accompanying an INSERT event. MetastoreEventProcessor should ignore
such events as these trivial properties are not used by Impala
and they cause unnecessary invalidates/refreshes. This change will
also potentially reduce the likelihood of IMPALA-8877 as back to back
invalidates after INSERT operations are avoided.
Testing:
Added tests respectively to testPartitionEvents() and
testAlterTableEvent() in MetastoreEventProcessorTest class.
Change-Id: I01a59d5170accc014f76f14eb526d96ddcf61f76
Reviewed-on: http://gerrit.cloudera.org:8080/14145
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Ignore trivial alter events
> ---------------------------
>
> Key: IMPALA-8579
> URL: https://issues.apache.org/jira/browse/IMPALA-8579
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Vihang Karajgaonkar
> Assignee: Anurag Mantripragada
> Priority: Major
> Labels: catalog-v2
>
> Certain alter table and alter partition events are actually just to update the {{lastaccesstime}}. We should ignore such alter events to avoid unnecessary refresh/invalidates.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org