You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2019/10/16 18:30:00 UTC
[jira] [Commented] (IMPALA-9052) Events processor goes into error
state if there are events on blacklisted db or table
[ https://issues.apache.org/jira/browse/IMPALA-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953084#comment-16953084 ]
ASF subversion and git services commented on IMPALA-9052:
---------------------------------------------------------
Commit 6e32ca3617ba0d207b60850f0b78000f613d5f31 in impala's branch refs/heads/master from Vihang Karajgaonkar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=6e32ca3 ]
IMPALA-9052: Events processor should skip blacklisted database and table
IMPALA-8797 introduced a configuration which can blacklist certain
database and tables so that catalog never loads them. This is useful to
skip the Hive's internal book-keeping tables which are unreadable by
Impala (like Information schema and sys tables). However, if there are
events generated on such tables, the events processor goes into error
state because the database does not exist.
This patch adds support for ignoring blacklisted database and tables in
the events processor.
Testing: 1. Added a new test case which makes sure that events processor
is not in error state after receiving events on blacklisted tables and
dbs.
2. Ran MetastoreEventsProcessorTest
Change-Id: Ic5a53b722e6225e9cad9954f447f821c2c677e60
Reviewed-on: http://gerrit.cloudera.org:8080/14457
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Events processor goes into error state if there are events on blacklisted db or table
> -------------------------------------------------------------------------------------
>
> Key: IMPALA-9052
> URL: https://issues.apache.org/jira/browse/IMPALA-9052
> Project: IMPALA
> Issue Type: Bug
> Reporter: Vihang Karajgaonkar
> Assignee: Vihang Karajgaonkar
> Priority: Major
>
> IMPALA-8797 introduces a configuration to blacklist certain databases and tables so that Catalog never loads them. However, if there are new events generated on such database or tables, the Events Processor tries to process them. This causes events processor to go into error state (eg. when adding a table in a blacklisted db). Also, it nullifies the purpose of the configuration if Events processor is able to add/remove/refresh the tables on such database or tables.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org