You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2020/03/22 15:17:00 UTC
[jira] [Commented] (IMPALA-9451)
custom_cluster.test_hive_text_codec_interop.TestTextInterop.test_hive_impala_interop
fails on CDP build
[ https://issues.apache.org/jira/browse/IMPALA-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064313#comment-17064313 ]
ASF subversion and git services commented on IMPALA-9451:
---------------------------------------------------------
Commit 01684ab3aa03645d3e0ab77026816f015b8aee23 in impala's branch refs/heads/master from Fang-Yu Rao
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=01684ab ]
IMPALA-9191 (part 1): Allow Impala to run tests without Sentry
This patch adds an environment variable DISABLE_SENTRY to allow Impala
to run tests without Sentry. Specifically, we start up Sentry only when
$DISABLE_SENTRY does not evaluate to true. The corresponding Sentry FE
and E2E tests will also be skipped if $DISABLE_SENTRY is true.
Moreover, in this patch we will set DISABLE_SENTRY to true if
$USE_CDP_HIVE evaluates to true, allowing one to only test Impala's
authorization with Ranger when support for Sentry is dropped after we
switch to the CDP Hive.
Note that in this patch we also change the way we generate
hive-site.xml when $DISABLE_SENTRY is true. To be more precise, when
generating hive-site.xml, we do not add the Sentry server as a metastore
event listener if $DISABLE_SENTRY is true. Recall that both CDH Hive and
CDP Hive would make an RPC to the registered listeners every time after
the method of create_database_core() in HiveMetaStore.java is called,
which happens when Hive instead of Impala is used to create a database,
e.g., when some databases in the TPC-DS data set are created during the
execution of create-load-data.sh. Thus the removal of Sentry as an event
listener is necessary when $DISABLE_SENTRY is true in that it prevents
the HiveMetaStore from keeping connecting to the Sentry server that is
not online, which could make create-load-data.sh time out.
Testing:
Except for two currently known issues of IMPALA-9513 AND IMPALA-9451,
verified this patch passes the exhaustive tests in the DEBUG build
- when $USE_CDP_HIVE is false, and
- when $USE_CDP_HIVE is true.
Change-Id: Ifa3f1840a77a7b32310a5c8b78a2c26300ccb41e
Reviewed-on: http://gerrit.cloudera.org:8080/15505
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> custom_cluster.test_hive_text_codec_interop.TestTextInterop.test_hive_impala_interop fails on CDP build
> -------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-9451
> URL: https://issues.apache.org/jira/browse/IMPALA-9451
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Reporter: Tim Armstrong
> Assignee: Xiaomeng Zhang
> Priority: Blocker
> Labels: broken-build
>
> {noformat}
> custom_cluster.test_hive_text_codec_interop.TestTextInterop.test_hive_impala_interop
> assert [] == ['0\ttrue\t0\t0\t0\t0\t0\t0\...t01/01/09\t5\t2009\t1', ...] Right contains more items, first extra item: '0\ttrue\t0\t0\t0\t0\t0\t0\t01/01/09\t0\t2009\t1' Full diff: - [] + ['0\ttrue\t0\t0\t0\t0\t0\t0\t01/01/09\t0\t2009\t1', + '1\tfalse\t1\t1\t1\t10\t1.100000023841858\t10.1\t01/01/09\t1\t2009\t1', + '2\ttrue\t2\t2\t2\t20\t2.200000047683716\t20.2\t01/01/09\t2\t2009\t1', + '3\tfalse\t3\t3\t3\t30\t3.299999952316284\t30.3\t01/01/09\t3\t2009\t1', + '4\ttrue\t4\t4\t4\t40\t4.400000095367432\t40.4\t01/01/09\t4\t2009\t1', + '5\tfalse\t5\t5\t5\t50\t5.5\t50.5\t01/01/09\t5\t2009\t1', + '6\ttrue\t6\t6\t6\t60\t6.599999904632568\t60.59999999999999\t01/01/09\t6\t2009\t1', + '7\tfalse\t7\t7\t7\t70\t7.699999809265137\t70.7\t01/01/09\t7\t2009\t1', + '8\ttrue\t8\t8\t8\t80\t8.800000190734863\t80.8\t01/01/09\t8\t2009\t1', + '9\tfalse\t9\t9\t9\t90\t9.899999618530273\t90.89999999999999\t01/01/09\t9\t2009\t1', + '10\ttrue\t0\t0\t0\t0\t0\t0\t01/02/09\t0\t2009\t1', + '11\tfalse\t1\t1\t1\t10\t1.100000023841858\t10.1\t01/02/09\t1\t2009\t1', + '12\ttrue\t2\t2\t2\t20\t2.200000047683716\t20.2\t01/02/09\t2\t2009\t1', + '13\tfalse\t3\t3\t3\t30\t3.299999952316284\t30.3\t01/02/09\t3\t2009\t1', + '14\ttrue\t4\t4\t4\t40\t4.400000095367432\t40.4\t01/02/09\t4\t2009\t1', + '15\tfalse\t5\t5\t5\t50\t5.5\t50.5\t01/02/09\t5\t2009\t1', + '16\ttrue\t6\t6\t6\t60\t6.599999904632568\t60.59999999999999\t01/02/09\t6\t2009\t1', + '17\tfalse\t7\t7\t7\t70\t7.699999809265137\t70.7\t01/02/09\t7\t2009\t1',
> ...
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org