You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/05/07 23:53:00 UTC
[jira] [Commented] (IMPALA-9365) Run hive-server2, YARN etc on
non-HDFS test envs
[ https://issues.apache.org/jira/browse/IMPALA-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341073#comment-17341073 ]
ASF subversion and git services commented on IMPALA-9365:
---------------------------------------------------------
Commit 9253e0a9e7751a471ddfde754767ca8f56b14ec4 in impala's branch refs/heads/master from Amogh Margoor
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=9253e0a ]
IMPALA-10683: Skip test 'test_double_precision' for non-HDFS test env
TestHdfsParquetTableWriter.test_double_parser uses Hive statement.
IMPALA-9365 describes why HS2 is not started on non-HDFS test env
and therefore we need to skip this test for such test environments.
Hive statement is being used as Impala's result are converted
by python to string. In both HS2 and beewax, it only handles float
precision uptil 16 decimal digits and test needs 17.
Change-Id: I1a3225ba563ec4d0514b489c3a1daf8291ca1445
Reviewed-on: http://gerrit.cloudera.org:8080/17397
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Run hive-server2, YARN etc on non-HDFS test envs
> ------------------------------------------------
>
> Key: IMPALA-9365
> URL: https://issues.apache.org/jira/browse/IMPALA-9365
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Reporter: Tim Armstrong
> Priority: Major
>
> We don't start yarn unless HDFS is also running - https://github.com/apache/impala/blob/master/testdata/cluster/admin#L70.
> We also don't start various other services, including hive server 2 https://github.com/apache/impala/blob/master/testdata/bin/run-all.sh#L79 .
> This has been a persistent pain point for testing, because we can't load data and can't run many tests against those filesystems (see all the SkipIfS3 , etc annotations). Even worse, it can result in hard-to-debug failure modes like IMPALA-9345.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org