You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2018/08/16 14:59:00 UTC
[jira] [Commented] (IMPALA-7452) test_disable_catalog_data_op s3
failiure
[ https://issues.apache.org/jira/browse/IMPALA-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16582644#comment-16582644 ]
ASF subversion and git services commented on IMPALA-7452:
---------------------------------------------------------
Commit 864be3e60dc1a9863607fbaa4d50c296c6873975 in impala's branch refs/heads/master from [~vercego]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=864be3e ]
IMPALA-7452: fix file check for test_disable_catalog_data_ops test
The test's regex did not handle s3 paths. The fix loosens the check
to allow for these paths.
Change-Id: I7408bc233714620f502af3b8c19400aa3bb1666c
Reviewed-on: http://gerrit.cloudera.org:8080/11243
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> test_disable_catalog_data_op s3 failiure
> ----------------------------------------
>
> Key: IMPALA-7452
> URL: https://issues.apache.org/jira/browse/IMPALA-7452
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.1.0
> Reporter: Michael Brown
> Assignee: Vuk Ercegovac
> Priority: Blocker
> Fix For: Impala 3.1.0
>
>
> [~vukercegovac] assigning this to you since you just added the test.
> {noformat}
> custom_cluster.test_disable_catalog_data_ops.TestDisableCatalogDataOps.test_disable_catalog_data_ops (from pytest)
> Error Message
> AssertionError: Expected 1 lines in file /data0/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/catalogd.impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com.jenkins.log.INFO.20180815-074632.10850 matching regex 'Avro schema, hdfs://localhost:20500//test-warehouse/avro_schemas/functional/tinytable.json, not loaded from fs: catalog data ops disabled.', but found 0 lines. Last line was: I0815 07:46:42.577656 11042 catalog-server.cc:251] A catalog update with 2 entries is assembled. Catalog version: 1138 Last sent catalog version: 1137
> Stacktrace
> custom_cluster/test_disable_catalog_data_ops.py:42: in test_disable_catalog_data_ops
> 'INFO', "Avro schema, "
> common/custom_cluster_test_suite.py:181: in assert_catalogd_log_contains
> self.assert_log_contains("catalogd", level, line_regex, expected_count)
> common/custom_cluster_test_suite.py:207: in assert_log_contains
> (expected_count, log_file_path, line_regex, found, line)
> E AssertionError: Expected 1 lines in file /data0/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/catalogd.impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com.jenkins.log.INFO.20180815-074632.10850 matching regex 'Avro schema, hdfs://localhost:20500//test-warehouse/avro_schemas/functional/tinytable.json, not loaded from fs: catalog data ops disabled.', but found 0 lines. Last line was:
> E I0815 07:46:42.577656 11042 catalog-server.cc:251] A catalog update with 2 entries is assembled. Catalog version: 1138 Last sent catalog version: 1137
> Standard Error
> 07:46:31 MainThread: Starting State Store logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/statestored.INFO
> 07:46:32 MainThread: Starting Catalog Service logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/catalogd.INFO
> 07:46:33 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad.INFO
> 07:46:34 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad_node1.INFO
> 07:46:35 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad_node2.INFO
> 07:46:38 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
> 07:46:38 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
> 07:46:38 MainThread: Waiting for num_known_live_backends=3. Current value: 0
> 07:46:39 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
> 07:46:39 MainThread: Waiting for num_known_live_backends=3. Current value: 1
> 07:46:40 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
> 07:46:40 MainThread: Waiting for num_known_live_backends=3. Current value: 2
> 07:46:41 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
> 07:46:41 MainThread: num_known_live_backends has reached value: 3
> 07:46:41 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25001
> 07:46:41 MainThread: num_known_live_backends has reached value: 3
> 07:46:41 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25002
> 07:46:41 MainThread: num_known_live_backends has reached value: 3
> 07:46:41 MainThread: Impala Cluster Running with 3 nodes (3 coordinators, 3 executors).
> MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
> MainThread: Getting metric: statestore.live-backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25010
> MainThread: Metric 'statestore.live-backends' has reached desired value: 4
> MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
> MainThread: num_known_live_backends has reached value: 3
> MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25001
> MainThread: num_known_live_backends has reached value: 3
> MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25002
> MainThread: num_known_live_backends has reached value: 3
> -- connecting to: localhost:21000
> -- executing against localhost:21000
> select count(*) from functional_avro.tinytable;
> MainThread: Started query e34ee6c7ae5915dc:ea0423dc00000000
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org