You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2022/03/03 05:06:00 UTC
[jira] [Commented] (IMPALA-10999) Flakiness in TestAsyncLoadData.test_async_load
[ https://issues.apache.org/jira/browse/IMPALA-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500501#comment-17500501 ]
Quanlong Huang commented on IMPALA-10999:
-----------------------------------------
Saw a failure of this test, but with a different error message: [https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/5353/]. Probably a different issue.
Stacktrace
{code:java}
metadata/test_load.py:197: in test_async_load
assert(exec_end_state == finished_state)
E assert 'RUNNING_STATE' == 'FINISHED_STATE'
E - RUNNING_STATE
E + FINISHED_STATE
{code}
Standard Error
{code:java}
SET client_identifier=metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution:False|protocol:hs2|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_row;
-- connecting to: localhost:21000
-- connecting to localhost:21050 with impyla
-- 2022-03-03 01:53:45,393 INFO MainThread: Closing active operation
-- connecting to localhost:28000 with impyla
-- 2022-03-03 01:53:45,412 INFO MainThread: Closing active operation
SET client_identifier=metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution:False|protocol:hs2|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_row;
SET sync_ddl=False;
-- executing against localhost:21000
DROP DATABASE IF EXISTS `test_async_load_931cdbf9` CASCADE;
-- 2022-03-03 01:53:45,425 INFO MainThread: Started query 8743893bd81a4d63:1591d8f500000000
SET client_identifier=metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution:False|protocol:hs2|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_row;
SET sync_ddl=False;
-- executing against localhost:21000
CREATE DATABASE `test_async_load_931cdbf9`;
-- 2022-03-03 01:53:50,938 INFO MainThread: Started query cb4623bf93ee5f8e:962a7a8d00000000
-- 2022-03-03 01:53:50,993 INFO MainThread: Created database "test_async_load_931cdbf9" for test ID "metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution: False | protocol: hs2 | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none]"
-- connecting to localhost:21050 with impyla
-- 2022-03-03 01:53:51,005 INFO MainThread: Closing active operation
-- executing against localhost:21000
create table test_async_load_931cdbf9.test_load_nopart_hs2_False like functional.alltypesnopart location '/test-warehouse/test_load_staging_hs2_False';
-- 2022-03-03 01:53:54,753 INFO MainThread: Started query 2e43b424099880fb:6fa0871500000000
-- getting log for operation: <tests.common.impala_connection.OperationHandle object at 0x7f893738e690>
-- getting runtime profile operation: <tests.common.impala_connection.OperationHandle object at 0x7f893738e690>
-- closing query for operation handle: <tests.common.impala_connection.OperationHandle object at 0x7f893738e690>
-- 2022-03-03 01:53:54,876 INFO MainThread: Closing active operation
-- getting log for operation: <tests.common.impala_connection.OperationHandle object at 0x7f893738e650>
-- getting runtime profile operation: <tests.common.impala_connection.OperationHandle object at 0x7f893738e650>
-- closing query for operation handle: <tests.common.impala_connection.OperationHandle object at 0x7f893738e650>
-- 2022-03-03 01:53:54,880 INFO MainThread: Closing active operation
-- executing against Impala at localhost:21050
load data inpath '/test-warehouse/test_load_staging_hs2_False' into table test_async_load_931cdbf9.test_load_nopart_hs2_False;
Started query 4b488fd194d4ffcb:bf2b035800000000
-- getting state for operation: <tests.common.impala_connection.OperationHandle object at 0x7f893738e690>
-- getting state for operation: <tests.common.impala_connection.OperationHandle object at 0x7f893738e690>
-- getting state for operation: <tests.common.impala_connection.OperationHandle object at 0x7f893738e690>
-- getting state for operation: <tests.common.impala_connection.OperationHandle object at 0x7f893738e690>
-- closing query for operation handle: <tests.common.impala_connection.OperationHandle object at 0x7f893738e690>
-- 2022-03-03 01:53:58,981 INFO MainThread: Closing active operation
-- closing connection to: localhost:21050
{code}
> Flakiness in TestAsyncLoadData.test_async_load
> ----------------------------------------------
>
> Key: IMPALA-10999
> URL: https://issues.apache.org/jira/browse/IMPALA-10999
> Project: IMPALA
> Issue Type: Bug
> Reporter: Bikramjeet Vig
> Assignee: Qifan Chen
> Priority: Major
> Labels: broken-build, flaky-test
>
> This test failed in one of the GVO's recently. [Link|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/15097/testReport/junit/metadata.test_load/TestAsyncLoadData/test_async_load_enable_async_load_data_execution__False___protocol__beeswax___exec_option____batch_size___0___num_nodes___0___disable_codegen_rows_threshold___0___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__text_none_/]
>
> {noformat}
> Error Message
> metadata/test_load.py:197: in test_async_load assert(exec_end_state == finished_state) E assert 3 == 4
> Stacktrace
> metadata/test_load.py:197: in test_async_load
> assert(exec_end_state == finished_state)
> E assert 3 == 4
> Standard Error
> SET client_identifier=metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution:False|protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node;
> -- connecting to: localhost:21000
> -- connecting to localhost:21050 with impyla
> -- 2021-10-30 01:38:55,203 INFO MainThread: Closing active operation
> -- connecting to localhost:28000 with impyla
> -- 2021-10-30 01:38:55,237 INFO MainThread: Closing active operation
> SET client_identifier=metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution:False|protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node;
> SET sync_ddl=False;
> -- executing against localhost:21000
> DROP DATABASE IF EXISTS `test_async_load_ff1c20a7` CASCADE;
> -- 2021-10-30 01:38:55,281 INFO MainThread: Started query df43a0ff6165a9eb:33b0d69f00000000
> SET client_identifier=metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution:False|protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node;
> SET sync_ddl=False;
> -- executing against localhost:21000
> CREATE DATABASE `test_async_load_ff1c20a7`;
> -- 2021-10-30 01:39:01,148 INFO MainThread: Started query e64bd28a97339b44:e76523a800000000
> -- 2021-10-30 01:39:01,253 INFO MainThread: Created database "test_async_load_ff1c20a7" for test ID "metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution: False | protocol: beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none]"
> SET client_identifier=metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution:False|protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node;
> -- connecting to: localhost:21000
> -- executing against localhost:21000
> create table test_async_load_ff1c20a7.test_load_nopart_beeswax_False like functional.alltypesnopart location '/test-warehouse/test_load_staging_beeswax_False';
> -- 2021-10-30 01:39:09,435 INFO MainThread: Started query e543635533874c9e:fe238ca900000000
> -- executing against localhost:21000
> select count(*) from test_async_load_ff1c20a7.test_load_nopart_beeswax_False;
> -- 2021-10-30 01:39:13,178 INFO MainThread: Started query 5c4969e81b1b614b:26754a2200000000
> SET client_identifier=metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution:False|protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node;
> -- executing against localhost:21000
> use functional;
> -- 2021-10-30 01:39:13,413 INFO MainThread: Started query d340e3650cba2d6f:a35a14bb00000000
> SET client_identifier=metadata/test_load.py::TestAsyncLoadData::()::test_async_load[enable_async_load_data_execution:False|protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node;
> SET batch_size=0;
> SET num_nodes=0;
> SET disable_codegen_rows_threshold=0;
> SET disable_codegen=False;
> SET abort_on_error=1;
> SET enable_async_load_data_execution=False;
> SET debug_action=CRS_DELAY_BEFORE_LOAD_DATA:SLEEP@3000;
> SET exec_single_node_rows_threshold=0;
> -- executing async: localhost:21000
> load data inpath '/test-warehouse/test_load_staging_beeswax_False' into table test_async_load_ff1c20a7.test_load_nopart_beeswax_False;
> -- 2021-10-30 01:39:16,472 INFO MainThread: Started query ac404aa17515170d:cbd45efd00000000
> -- getting state for operation: <tests.common.impala_connection.OperationHandle object at 0x7f9426833990>
> -- getting state for operation: <tests.common.impala_connection.OperationHandle object at 0x7f9426833990>
> -- getting state for operation: <tests.common.impala_connection.OperationHandle object at 0x7f9426833990>
> -- getting state for operation: <tests.common.impala_connection.OperationHandle object at 0x7f9426833990>
> -- closing query for operation handle: <tests.common.impala_connection.OperationHandle object at 0x7f9426833990>
> -- closing connection to: localhost:21000
> {noformat}
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org