You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2019/01/28 20:38:00 UTC

[jira] [Commented] (IMPALA-8118) ASAN build failure: query_test/test_scanners.py

    [ https://issues.apache.org/jira/browse/IMPALA-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16754340#comment-16754340 ] 

Paul Rogers commented on IMPALA-8118:
-------------------------------------

Originally added to IMPALA-8132:

EE tests failed, Impalad apparently crashed, when running {{query_test/test_scanners.py}}.

Partial ASAN error messages:

{noformat}
==119129==ERROR: AddressSanitizer: use-after-poison on address 0x631004d5918c at pc 0x000002013e2c bp 0x7f9b3cb4a640 sp 0x7f9b3cb4a638
READ of size 1 at 0x631004d5918c thread T107558
    #0 0x2013e2b in impala::Tuple::IsNull(impala::NullIndicatorOffset const&) const /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/runtime/tuple.h:241:13
    #1 0x2809df1 in impala::AggFnEvaluator::SerializeOrFinalize(impala::Tuple*, impala::SlotDescriptor const&, impala::Tuple*, void*) /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exprs/agg-fn-evaluator.cc:393:29
    #2 0x27755e8 in impala::AggFnEvaluator::Finalize(std::vector<impala::AggFnEvaluator*, std::allocator<impala::AggFnEvaluator*> > const&, impala::Tuple*, impala::Tuple*) /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exprs/agg-fn-evaluator.h:307:15
{noformat}

> ASAN build failure: query_test/test_scanners.py
> -----------------------------------------------
>
>                 Key: IMPALA-8118
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8118
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 3.1.0
>            Reporter: Paul Rogers
>            Assignee: Lars Volker
>            Priority: Blocker
>              Labels: broken-build
>             Fix For: Impala 3.1.0
>
>
> Build of latest master, with ASAN, failed with the following error, which to my newbie eyes looks like a connection failure:
> {noformat}
> 05:42:04 =================================== FAILURES ===================================
> 05:42:04  TestQueriesTextTables.test_data_source_tables[protocol: beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none] 
> 05:42:04 [gw5] linux2 -- Python 2.7.5 /data/jenkins/workspace/impala-cdh6.x-core-asan/repos/Impala/bin/../infra/python/env/bin/python
> 05:42:04 query_test/test_queries.py:174: in test_data_source_tables
> 05:42:04     self.run_test_case('QueryTest/data-source-tables', vector)
> 05:42:04 common/impala_test_suite.py:472: in run_test_case
> 05:42:04     result = self.__execute_query(target_impalad_client, query, user=user)
> ...
> 05:42:04     handle = self.execute_query_async(query_string, user=user)
> 05:42:04 beeswax/impala_beeswax.py:351: in execute_query_async
> 05:42:04     handle = self.__do_rpc(lambda: self.imp_service.query(query,))
> 05:42:04 beeswax/impala_beeswax.py:512: in __do_rpc
> 05:42:04     raise ImpalaBeeswaxException(self.__build_error_message(e), e)
> 05:42:04 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
> 05:42:04 E    INNER EXCEPTION: <class 'thrift.transport.TTransport.TTransportException'>
> 05:42:04 E    MESSAGE: TSocket read 0 bytes
> 05:42:04 ----------------------------- Captured stderr call -----------------------------
> ...
> 05:42:04 -- executing against localhost:21000
> 05:42:04 select *
> 05:42:04 from alltypes_datasource
> 05:42:04 where float_col != 0 and
> 05:42:04       int_col >= 1990 limit 5;
> {noformat}
> A similar error appears for multiple other tests. Then:
> {noformat}
> 05:42:04 TTransportException: Could not connect to localhost:21050
> 05:42:04 !!!!!!!!!!!!!!!!!!! Interrupted: stopping after 10 failures !!!!!!!!!!!!!!!!!!!!
> {noformat}
> I wonder if these are just symptoms of a failure in the BE code due to ASAN being enabled.
> Similar error in the latest build:
> {noformat}
> 05:20:05 =================================== FAILURES ===================================
> 05:20:05  TestHdfsQueries.test_hdfs_scan_node[protocol: beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: hbase/none] 
> 05:20:05 [gw4] linux2 -- Python 2.7.5 /data/jenkins/workspace/impala-cdh6.x-core-asan/repos/Impala/bin/../infra/python/env/bin/python
> 05:20:05 query_test/test_queries.py:240: in test_hdfs_scan_node
> 05:20:05     self.run_test_case('QueryTest/hdfs-scan-node', vector)
> ...
> 05:20:05     exec_result = self.__fetch_results(query_handle, max_rows)
> 05:20:05 beeswax/impala_beeswax.py:456: in __fetch_results
> 05:20:05     results = self.__do_rpc(lambda: self.imp_service.fetch(handle, False, fetch_rows))
> 05:20:05 beeswax/impala_beeswax.py:512: in __do_rpc
> 05:20:05     raise ImpalaBeeswaxException(self.__build_error_message(e), e)
> 05:20:05 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
> 05:20:05 E    INNER EXCEPTION: <class 'thrift.transport.TTransport.TTransportException'>
> 05:20:05 E    MESSAGE: TSocket read 0 bytes
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org