You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Wenzhe Zhou (Jira)" <ji...@apache.org> on 2021/11/01 17:18:00 UTC
[jira] [Updated] (IMPALA-10998) Backend test
scratch-tuple-batch-test failed in ASAN build
[ https://issues.apache.org/jira/browse/IMPALA-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenzhe Zhou updated IMPALA-10998:
---------------------------------
Description:
Backend test scratch-tuple-batch-test failed in my recent ASAN builds ran on impala-private-parameterized. It also happened in recent cdw-master-staging ASAN build: [https://master-03.jenkins.cloudera.com/job/impala-cdw-master-staging-core-asan/47/ |https://master-03.jenkins.cloudera.com/job/impala-cdw-master-staging-core-asan/47/]and asf-master core asan build [https://master-03.jenkins.cloudera.com/job/impala-asf-master-core-asan/94/]
This new backend test was added by recent commits [https://gerrit.cloudera.org/#/c/17860/].
Here is the console output:
21:11:01 ==19341==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x603000390d74 at pc 0x000001d18abf bp 0x7ffd7f9fef30 sp 0x7ffd7f9fef28
21:11:01 READ of size 4 at 0x603000390d74 thread T0
21:11:01 #0 0x1d18abe in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody() /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:159:13
21:11:01 #1 0x5ea0299 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5ea0299)
21:11:01 #2 0x5e99079 in testing::Test::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e99079)
21:11:01 #3 0x5e9915b in testing::TestInfo::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9915b)
21:11:01 #4 0x5e99294 in testing::TestCase::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e99294)
21:11:01 #5 0x5e9993f in testing::internal::UnitTestImpl::RunAllTests() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9993f)
21:11:01 #6 0x5e99a76 in testing::UnitTest::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e99a76)
21:11:01 #7 0x1d18cab in main /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:187:10
21:11:01 #8 0x7feb3bf0bc04 in __libc_start_main (/lib64/libc.so.6+0x21c04)
21:11:01 #9 0x1c20796 in _start (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x1c20796)
21:11:01
21:11:01 0x603000390d74 is located 0 bytes to the right of 20-byte region [0x603000390d60,0x603000390d74)
21:11:01 allocated by thread T0 here:
21:11:01 #0 0x1d135b0 in operator new(unsigned long) /mnt/source/llvm/llvm-5.0.1.src-p3/projects/compiler-rt/lib/asan/asan_new_delete.cc:92
21:11:01 #1 0x1d26ecf in void std::vector<int, std::allocator<int> >::_M_range_initialize<int const*>(int const*, int const*, std::forward_iterator_tag) /data/jenkins/workspace/impala-asf-master-core-asan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/stl_vector.h:1328:35
21:11:01 #2 0x1d1ac6f in std::vector<int, std::allocator<int> >::vector(std::initializer_list<int>, std::allocator<int> const&) /data/jenkins/workspace/impala-asf-master-core-asan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/stl_vector.h:387:2
21:11:01 #3 0x1d18767 in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody() /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:156:22
21:11:01 #4 0x5ea0299 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5ea0299)
21:11:01
21:11:01 SUMMARY: AddressSanitizer: heap-buffer-overflow /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:159:13 in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody()
21:11:01 Shadow bytes around the buggy address:
21:11:01 0x0c068006a150: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 0x0c068006a160: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 0x0c068006a170: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 0x0c068006a180: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 0x0c068006a190: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 =>0x0c068006a1a0: fa fa fa fa fa fa 00 00 04 fa fa fa 00 00[04]fa
21:11:01 0x0c068006a1b0: fa fa 00 00 00 fa fa fa 00 00 00 fa fa fa 00 00
21:11:01 0x0c068006a1c0: 00 fa fa fa 00 00 00 fa fa fa fd fd fd fd fa fa
21:11:01 0x0c068006a1d0: fd fd fd fa fa fa fd fd fd fa fa fa fd fd fd fa
21:11:01 0x0c068006a1e0: fa fa fd fd fd fa fa fa fd fd fd fa fa fa 00 00
21:11:01 0x0c068006a1f0: 00 fa fa fa fd fd fd fa fa fa fd fd fd fa fa fa
21:11:01 Shadow byte legend (one shadow byte represents 8 application bytes):
21:11:01 Addressable: 00
21:11:01 Partially addressable: 01 02 03 04 05 06 07
21:11:01 Heap left redzone: fa
21:11:01 Freed heap region: fd
21:11:01 Stack left redzone: f1
21:11:01 Stack mid redzone: f2
21:11:01 Stack right redzone: f3
21:11:01 Stack after return: f5
21:11:01 Stack use after scope: f8
21:11:01 Global redzone: f9
21:11:01 Global init order: f6
21:11:01 Poisoned by user: f7
21:11:01 Container overflow: fc
21:11:01 Array cookie: ac
21:11:01 Intra object redzone: bb
21:11:01 ASan internal: fe
21:11:01 Left alloca redzone: ca
21:11:01 Right alloca redzone: cb
21:11:01 ==19341==ABORTING
was:
Backend test scratch-tuple-batch-test failed in my recent ASAN builds ran on impala-private-parameterized. It also happened in recent cdw-master-staging ASAN build: https://master-03.jenkins.cloudera.com/job/impala-cdw-master-staging-core-asan/47/
This new backend test was added by recent commits https://gerrit.cloudera.org/#/c/17860/.
*16:01:01* ==7348==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x60300038e5e4 at pc 0x000001d19eaf bp 0x7ffef7332ff0 sp 0x7ffef7332fe8*16:01:01* READ of size 4 at 0x60300038e5e4 thread T0*16:01:01* #0 0x1d19eae in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody() /data/jenkins/workspace/impala-private-parameterized/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:159:13*16:01:01* #1 0x5ea45a9 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5ea45a9)*16:01:01* #2 0x5e9d389 in testing::Test::Run() (/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9d389)*16:01:01* #3 0x5e9d46b in testing::TestInfo::Run() (/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9d46b)*16:01:01* #4 0x5e9d5a4 in testing::TestCase::Run() (/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9d5a4)*16:01:01* #5 0x5e9dc4f in testing::internal::UnitTestImpl::RunAllTests() (/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9dc4f)*16:01:01* #6 0x5e9dd86 in testing::UnitTest::Run() (/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9dd86)*16:01:01* #7 0x1d1a09b in main /data/jenkins/workspace/impala-private-parameterized/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:187:10*16:01:01* #8 0x7efce3c17c04 in __libc_start_main (/lib64/libc.so.6+0x21c04)*16:01:01* #9 0x1c21b86 in _start (/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x1c21b86)*16:01:01* *16:01:01* 0x60300038e5e4 is located 0 bytes to the right of 20-byte region [0x60300038e5d0,0x60300038e5e4)*16:01:01* allocated by thread T0 here:*16:01:01* #0 0x1d149a0 in operator new(unsigned long) /mnt/source/llvm/llvm-5.0.1.src-p3/projects/compiler-rt/lib/asan/asan_new_delete.cc:92*16:01:01* #1 0x1d282bf in void std::vector<int, std::allocator<int> >::_M_range_initialize<int const*>(int const*, int const*, std::forward_iterator_tag) /data/jenkins/workspace/impala-private-parameterized/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/stl_vector.h:1328:35*16:01:01* #2 0x1d1c05f in std::vector<int, std::allocator<int> >::vector(std::initializer_list<int>, std::allocator<int> const&) /data/jenkins/workspace/impala-private-parameterized/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/stl_vector.h:387:2*16:01:01* #3 0x1d19b57 in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody() /data/jenkins/workspace/impala-private-parameterized/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:156:22*16:01:01* #4 0x5ea45a9 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5ea45a9)*16:01:01* *16:01:01* SUMMARY: AddressSanitizer: heap-buffer-overflow /data/jenkins/workspace/impala-private-parameterized/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:159:13 in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody()*16:01:01* Shadow bytes around the buggy address:*16:01:01* 0x0c0680069c60: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa*16:01:01* 0x0c0680069c70: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa*16:01:01* 0x0c0680069c80: fa fa fa fa fa fa fa fa fa fa 00 00 00 00 fa fa*16:01:01* 0x0c0680069c90: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa*16:01:01* 0x0c0680069ca0: fa fa fa fa fa fa fa fa 00 00 00 00 fa fa fa fa*16:01:01* =>0x0c0680069cb0: fa fa fa fa 00 00 04 fa fa fa 00 00[04]fa fa fa*16:01:01* 0x0c0680069cc0: 00 00 00 fa fa fa 00 00 00 fa fa fa 00 00 00 fa*16:01:01* 0x0c0680069cd0: fa fa 00 00 00 fa fa fa fd fd fd fd fa fa fd fd*16:01:01* 0x0c0680069ce0: fd fa fa fa fd fd fd fa fa fa fd fd fd fa fa fa*16:01:01* 0x0c0680069cf0: fd fd fd fa fa fa fd fd fd fa fa fa 00 00 00 fa*16:01:01* 0x0c0680069d00: fa fa fd fd fd fa fa fa fd fd fd fa fa fa fd fd*16:01:01* Shadow byte legend (one shadow byte represents 8 application bytes):*16:01:01* Addressable: 00*16:01:01* Partially addressable: 01 02 03 04 05 06 07 *16:01:01* Heap left redzone: fa*16:01:01* Freed heap region: fd*16:01:01* Stack left redzone: f1*16:01:01* Stack mid redzone: f2*16:01:01* Stack right redzone: f3*16:01:01* Stack after return: f5*16:01:01* Stack use after scope: f8*16:01:01* Global redzone: f9*16:01:01* Global init order: f6*16:01:01* Poisoned by user: f7*16:01:01* Container overflow: fc*16:01:01* Array cookie: ac*16:01:01* Intra object redzone: bb*16:01:01* ASan internal: fe*16:01:01* Left alloca redzone: ca*16:01:01* Right alloca redzone: cb*16:01:01* ==7348==ABORTING
> Backend test scratch-tuple-batch-test failed in ASAN build
> ----------------------------------------------------------
>
> Key: IMPALA-10998
> URL: https://issues.apache.org/jira/browse/IMPALA-10998
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 4.1.0
> Reporter: Wenzhe Zhou
> Assignee: Amogh Margoor
> Priority: Critical
> Labels: broken-build
>
> Backend test scratch-tuple-batch-test failed in my recent ASAN builds ran on impala-private-parameterized. It also happened in recent cdw-master-staging ASAN build: [https://master-03.jenkins.cloudera.com/job/impala-cdw-master-staging-core-asan/47/ |https://master-03.jenkins.cloudera.com/job/impala-cdw-master-staging-core-asan/47/]and asf-master core asan build [https://master-03.jenkins.cloudera.com/job/impala-asf-master-core-asan/94/]
> This new backend test was added by recent commits [https://gerrit.cloudera.org/#/c/17860/].
> Here is the console output:
> 21:11:01 ==19341==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x603000390d74 at pc 0x000001d18abf bp 0x7ffd7f9fef30 sp 0x7ffd7f9fef28
> 21:11:01 READ of size 4 at 0x603000390d74 thread T0
> 21:11:01 #0 0x1d18abe in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody() /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:159:13
> 21:11:01 #1 0x5ea0299 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5ea0299)
> 21:11:01 #2 0x5e99079 in testing::Test::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e99079)
> 21:11:01 #3 0x5e9915b in testing::TestInfo::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9915b)
> 21:11:01 #4 0x5e99294 in testing::TestCase::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e99294)
> 21:11:01 #5 0x5e9993f in testing::internal::UnitTestImpl::RunAllTests() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9993f)
> 21:11:01 #6 0x5e99a76 in testing::UnitTest::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e99a76)
> 21:11:01 #7 0x1d18cab in main /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:187:10
> 21:11:01 #8 0x7feb3bf0bc04 in __libc_start_main (/lib64/libc.so.6+0x21c04)
> 21:11:01 #9 0x1c20796 in _start (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x1c20796)
> 21:11:01
> 21:11:01 0x603000390d74 is located 0 bytes to the right of 20-byte region [0x603000390d60,0x603000390d74)
> 21:11:01 allocated by thread T0 here:
> 21:11:01 #0 0x1d135b0 in operator new(unsigned long) /mnt/source/llvm/llvm-5.0.1.src-p3/projects/compiler-rt/lib/asan/asan_new_delete.cc:92
> 21:11:01 #1 0x1d26ecf in void std::vector<int, std::allocator<int> >::_M_range_initialize<int const*>(int const*, int const*, std::forward_iterator_tag) /data/jenkins/workspace/impala-asf-master-core-asan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/stl_vector.h:1328:35
> 21:11:01 #2 0x1d1ac6f in std::vector<int, std::allocator<int> >::vector(std::initializer_list<int>, std::allocator<int> const&) /data/jenkins/workspace/impala-asf-master-core-asan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/stl_vector.h:387:2
> 21:11:01 #3 0x1d18767 in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody() /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:156:22
> 21:11:01 #4 0x5ea0299 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5ea0299)
> 21:11:01
> 21:11:01 SUMMARY: AddressSanitizer: heap-buffer-overflow /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:159:13 in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody()
> 21:11:01 Shadow bytes around the buggy address:
> 21:11:01 0x0c068006a150: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
> 21:11:01 0x0c068006a160: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
> 21:11:01 0x0c068006a170: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
> 21:11:01 0x0c068006a180: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
> 21:11:01 0x0c068006a190: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
> 21:11:01 =>0x0c068006a1a0: fa fa fa fa fa fa 00 00 04 fa fa fa 00 00[04]fa
> 21:11:01 0x0c068006a1b0: fa fa 00 00 00 fa fa fa 00 00 00 fa fa fa 00 00
> 21:11:01 0x0c068006a1c0: 00 fa fa fa 00 00 00 fa fa fa fd fd fd fd fa fa
> 21:11:01 0x0c068006a1d0: fd fd fd fa fa fa fd fd fd fa fa fa fd fd fd fa
> 21:11:01 0x0c068006a1e0: fa fa fd fd fd fa fa fa fd fd fd fa fa fa 00 00
> 21:11:01 0x0c068006a1f0: 00 fa fa fa fd fd fd fa fa fa fd fd fd fa fa fa
> 21:11:01 Shadow byte legend (one shadow byte represents 8 application bytes):
> 21:11:01 Addressable: 00
> 21:11:01 Partially addressable: 01 02 03 04 05 06 07
> 21:11:01 Heap left redzone: fa
> 21:11:01 Freed heap region: fd
> 21:11:01 Stack left redzone: f1
> 21:11:01 Stack mid redzone: f2
> 21:11:01 Stack right redzone: f3
> 21:11:01 Stack after return: f5
> 21:11:01 Stack use after scope: f8
> 21:11:01 Global redzone: f9
> 21:11:01 Global init order: f6
> 21:11:01 Poisoned by user: f7
> 21:11:01 Container overflow: fc
> 21:11:01 Array cookie: ac
> 21:11:01 Intra object redzone: bb
> 21:11:01 ASan internal: fe
> 21:11:01 Left alloca redzone: ca
> 21:11:01 Right alloca redzone: cb
> 21:11:01 ==19341==ABORTING
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org