You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2020/05/30 01:01:00 UTC

[jira] [Resolved] (IMPALA-9800) BE test parquet-plain-test crashes in ubsan test

     [ https://issues.apache.org/jira/browse/IMPALA-9800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe McDonnell resolved IMPALA-9800.
-----------------------------------
     Fix Version/s: Impala 4.0
    Target Version: Impala 4.0
        Resolution: Fixed

Reverted the fix for IMPALA-9781.

> BE test parquet-plain-test crashes in ubsan test 
> -------------------------------------------------
>
>                 Key: IMPALA-9800
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9800
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Quanlong Huang
>            Assignee: Joe McDonnell
>            Priority: Blocker
>              Labels: broken-build
>             Fix For: Impala 4.0
>
>
> Jenkins log:
> {code:java}
> 18/122 Test  #18: parquet-plain-test ...............***Failed    1.66 sec
> Turning perftools heap leak checking off
> seed = 1590735754
> Note: Google Test filter = PlainEncoding.*
> [==========] Running 4 tests from 1 test case.
> [----------] Global test environment set-up.
> [----------] 4 tests from PlainEncoding
> [ RUN      ] PlainEncoding.Basic
> [       OK ] PlainEncoding.Basic (1 ms)
> [ RUN      ] PlainEncoding.Batch
> 2020-05-29 00:02:34,975 INFO  util.JvmPauseMonitor (JvmPauseMonitor.java:run(190)) - Starting JVM pause monitor
> Wrote minidump to /data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/be_tests/minidumps/unifiedbetests/358b26b7-358a-4528-d1a6bf8d-79773a69.dmp
> Wrote minidump to /data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/be_tests/minidumps/unifiedbetests/358b26b7-358a-4528-d1a6bf8d-79773a69.dmp
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> #  SIGSEGV (0xb) at pc=0x000000000210c403, pid=15155, tid=0x00007fc5dec0e9c0
> #
> # JRE version: Java(TM) SE Runtime Environment (8.0_144-b01) (build 1.8.0_144-b01)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.144-b01 mixed mode linux-amd64 compressed oops)
> # Problematic frame:
> # C  [unifiedbetests+0x1d0c403]  void impala::DecimalUtil::DecodeFromFixedLenByteArray<impala::DecimalValue<__int128> >(unsigned char const*, int, impala::DecimalValue<__int128>*)+0x1a3
> #
> # Core dump written. Default location: /data0/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/be/src/exec/parquet/core or core.15155
> #
> # An error report file with more information is saved as:
> # /data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/hs_err_pid15155.log
> #
> # If you would like to submit a bug report, please visit:
> #   http://bugreport.java.com/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
> /data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/be/build/debug//exec/parquet/parquet-plain-test: line 10: 15155 Aborted                 (core dumped) ${IMPALA_HOME}/bin/run-jvm-binary.sh ${IMPALA_HOME}/be/build/latest/service/unifiedbetests --gtest_filter=${GTEST_FILTER} --gtest_output=xml:${IMPALA_BE_TEST_LOGS_DIR}/${TEST_EXEC_NAME}.xml -log_filename="${TEST_EXEC_NAME}" "$@"
> Traceback (most recent call last):
>   File "/data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/bin/junitxml_prune_notrun.py", line 71, in <module>
>     if __name__ == "__main__": main()
>   File "/data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/bin/junitxml_prune_notrun.py", line 68, in main
>     junitxml_prune_notrun(options.filename)
>   File "/data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/bin/junitxml_prune_notrun.py", line 31, in junitxml_prune_notrun
>     root = tree.parse(junitxml_filename)
>   File "/usr/lib64/python2.7/xml/etree/ElementTree.py", line 647, in parse
>     source = open(source, "rb")
> IOError: [Errno 2] No such file or directory: '/data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/be_tests/parquet-plain-test.xml' {code}
> Error Message
> {code:java}
> Minidump generated: /data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/be_tests/minidumps/unifiedbetests/358b26b7-358a-4528-d1a6bf8d-79773a69.dmp
> {code}
> Standard Error
> {code}Operating system: Linux
>                   0.0.0 Linux 3.10.0-693.5.2.el7.x86_64 #1 SMP Fri Oct 20 20:32:50 UTC 2017 x86_64
> CPU: amd64
>      family 6 model 85 stepping 4
>      1 CPU
> GPU: UNKNOWN
> Crash reason:  SIGSEGV
> Crash address: 0x0
> Process uptime: not available
> Thread 0 (crashed)
>  0  unifiedbetests!void impala::DecimalUtil::DecodeFromFixedLenByteArray<impala::DecimalValue<__int128> >(unsigned char const*, int, impala::DecimalValue<__int128>*) [decimal-util.h : 132 + 0x12]
>     rax = 0x000000001983c014   rdx = 0x0000000000000010
>     rcx = 0x00007ffe49b8bb01   rbx = 0x00000000020bc580
>     rsi = 0x00007ffe49b8bc60   rdi = 0x00007ffe49b8bc6c
>     rbp = 0x00007ffe49b8bcd0   rsp = 0x00007ffe49b8bb70
>      r8 = 0x000000001983c001    r9 = 0x00000000000000ff
>     r10 = 0x0000000000000001   r11 = 0x0000000000000000
>     r12 = 0x0000000015f2a2a0   r13 = 0x00000000092bb17f
>     r14 = 0x000001725f3d56e0   r15 = 0x0000000008f6a160
>     rip = 0x000000000210c403
>     Found by: given as instruction pointer in context
>  1  unifiedbetests!int impala::DecodeDecimalByteArray<impala::DecimalValue<__int128> >(unsigned char const*, unsigned char const*, int, impala::DecimalValue<__int128>*) [parquet-common.h : 653 + 0x5]
>     rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8bd50
>     rsp = 0x00007ffe49b8bce0   r12 = 0x0000000015f2a2a0
>     r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
>     r15 = 0x0000000008f6a160   rip = 0x000000000210c242
>     Found by: call frame info
>  2  unifiedbetests!int impala::ParquetPlainEncoder::Decode<impala::DecimalValue<__int128>, (parquet::Type::type)6>(unsigned char const*, unsigned char const*, int, impala::DecimalValue<__int128>*) [parquet-common.h : 675 + 0x5]
>     rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8bd80
>     rsp = 0x00007ffe49b8bd60   r12 = 0x0000000015f2a2a0
>     r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
>     r15 = 0x0000000008f6a160   rip = 0x000000000210bb1b
>     Found by: call frame info
>  3  unifiedbetests!void impala::TestTypeWideningBatch<impala::DecimalValue<__int128>, impala::DecimalValue<__int128>, (parquet::Type::type)6>(std::vector<impala::DecimalValue<__int128>, std::allocator<impala::DecimalValue<__int128> > > const&, int, int) [parquet-plain-test.cc : 319 + 0x13]
>     rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8c080
>     rsp = 0x00007ffe49b8bd90   r12 = 0x0000000015f2a2a0
>     r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
>     r15 = 0x0000000008f6a160   rip = 0x000000000212df83
>     Found by: call frame info
>  4  unifiedbetests!void impala::TestTypeBatch<impala::DecimalValue<__int128>, (parquet::Type::type)6>(std::vector<impala::DecimalValue<__int128>, std::allocator<impala::DecimalValue<__int128> > > const&, int, int) [parquet-plain-test.cc : 349 + 0x9]
>     rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8c0b0
>     rsp = 0x00007ffe49b8c090   r12 = 0x0000000015f2a2a0
>     r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
>     r15 = 0x0000000008f6a160   rip = 0x00000000020c4fa6
>     Found by: call frame info
>  5  unifiedbetests!impala::PlainEncoding_Batch_Test::TestBody() [parquet-plain-test.cc : 436 + 0xe]
>     rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8d6f0
>     rsp = 0x00007ffe49b8c0c0   r12 = 0x0000000015f2a2a0
>     r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
>     r15 = 0x0000000008f6a160   rip = 0x00000000020bcbfb
>     Found by: call frame info
>  6  unifiedbetests!void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) + 0x33
>     rbx = 0x00000000020bc580   rbp = 0x0000000000000000
>     rsp = 0x00007ffe49b8d700   r12 = 0x0000000015f2a2a0
>     r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
>     r15 = 0x0000000008f6a160   rip = 0x0000000008f85173
>     Found by: call frame info
>  7  unifiedbetests!testing::Test::Run() + 0xba
>     rbx = 0x0000000015f2a2a0   rbp = 0x0000000008f6a160
>     rsp = 0x00007ffe49b8d740   r12 = 0x00000000111c0000
>     r13 = 0x0000000015f2a2a0   r14 = 0x000001725f3d56e0
>     r15 = 0x0000000008f6a160   rip = 0x0000000008f7cdca
>     Found by: call frame info
>  8  unifiedbetests!testing::TestInfo::Run() + 0x118
>     rbx = 0x00000000111ae840   rbp = 0x00000000111c0000
>     rsp = 0x00007ffe49b8d760   r12 = 0x00000000111c4780
>     r13 = 0x0000000015f2a2a0   r14 = 0x000001725f3d56e0
>     r15 = 0x0000000008f6a160   rip = 0x0000000008f7cf18
>     Found by: call frame info
>  9  unifiedbetests!testing::TestCase::Run() + 0xb5
>     rbx = 0x0000000000000002   rbp = 0x00000000111bf720
>     rsp = 0x00007ffe49b8d7a0   r12 = 0x00000000111c0000
>     r13 = 0x00000000111c4780   r14 = 0x0000000008f6a160
>     r15 = 0x000001725f3d56df   rip = 0x0000000008f7cff5
>     Found by: call frame info
> 10  unifiedbetests!testing::internal::UnitTestImpl::RunAllTests() + 0x258
>     rbx = 0x00000000111c0000   rbp = 0x00000000111c4780
>     rsp = 0x00007ffe49b8d7f0   r12 = 0x0000000000000018
>     r13 = 0x0000000000000000   r14 = 0x000001725f3d56df
>     r15 = 0x000000001055e2d4   rip = 0x0000000008f7e278
>     Found by: call frame info
> 11  unifiedbetests!testing::UnitTest::Run() + 0x33
>     rbx = 0x00000000111c0000   rbp = 0x00007ffe49b8d960
>     rsp = 0x00007ffe49b8d880   r12 = 0x0000000001ca3dce
>     r13 = 0x00007ffe49b8da40   r14 = 0x0000000000000000
>     r15 = 0x0000000000000000   rip = 0x0000000008f7e553
>     Found by: call frame info
> 12  unifiedbetests!main [unified-betest-main.cc : 48 + 0x1b]
>     rbx = 0x0000000000000000   rbp = 0x00007ffe49b8d960
>     rsp = 0x00007ffe49b8d8a0   r12 = 0x0000000001ca3dce
>     r13 = 0x00007ffe49b8da40   r14 = 0x0000000000000000
>     r15 = 0x0000000000000000   rip = 0x0000000001cc9386
>     Found by: call frame info
> 13  libc-2.17.so + 0x21c05
>     rbx = 0x0000000000000000   rbp = 0x0000000000000000
>     rsp = 0x00007ffe49b8d970   r12 = 0x0000000001ca3dce
>     r13 = 0x00007ffe49b8da40   r14 = 0x0000000000000000 {code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)