You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Andrew Sherman (JIRA)" <ji...@apache.org> on 2019/03/27 22:08:00 UTC
[jira] [Updated] (IMPALA-7930) Crash in thrift-server-test
[ https://issues.apache.org/jira/browse/IMPALA-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Sherman updated IMPALA-7930:
-----------------------------------
Description:
I've seen a crash in thrift-server-test during an exhaustive test run. Unfortunately the core file indicated that it was written by a directory, which caused the automatic core dump resolution to fail. Here's the resolved minidump:
{noformat}
Crash reason: SIGABRT
Crash address: 0x7d100001d19
Process uptime: not available
Thread 0 (crashed)
0 libc-2.17.so + 0x351f7
rax = 0x0000000000000000 rdx = 0x0000000000000006
rcx = 0xffffffffffffffff rbx = 0x00007f1e65876000
rsi = 0x0000000000001d19 rdi = 0x0000000000001d19
rbp = 0x00007f1e61dbde68 rsp = 0x00007fffc22796d8
r8 = 0x00000000000a1a10 r9 = 0xfefefefefeff092d
r10 = 0x0000000000000008 r11 = 0x0000000000000202
r12 = 0x00000000029dca31 r13 = 0x00000000033a5e00
r14 = 0x00000000ffffffff r15 = 0x0000000000000000
rip = 0x00007f1e61c721f7
Found by: given as instruction pointer in context
1 libc-2.17.so + 0x368e8
rsp = 0x00007fffc22796e0 rip = 0x00007f1e61c738e8
Found by: stack scanning
2 libc-2.17.so + 0x17df70
rsp = 0x00007fffc2279770 rip = 0x00007f1e61dbaf70
Found by: stack scanning
3 thrift-server-test!_fini + 0xdf918
rsp = 0x00007fffc2279778 rip = 0x0000000002ab0288
Found by: stack scanning
4 libc-2.17.so + 0x2fbc3
rsp = 0x00007fffc2279790 rip = 0x00007f1e61c6cbc3
Found by: stack scanning
5 thrift-server-test!testing::internal::TestEventRepeater::OnTestProgramEnd(testing::UnitTest const&) + 0x55
rsp = 0x00007fffc22797b0 rip = 0x00000000028711f5
Found by: stack scanning
6 libc-2.17.so + 0x17df70
rbx = 0x0000000000000000 rbp = 0x0000000000000000
rsp = 0x00007fffc22797e0 r12 = 0x0000000000000000
r13 = 0x0000000500000000 rip = 0x00007f1e61dbaf70
Found by: call frame info
7 thrift-server-test!_fini + 0xc0c1
rsp = 0x00007fffc22797f0 rip = 0x00000000029dca31
Found by: stack scanning
8 thrift-server-test!_fini + 0x9d5490
rsp = 0x00007fffc22797f8 rip = 0x00000000033a5e00
Found by: stack scanning
9 libc-2.17.so + 0x180e68
rsp = 0x00007fffc2279808 rip = 0x00007f1e61dbde68
Found by: stack scanning
10 libc-2.17.so + 0x2e266
rsp = 0x00007fffc2279810 rip = 0x00007f1e61c6b266
Found by: stack scanning
11 thrift-server-test!_fini + 0x9d5490
rsp = 0x00007fffc2279818 rip = 0x00000000033a5e00
Found by: stack scanning
12 libc-2.17.so + 0x17df70
rsp = 0x00007fffc2279820 rip = 0x00007f1e61dbaf70
Found by: stack scanning
13 thrift-server-test!_fini + 0xc0c1
rsp = 0x00007fffc2279828 rip = 0x00000000029dca31
Found by: stack scanning
14 thrift-server-test!_fini + 0xdf918
rsp = 0x00007fffc2279840 rip = 0x0000000002ab0288
Found by: stack scanning
15 thrift-server-test!_fini + 0x9d5490
rsp = 0x00007fffc2279850 rip = 0x00000000033a5e00
Found by: stack scanning
16 thrift-server-test!_fini + 0xc0c1
rsp = 0x00007fffc2279860 rip = 0x00000000029dca31
Found by: stack scanning
17 thrift-server-test!_fini + 0x9d5490
rsp = 0x00007fffc2279870 rip = 0x00000000033a5e00
Found by: stack scanning
18 thrift-server-test!_fini + 0xc0c1
rsp = 0x00007fffc2279878 rip = 0x00000000029dca31
Found by: stack scanning
19 thrift-server-test!_fini + 0xdf918
rsp = 0x00007fffc2279880 rip = 0x0000000002ab0288
Found by: stack scanning
20 libc-2.17.so + 0x2e312
rsp = 0x00007fffc2279890 rip = 0x00007f1e61c6b312
Found by: stack scanning
21 thrift-server-test!boost::shared_array<apache::thrift::concurrency::Mutex>::~shared_array() + 0x70
rsp = 0x00007fffc22798b0 rip = 0x0000000002719b40
Found by: stack scanning
22 thrift-server-test!boost::detail::sp_counted_impl_p<apache::thrift::concurrency::Mutex::impl>::dispose() + 0x4f
rsp = 0x00007fffc22798c0 rip = 0x000000000271e1af
Found by: stack scanning
23 thrift-server-test!boost::detail::sp_counted_impl_pd<apache::thrift::concurrency::Mutex*, boost::checked_array_deleter<apache::thrift::concurrency::Mutex> >::dispose() + 0xaa
rbx = 0x00000000042f7128 rsp = 0x00007fffc22798d0
rip = 0x0000000002719cfa
Found by: call frame info
24 thrift-server-test!boost::shared_array<apache::thrift::concurrency::Mutex>::~shared_array() + 0x39
rbx = 0x000000000436f900 rbp = 0x00000000ffffffff
rsp = 0x00007fffc2279900 r12 = 0x0000000000000001
r13 = 0x0000000004323680 r14 = 0x0000000000000000
rip = 0x0000000002719b09
Found by: call frame info
25 libc-2.17.so + 0x38a69
rbx = 0x0000000000000000 rbp = 0x00007f1e61ff96c8
rsp = 0x00007fffc2279920 r12 = 0x0000000000000001
r13 = 0x0000000004323680 r14 = 0x0000000000000000
rip = 0x00007f1e61c75a69
Found by: call frame info
26 thrift-server-test!_GLOBAL__sub_I_json_escaping.cc + 0x2e
rsp = 0x00007fffc2279940 rip = 0x0000000000b06b0e
Found by: stack scanning
27 0x7fffc2279a30
rsp = 0x00007fffc2279948 rip = 0x00007fffc2279a30
Found by: call frame info
28 libc-2.17.so + 0x38ab5
rsp = 0x00007fffc2279950 rip = 0x00007f1e61c75ab5
Found by: stack scanning
29 libc-2.17.so + 0x21c0c
rsp = 0x00007fffc2279960 rip = 0x00007f1e61c5ec0c
Found by: stack scanning
30 thrift-server-test!ldap_int_destroy_global_options + 0x80
rsp = 0x00007fffc2279980 rip = 0x0000000000aaa4b0
Found by: stack scanning
31 thrift-server-test!_GLOBAL__sub_I_json_escaping.cc + 0x2e
rsp = 0x00007fffc2279998 rip = 0x0000000000b06b0e
Found by: stack scanning
32 0x7fffc2279a30
rsp = 0x00007fffc22799a0 rip = 0x00007fffc2279a30
Found by: call frame info
33 ld-2.17.so + 0xf47f
rsp = 0x00007fffc22799e0 rip = 0x00007f1e656c547f
Found by: stack scanning
34 thrift-server-test!_GLOBAL__sub_I_json_escaping.cc + 0x2e
rsp = 0x00007fffc2279a08 rip = 0x0000000000b06b0e
Found by: stack scanning
35 0x7fffc2279a30
rsp = 0x00007fffc2279a10 rip = 0x00007fffc2279a30
Found by: call frame info
36 thrift-server-test!_start + 0x29
rsp = 0x00007fffc2279a20 rip = 0x0000000000b06b37
Found by: stack scanning
37 0x7fffc2279a28
rsp = 0x00007fffc2279a28 rip = 0x00007fffc2279a28
Found by: call frame info
{noformat}
was:
I've seen a crash in thrift-server-test during an exhaustive test run. Unfortunately the core file indicated that it was written by a directory, which caused the automatic core dump resolution to fail. Here's the resolved minidump:
{noformat}
Crash reason: SIGABRT
Crash address: 0x7d100001d19
Process uptime: not available
Thread 0 (crashed)
0 libc-2.17.so + 0x351f7
rax = 0x0000000000000000 rdx = 0x0000000000000006
rcx = 0xffffffffffffffff rbx = 0x00007f1e65876000
rsi = 0x0000000000001d19 rdi = 0x0000000000001d19
rbp = 0x00007f1e61dbde68 rsp = 0x00007fffc22796d8
r8 = 0x00000000000a1a10 r9 = 0xfefefefefeff092d
r10 = 0x0000000000000008 r11 = 0x0000000000000202
r12 = 0x00000000029dca31 r13 = 0x00000000033a5e00
r14 = 0x00000000ffffffff r15 = 0x0000000000000000
rip = 0x00007f1e61c721f7
Found by: given as instruction pointer in context
1 libc-2.17.so + 0x368e8
rsp = 0x00007fffc22796e0 rip = 0x00007f1e61c738e8
Found by: stack scanning
2 libc-2.17.so + 0x17df70
rsp = 0x00007fffc2279770 rip = 0x00007f1e61dbaf70
Found by: stack scanning
3 thrift-server-test!_fini + 0xdf918
rsp = 0x00007fffc2279778 rip = 0x0000000002ab0288
Found by: stack scanning
4 libc-2.17.so + 0x2fbc3
rsp = 0x00007fffc2279790 rip = 0x00007f1e61c6cbc3
Found by: stack scanning
5 thrift-server-test!testing::internal::TestEventRepeater::OnTestProgramEnd(testing::UnitTest const&) + 0x55
rsp = 0x00007fffc22797b0 rip = 0x00000000028711f5
Found by: stack scanning
6 libc-2.17.so + 0x17df70
rbx = 0x0000000000000000 rbp = 0x0000000000000000
rsp = 0x00007fffc22797e0 r12 = 0x0000000000000000
r13 = 0x0000000500000000 rip = 0x00007f1e61dbaf70
Found by: call frame info
7 thrift-server-test!_fini + 0xc0c1
rsp = 0x00007fffc22797f0 rip = 0x00000000029dca31
Found by: stack scanning
8 thrift-server-test!_fini + 0x9d5490
rsp = 0x00007fffc22797f8 rip = 0x00000000033a5e00
Found by: stack scanning
9 libc-2.17.so + 0x180e68
rsp = 0x00007fffc2279808 rip = 0x00007f1e61dbde68
Found by: stack scanning
10 libc-2.17.so + 0x2e266
rsp = 0x00007fffc2279810 rip = 0x00007f1e61c6b266
Found by: stack scanning
11 thrift-server-test!_fini + 0x9d5490
rsp = 0x00007fffc2279818 rip = 0x00000000033a5e00
Found by: stack scanning
12 libc-2.17.so + 0x17df70
rsp = 0x00007fffc2279820 rip = 0x00007f1e61dbaf70
Found by: stack scanning
13 thrift-server-test!_fini + 0xc0c1
rsp = 0x00007fffc2279828 rip = 0x00000000029dca31
Found by: stack scanning
14 thrift-server-test!_fini + 0xdf918
rsp = 0x00007fffc2279840 rip = 0x0000000002ab0288
Found by: stack scanning
15 thrift-server-test!_fini + 0x9d5490
rsp = 0x00007fffc2279850 rip = 0x00000000033a5e00
Found by: stack scanning
16 thrift-server-test!_fini + 0xc0c1
rsp = 0x00007fffc2279860 rip = 0x00000000029dca31
Found by: stack scanning
17 thrift-server-test!_fini + 0x9d5490
rsp = 0x00007fffc2279870 rip = 0x00000000033a5e00
Found by: stack scanning
18 thrift-server-test!_fini + 0xc0c1
rsp = 0x00007fffc2279878 rip = 0x00000000029dca31
Found by: stack scanning
19 thrift-server-test!_fini + 0xdf918
rsp = 0x00007fffc2279880 rip = 0x0000000002ab0288
Found by: stack scanning
20 libc-2.17.so + 0x2e312
rsp = 0x00007fffc2279890 rip = 0x00007f1e61c6b312
Found by: stack scanning
21 thrift-server-test!boost::shared_array<apache::thrift::concurrency::Mutex>::~shared_array() + 0x70
rsp = 0x00007fffc22798b0 rip = 0x0000000002719b40
Found by: stack scanning
22 thrift-server-test!boost::detail::sp_counted_impl_p<apache::thrift::concurrency::Mutex::impl>::dispose() + 0x4f
rsp = 0x00007fffc22798c0 rip = 0x000000000271e1af
Found by: stack scanning
23 thrift-server-test!boost::detail::sp_counted_impl_pd<apache::thrift::concurrency::Mutex*, boost::checked_array_deleter<apache::thrift::concurrency::Mutex> >::dispose() + 0xaa
rbx = 0x00000000042f7128 rsp = 0x00007fffc22798d0
rip = 0x0000000002719cfa
Found by: call frame info
24 thrift-server-test!boost::shared_array<apache::thrift::concurrency::Mutex>::~shared_array() + 0x39
rbx = 0x000000000436f900 rbp = 0x00000000ffffffff
rsp = 0x00007fffc2279900 r12 = 0x0000000000000001
r13 = 0x0000000004323680 r14 = 0x0000000000000000
rip = 0x0000000002719b09
Found by: call frame info
25 libc-2.17.so + 0x38a69
rbx = 0x0000000000000000 rbp = 0x00007f1e61ff96c8
rsp = 0x00007fffc2279920 r12 = 0x0000000000000001
r13 = 0x0000000004323680 r14 = 0x0000000000000000
rip = 0x00007f1e61c75a69
Found by: call frame info
26 thrift-server-test!_GLOBAL__sub_I_json_escaping.cc + 0x2e
rsp = 0x00007fffc2279940 rip = 0x0000000000b06b0e
Found by: stack scanning
27 0x7fffc2279a30
rsp = 0x00007fffc2279948 rip = 0x00007fffc2279a30
Found by: call frame info
28 libc-2.17.so + 0x38ab5
rsp = 0x00007fffc2279950 rip = 0x00007f1e61c75ab5
Found by: stack scanning
29 libc-2.17.so + 0x21c0c
rsp = 0x00007fffc2279960 rip = 0x00007f1e61c5ec0c
Found by: stack scanning
30 thrift-server-test!ldap_int_destroy_global_options + 0x80
rsp = 0x00007fffc2279980 rip = 0x0000000000aaa4b0
Found by: stack scanning
31 thrift-server-test!_GLOBAL__sub_I_json_escaping.cc + 0x2e
rsp = 0x00007fffc2279998 rip = 0x0000000000b06b0e
Found by: stack scanning
32 0x7fffc2279a30
rsp = 0x00007fffc22799a0 rip = 0x00007fffc2279a30
Found by: call frame info
33 ld-2.17.so + 0xf47f
rsp = 0x00007fffc22799e0 rip = 0x00007f1e656c547f
Found by: stack scanning
34 thrift-server-test!_GLOBAL__sub_I_json_escaping.cc + 0x2e
rsp = 0x00007fffc2279a08 rip = 0x0000000000b06b0e
Found by: stack scanning
35 0x7fffc2279a30
rsp = 0x00007fffc2279a10 rip = 0x00007fffc2279a30
Found by: call frame info
36 thrift-server-test!_start + 0x29
rsp = 0x00007fffc2279a20 rip = 0x0000000000b06b37
Found by: stack scanning
37 0x7fffc2279a28
rsp = 0x00007fffc2279a28 rip = 0x00007fffc2279a28
Found by: call frame info
{noformat}
> Crash in thrift-server-test
> ---------------------------
>
> Key: IMPALA-7930
> URL: https://issues.apache.org/jira/browse/IMPALA-7930
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 3.2.0
> Reporter: Lars Volker
> Assignee: Thomas Tauber-Marshall
> Priority: Critical
> Labels: broken-build, flaky
>
> I've seen a crash in thrift-server-test during an exhaustive test run. Unfortunately the core file indicated that it was written by a directory, which caused the automatic core dump resolution to fail. Here's the resolved minidump:
> {noformat}
> Crash reason: SIGABRT
> Crash address: 0x7d100001d19
> Process uptime: not available
> Thread 0 (crashed)
> 0 libc-2.17.so + 0x351f7
> rax = 0x0000000000000000 rdx = 0x0000000000000006
> rcx = 0xffffffffffffffff rbx = 0x00007f1e65876000
> rsi = 0x0000000000001d19 rdi = 0x0000000000001d19
> rbp = 0x00007f1e61dbde68 rsp = 0x00007fffc22796d8
> r8 = 0x00000000000a1a10 r9 = 0xfefefefefeff092d
> r10 = 0x0000000000000008 r11 = 0x0000000000000202
> r12 = 0x00000000029dca31 r13 = 0x00000000033a5e00
> r14 = 0x00000000ffffffff r15 = 0x0000000000000000
> rip = 0x00007f1e61c721f7
> Found by: given as instruction pointer in context
> 1 libc-2.17.so + 0x368e8
> rsp = 0x00007fffc22796e0 rip = 0x00007f1e61c738e8
> Found by: stack scanning
> 2 libc-2.17.so + 0x17df70
> rsp = 0x00007fffc2279770 rip = 0x00007f1e61dbaf70
> Found by: stack scanning
> 3 thrift-server-test!_fini + 0xdf918
> rsp = 0x00007fffc2279778 rip = 0x0000000002ab0288
> Found by: stack scanning
> 4 libc-2.17.so + 0x2fbc3
> rsp = 0x00007fffc2279790 rip = 0x00007f1e61c6cbc3
> Found by: stack scanning
> 5 thrift-server-test!testing::internal::TestEventRepeater::OnTestProgramEnd(testing::UnitTest const&) + 0x55
> rsp = 0x00007fffc22797b0 rip = 0x00000000028711f5
> Found by: stack scanning
> 6 libc-2.17.so + 0x17df70
> rbx = 0x0000000000000000 rbp = 0x0000000000000000
> rsp = 0x00007fffc22797e0 r12 = 0x0000000000000000
> r13 = 0x0000000500000000 rip = 0x00007f1e61dbaf70
> Found by: call frame info
> 7 thrift-server-test!_fini + 0xc0c1
> rsp = 0x00007fffc22797f0 rip = 0x00000000029dca31
> Found by: stack scanning
> 8 thrift-server-test!_fini + 0x9d5490
> rsp = 0x00007fffc22797f8 rip = 0x00000000033a5e00
> Found by: stack scanning
> 9 libc-2.17.so + 0x180e68
> rsp = 0x00007fffc2279808 rip = 0x00007f1e61dbde68
> Found by: stack scanning
> 10 libc-2.17.so + 0x2e266
> rsp = 0x00007fffc2279810 rip = 0x00007f1e61c6b266
> Found by: stack scanning
> 11 thrift-server-test!_fini + 0x9d5490
> rsp = 0x00007fffc2279818 rip = 0x00000000033a5e00
> Found by: stack scanning
> 12 libc-2.17.so + 0x17df70
> rsp = 0x00007fffc2279820 rip = 0x00007f1e61dbaf70
> Found by: stack scanning
> 13 thrift-server-test!_fini + 0xc0c1
> rsp = 0x00007fffc2279828 rip = 0x00000000029dca31
> Found by: stack scanning
> 14 thrift-server-test!_fini + 0xdf918
> rsp = 0x00007fffc2279840 rip = 0x0000000002ab0288
> Found by: stack scanning
> 15 thrift-server-test!_fini + 0x9d5490
> rsp = 0x00007fffc2279850 rip = 0x00000000033a5e00
> Found by: stack scanning
> 16 thrift-server-test!_fini + 0xc0c1
> rsp = 0x00007fffc2279860 rip = 0x00000000029dca31
> Found by: stack scanning
> 17 thrift-server-test!_fini + 0x9d5490
> rsp = 0x00007fffc2279870 rip = 0x00000000033a5e00
> Found by: stack scanning
> 18 thrift-server-test!_fini + 0xc0c1
> rsp = 0x00007fffc2279878 rip = 0x00000000029dca31
> Found by: stack scanning
> 19 thrift-server-test!_fini + 0xdf918
> rsp = 0x00007fffc2279880 rip = 0x0000000002ab0288
> Found by: stack scanning
> 20 libc-2.17.so + 0x2e312
> rsp = 0x00007fffc2279890 rip = 0x00007f1e61c6b312
> Found by: stack scanning
> 21 thrift-server-test!boost::shared_array<apache::thrift::concurrency::Mutex>::~shared_array() + 0x70
> rsp = 0x00007fffc22798b0 rip = 0x0000000002719b40
> Found by: stack scanning
> 22 thrift-server-test!boost::detail::sp_counted_impl_p<apache::thrift::concurrency::Mutex::impl>::dispose() + 0x4f
> rsp = 0x00007fffc22798c0 rip = 0x000000000271e1af
> Found by: stack scanning
> 23 thrift-server-test!boost::detail::sp_counted_impl_pd<apache::thrift::concurrency::Mutex*, boost::checked_array_deleter<apache::thrift::concurrency::Mutex> >::dispose() + 0xaa
> rbx = 0x00000000042f7128 rsp = 0x00007fffc22798d0
> rip = 0x0000000002719cfa
> Found by: call frame info
> 24 thrift-server-test!boost::shared_array<apache::thrift::concurrency::Mutex>::~shared_array() + 0x39
> rbx = 0x000000000436f900 rbp = 0x00000000ffffffff
> rsp = 0x00007fffc2279900 r12 = 0x0000000000000001
> r13 = 0x0000000004323680 r14 = 0x0000000000000000
> rip = 0x0000000002719b09
> Found by: call frame info
> 25 libc-2.17.so + 0x38a69
> rbx = 0x0000000000000000 rbp = 0x00007f1e61ff96c8
> rsp = 0x00007fffc2279920 r12 = 0x0000000000000001
> r13 = 0x0000000004323680 r14 = 0x0000000000000000
> rip = 0x00007f1e61c75a69
> Found by: call frame info
> 26 thrift-server-test!_GLOBAL__sub_I_json_escaping.cc + 0x2e
> rsp = 0x00007fffc2279940 rip = 0x0000000000b06b0e
> Found by: stack scanning
> 27 0x7fffc2279a30
> rsp = 0x00007fffc2279948 rip = 0x00007fffc2279a30
> Found by: call frame info
> 28 libc-2.17.so + 0x38ab5
> rsp = 0x00007fffc2279950 rip = 0x00007f1e61c75ab5
> Found by: stack scanning
> 29 libc-2.17.so + 0x21c0c
> rsp = 0x00007fffc2279960 rip = 0x00007f1e61c5ec0c
> Found by: stack scanning
> 30 thrift-server-test!ldap_int_destroy_global_options + 0x80
> rsp = 0x00007fffc2279980 rip = 0x0000000000aaa4b0
> Found by: stack scanning
> 31 thrift-server-test!_GLOBAL__sub_I_json_escaping.cc + 0x2e
> rsp = 0x00007fffc2279998 rip = 0x0000000000b06b0e
> Found by: stack scanning
> 32 0x7fffc2279a30
> rsp = 0x00007fffc22799a0 rip = 0x00007fffc2279a30
> Found by: call frame info
> 33 ld-2.17.so + 0xf47f
> rsp = 0x00007fffc22799e0 rip = 0x00007f1e656c547f
> Found by: stack scanning
> 34 thrift-server-test!_GLOBAL__sub_I_json_escaping.cc + 0x2e
> rsp = 0x00007fffc2279a08 rip = 0x0000000000b06b0e
> Found by: stack scanning
> 35 0x7fffc2279a30
> rsp = 0x00007fffc2279a10 rip = 0x00007fffc2279a30
> Found by: call frame info
> 36 thrift-server-test!_start + 0x29
> rsp = 0x00007fffc2279a20 rip = 0x0000000000b06b37
> Found by: stack scanning
> 37 0x7fffc2279a28
> rsp = 0x00007fffc2279a28 rip = 0x00007fffc2279a28
> Found by: call frame info
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org