You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Adar Dembo (JIRA)" <ji...@apache.org> on 2019/02/02 19:52:00 UTC
[jira] [Commented] (KUDU-2212) TSAN "destroy of locked mutex"
failure in kudu-admin-test
[ https://issues.apache.org/jira/browse/KUDU-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16759167#comment-16759167 ]
Adar Dembo commented on KUDU-2212:
----------------------------------
Happened again in kudu-tool-test, during a run of {{kudu perf loadgen}}
{noformat}
==================
WARNING: ThreadSanitizer: destroy of a locked mutex (pid=4352)
#0 pthread_rwlock_destroy /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-6.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1313 (kudu+0x4b0134)
#1 glog_internal_namespace_::Mutex::~Mutex() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/base/mutex.h:249:30 (libglog.so.0+0x16488)
#2 cxa_at_exit_wrapper(void*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-6.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:386 (kudu+0x4804c3)
and:
#0 pthread_rwlock_destroy /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-6.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1313 (kudu+0x4b0134)
#1 glog_internal_namespace_::Mutex::~Mutex() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/base/mutex.h:249:30 (libglog.so.0+0x16488)
#2 cxa_at_exit_wrapper(void*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-6.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:386 (kudu+0x4804c3)
Location is global 'google::log_mutex' of size 64 at 0x7f47c0ba19b8 (libglog.so.0+0x00000022c9b8)
Mutex M121 (0x7f47c0ba19b8) created at:
#0 pthread_rwlock_init /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-6.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1304 (kudu+0x4b03a4)
#1 glog_internal_namespace_::Mutex::Mutex() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/base/mutex.h:247:19 (libglog.so.0+0xc6a3)
#2 __cxx_global_var_init.130 /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/logging.cc:372 (libglog.so.0+0xc6a3)
#3 _GLOBAL__sub_I_logging.cc /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/logging.cc (libglog.so.0+0xc6a3)
#4 call_init /build/eglibc-SvCtMH/eglibc-2.19/elf/dl-init.c:78 (ld-linux-x86-64.so.2+0x102d9)
SUMMARY: ThreadSanitizer: destroy of a locked mutex /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/base/mutex.h:249:30 in glog_internal_namespace_::Mutex::~Mutex()
==================
{noformat}
I'm attaching the full log.
> TSAN "destroy of locked mutex" failure in kudu-admin-test
> ---------------------------------------------------------
>
> Key: KUDU-2212
> URL: https://issues.apache.org/jira/browse/KUDU-2212
> Project: Kudu
> Issue Type: Bug
> Components: test
> Reporter: Todd Lipcon
> Priority: Major
> Attachments: kudu-tool-test.0.txt.gz
>
>
> admin cli test is flaky with:
> WARNING: ThreadSanitizer: destroy of a locked mutex (pid=16401)
> #0 pthread_rwlock_destroy /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-4.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1214 (kudu+0x49c866)
> #1 glog_internal_namespace_::Mutex::~Mutex() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/base/mutex.h:249:30 (libglog.so.0+0x15878)
> #2 at_exit_wrapper(void*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-4.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:375 (kudu+0x4706a3)
> and:
> #0 memcpy /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-4.0.0.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:655 (kudu+0x49344c)
> #1 std::__1::char_traits<char>::copy(char*, char const*, unsigned long) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/__string:223:50 (kudu+0x51285e)
> #2 std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >::__init(char const*, unsigned long) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/string:1538:5 (libkudu_util.so+0x13c118)
> #3 std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >::basic_string(char const*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/string:1547 (libkudu_util.so+0x13c118)
> #4 kudu::flag_tags_internal::FlagTagger::FlagTagger(char const*, char const*) /data/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/flag_tags.cc:76 (libkudu_util.so+0x13c118)
> #5 __cxx_global_var_init.8 /data/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/rpc_server.cc:54:1 (libserver_process.so+0x5f7c8)
> #6 _GLOBAL__sub_I_rpc_server.cc /data/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/rpc_server.cc (libserver_process.so+0x5fcfc)
> #7 _dl_init_internal <null> (ld-linux-x86-64.so.2+0xe64e)
> Location is global 'google::log_mutex' of size 64 at 0x7ff79ecd3038 (libglog.so.0+0x00000022b038)
> Mutex M115 (0x7ff79ecd3038) created at:
> #0 pthread_rwlock_init /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-4.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1205 (kudu+0x49ca9c)
> #1 glog_internal_namespace_::Mutex::Mutex() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/base/mutex.h:247:19 (libglog.so.0+0xc5f3)
> #2 __cxx_global_var_init.130 /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/logging.cc:372 (libglog.so.0+0xc5f3)
> #3 _GLOBAL__sub_I_logging.cc /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/logging.cc (libglog.so.0+0xc5f3)
> #4 _dl_init_internal <null> (ld-linux-x86-64.so.2+0xe64e)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)