You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2025/08/04 11:19:00 UTC
[jira] [Updated] (IMPALA-14278) MemTracker data race TSAN build failure between ExecEnv and Webserver
[ https://issues.apache.org/jira/browse/IMPALA-14278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Quanlong Huang updated IMPALA-14278:
------------------------------------
Description:
[https://master-03.jenkins.cloudera.com/job/impala-asf-master-core-tsan/496/testReport]
h3. Error Message
{code}
Thread Sanitizer message detected in /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/logs/data_loading/impalad.impala-ec2-redhat86-m6i-4xlarge-ondemand-1d1a.vpc.cloudera.com.jenkins.log.ERROR.20250728-171802.60555{code}
h3. Standard Error
{code}
WARNING: ThreadSanitizer: data race (pid=60555)
Read of size 8 at 0x7b5c000087a0 by thread T207:
#0 std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2>::__shared_ptr(std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2> const&) /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/gcc-10.4.0/lib/gcc/x86_64-pc-linux-gnu/10.4.0/../../../../include/c++/10.4.0/bits/shared_ptr_base.h:1186:7 (impalad+0x29ba980)
#1 std::shared_ptr<impala::MemTracker>::shared_ptr(std::shared_ptr<impala::MemTracker> const&) /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/gcc-10.4.0/lib/gcc/x86_64-pc-linux-gnu/10.4.0/../../../../include/c++/10.4.0/bits/shared_ptr.h:149:7 (impalad+0x29b5fe0)
#2 impala::Webserver::SendResponse(sq_connection*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/webserver.cc:633:7 (impalad+0x3038cc8)
#3 impala::Webserver::BeginRequestCallback(sq_connection*, sq_request_info*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/webserver.cc:1063:3 (impalad+0x303b96d)
#4 impala::Webserver::BeginRequestCallbackStatic(sq_connection*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/webserver.cc:723:20 (impalad+0x30389c8)
#5 handle_request <null> (impalad+0x3052449)
Previous write of size 8 at 0x7b5c000087a0 by main thread:
[failed to restore the stack]
Location is heap block of size 792 at 0x7b5c00008500 allocated by main thread:
#0 operator new(unsigned long) <null> (impalad+0x2179bea)
#1 impala::ExecEnv::ExecEnv(int, int, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, bool) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/runtime/exec-env.cc:248:16 (impalad+0x2835ca0)
#2 impala::ExecEnv::ExecEnv(bool) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/runtime/exec-env.cc:226:5 (impalad+0x2835999)
#3 ImpaladMain(int, char**) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/impalad-main.cc:75:11 (impalad+0x2c84991)
#4 main /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/daemon-main.cc:38:12 (impalad+0x217b2ba)
Thread T207 'sq_worker' (tid=61451, running) created by thread T205 at:
#0 pthread_create <null> (impalad+0x211bff3)
#1 sq_start_thread <null> (impalad+0x304a2c4)
SUMMARY: ThreadSanitizer: data race /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/gcc-10.4.0/lib/gcc/x86_64-pc-linux-gnu/10.4.0/../../../../include/c++/10.4.0/bits/shared_ptr_base.h:1186:7 in std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2>::__shared_ptr(std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2> const&)
=================={code}
was:
[https://master-03.jenkins.cloudera.com/job/impala-asf-master-core-tsan/496/testReport]
h3. Error Message
{code}
Thread Sanitizer message detected in /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/logs/data_loading/impalad.impala-ec2-redhat86-m6i-4xlarge-ondemand-1d1a.vpc.cloudera.com.jenkins.log.ERROR.20250728-171802.60555{code}
h3. Standard Error
{code}
WARNING: ThreadSanitizer: data race (pid=60555) Read of size 8 at 0x7b5c000087a0 by thread T207: #0 std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2>::__shared_ptr(std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2> const&) /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/gcc-10.4.0/lib/gcc/x86_64-pc-linux-gnu/10.4.0/../../../../include/c++/10.4.0/bits/shared_ptr_base.h:1186:7 (impalad+0x29ba980) #1 std::shared_ptr<impala::MemTracker>::shared_ptr(std::shared_ptr<impala::MemTracker> const&) /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/gcc-10.4.0/lib/gcc/x86_64-pc-linux-gnu/10.4.0/../../../../include/c++/10.4.0/bits/shared_ptr.h:149:7 (impalad+0x29b5fe0) #2 impala::Webserver::SendResponse(sq_connection*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/webserver.cc:633:7 (impalad+0x3038cc8) #3 impala::Webserver::BeginRequestCallback(sq_connection*, sq_request_info*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/webserver.cc:1063:3 (impalad+0x303b96d) #4 impala::Webserver::BeginRequestCallbackStatic(sq_connection*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/webserver.cc:723:20 (impalad+0x30389c8) #5 handle_request <null> (impalad+0x3052449) Previous write of size 8 at 0x7b5c000087a0 by main thread: [failed to restore the stack] Location is heap block of size 792 at 0x7b5c00008500 allocated by main thread: #0 operator new(unsigned long) <null> (impalad+0x2179bea) #1 impala::ExecEnv::ExecEnv(int, int, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, bool) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/runtime/exec-env.cc:248:16 (impalad+0x2835ca0) #2 impala::ExecEnv::ExecEnv(bool) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/runtime/exec-env.cc:226:5 (impalad+0x2835999) #3 ImpaladMain(int, char**) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/impalad-main.cc:75:11 (impalad+0x2c84991) #4 main /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/daemon-main.cc:38:12 (impalad+0x217b2ba) Thread T207 'sq_worker' (tid=61451, running) created by thread T205 at: #0 pthread_create <null> (impalad+0x211bff3) #1 sq_start_thread <null> (impalad+0x304a2c4) SUMMARY: ThreadSanitizer: data race /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/gcc-10.4.0/lib/gcc/x86_64-pc-linux-gnu/10.4.0/../../../../include/c++/10.4.0/bits/shared_ptr_base.h:1186:7 in std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2>::__shared_ptr(std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2> const&) =================={code}
> MemTracker data race TSAN build failure between ExecEnv and Webserver
> ---------------------------------------------------------------------
>
> Key: IMPALA-14278
> URL: https://issues.apache.org/jira/browse/IMPALA-14278
> Project: IMPALA
> Issue Type: Bug
> Reporter: Surya Hebbar
> Assignee: Surya Hebbar
> Priority: Major
>
> [https://master-03.jenkins.cloudera.com/job/impala-asf-master-core-tsan/496/testReport]
> h3. Error Message
> {code}
> Thread Sanitizer message detected in /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/logs/data_loading/impalad.impala-ec2-redhat86-m6i-4xlarge-ondemand-1d1a.vpc.cloudera.com.jenkins.log.ERROR.20250728-171802.60555{code}
> h3. Standard Error
> {code}
> WARNING: ThreadSanitizer: data race (pid=60555)
> Read of size 8 at 0x7b5c000087a0 by thread T207:
> #0 std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2>::__shared_ptr(std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2> const&) /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/gcc-10.4.0/lib/gcc/x86_64-pc-linux-gnu/10.4.0/../../../../include/c++/10.4.0/bits/shared_ptr_base.h:1186:7 (impalad+0x29ba980)
> #1 std::shared_ptr<impala::MemTracker>::shared_ptr(std::shared_ptr<impala::MemTracker> const&) /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/gcc-10.4.0/lib/gcc/x86_64-pc-linux-gnu/10.4.0/../../../../include/c++/10.4.0/bits/shared_ptr.h:149:7 (impalad+0x29b5fe0)
> #2 impala::Webserver::SendResponse(sq_connection*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/webserver.cc:633:7 (impalad+0x3038cc8)
> #3 impala::Webserver::BeginRequestCallback(sq_connection*, sq_request_info*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/webserver.cc:1063:3 (impalad+0x303b96d)
> #4 impala::Webserver::BeginRequestCallbackStatic(sq_connection*) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/webserver.cc:723:20 (impalad+0x30389c8)
> #5 handle_request <null> (impalad+0x3052449)
> Previous write of size 8 at 0x7b5c000087a0 by main thread:
> [failed to restore the stack]
> Location is heap block of size 792 at 0x7b5c00008500 allocated by main thread:
> #0 operator new(unsigned long) <null> (impalad+0x2179bea)
> #1 impala::ExecEnv::ExecEnv(int, int, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, bool) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/runtime/exec-env.cc:248:16 (impalad+0x2835ca0)
> #2 impala::ExecEnv::ExecEnv(bool) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/runtime/exec-env.cc:226:5 (impalad+0x2835999)
> #3 ImpaladMain(int, char**) /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/impalad-main.cc:75:11 (impalad+0x2c84991)
> #4 main /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/daemon-main.cc:38:12 (impalad+0x217b2ba)
> Thread T207 'sq_worker' (tid=61451, running) created by thread T205 at:
> #0 pthread_create <null> (impalad+0x211bff3)
> #1 sq_start_thread <null> (impalad+0x304a2c4)
> SUMMARY: ThreadSanitizer: data race /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/gcc-10.4.0/lib/gcc/x86_64-pc-linux-gnu/10.4.0/../../../../include/c++/10.4.0/bits/shared_ptr_base.h:1186:7 in std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2>::__shared_ptr(std::__shared_ptr<impala::MemTracker, (__gnu_cxx::_Lock_policy)2> const&)
> =================={code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org