You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2022/06/09 07:47:00 UTC
[jira] [Commented] (IMPALA-11296) The executor has some resident threads that occupy CPU abnormally.
[ https://issues.apache.org/jira/browse/IMPALA-11296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552021#comment-17552021 ]
Quanlong Huang commented on IMPALA-11296:
-----------------------------------------
I can reproduce the issue on the 3.x branch:
{code:java}
Thread 1 (process 8963):
#0 0x000000000267391e in impala::HdfsScanner::InitTupleFromTemplate (this=0x12aff400, template_tuple=0x157bd000, tuple=0x144e9b92, tuple_byte_size=5) at /var/lib/jenkins/impala/be/src/exec/hdfs-scanner.h:537
#1 0x00000000026c89bd in impala::HdfsScanner::InitTupleBuffer (this=0x12aff400, template_tuple=0x157bd000, tuple_mem=0x144e9b92 "", num_tuples=1024) at /var/lib/jenkins/impala/be/src/exec/hdfs-scanner.h:552
#2 0x00000000026c777e in impala::HdfsOrcScanner::TransferTuples (this=0x12aff400, coll_reader=0x138aefc0, dst_batch=0x13c4aa80, do_batch_read=true) at /var/lib/jenkins/impala/be/src/exec/hdfs-orc-scanner.cc:728
#3 0x00000000026c65c1 in impala::HdfsOrcScanner::AssembleRows (this=0x12aff400, row_batch=0x13c4aa80) at /var/lib/jenkins/impala/be/src/exec/hdfs-orc-scanner.cc:683
#4 0x00000000026c4ea1 in impala::HdfsOrcScanner::GetNextInternal (this=0x12aff400, row_batch=0x13c4aa80) at /var/lib/jenkins/impala/be/src/exec/hdfs-orc-scanner.cc:560
#5 0x00000000026c3832 in impala::HdfsOrcScanner::ProcessSplit (this=0x12aff400) at /var/lib/jenkins/impala/be/src/exec/hdfs-orc-scanner.cc:468
#6 0x00000000027de5ae in impala::HdfsScanNode::ProcessSplit (this=0x1095c400, filter_ctxs=..., expr_results_pool=0x7f2814ca4410, scan_range=0x13ab44c0, scanner_thread_reservation=0x7f2814ca4368) at /var/lib/jenkins/impala/be/src/exec/hdfs-scan-node.cc:515
#7 0x00000000027dd783 in impala::HdfsScanNode::ScannerThread (this=0x1095c400, first_thread=true, scanner_thread_reservation=8192) at /var/lib/jenkins/impala/be/src/exec/hdfs-scan-node.cc:417
#8 0x00000000027dcae0 in impala::HdfsScanNode::<lambda()>::operator()(void) const (__closure=0x7f2814ca4b98) at /var/lib/jenkins/impala/be/src/exec/hdfs-scan-node.cc:338
#9 0x00000000027df0d4 in boost::detail::function::void_function_obj_invoker0<impala::HdfsScanNode::ThreadTokenAvailableCb(impala::ThreadResourcePool*)::<lambda()>, void>::invoke(boost::detail::function::function_buffer &) (function_obj_ptr=...) at /var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/function/function_template.hpp:159
#10 0x0000000001fc944c in boost::function0<void>::operator() (this=0x7f2814ca4b90) at /var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/function/function_template.hpp:771
#11 0x000000000258a2ff in impala::Thread::SuperviseThread(std::string const&, std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*, impala::Promise<long, (impala::PromiseMode)0>*) (name=..., category=..., functor=..., parent_thread_info=0x7f281169e840, thread_started=0x7f281169d660) at /var/lib/jenkins/impala/be/src/util/thread.cc:360
#12 0x0000000002592583 in boost::_bi::list5<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >, boost::_bi::value<impala::ThreadDebugInfo*>, boost::_bi::value<impala::Promise<long, (impala::PromiseMode)0>*> >::operator()<void (*)(std::string const&, std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*, impala::Promise<long, (impala::PromiseMode)0>*), boost::_bi::list0>(boost::_bi::type<void>, void (*&)(std::string const&, std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*, impala::Promise<long, (impala::PromiseMode)0>*), boost::_bi::list0&, int) (this=0x13557dc0, f=@0x13557db8: 0x2589f98 <impala::Thread::SuperviseThread(std::string const&, std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*, impala::Promise<long, (impala::PromiseMode)0>*)>, a=...) at /var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/bind/bind.hpp:531
#13 0x00000000025924a7 in boost::_bi::bind_t<void, void (*)(std::string const&, std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*, impala::Promise<long, (impala::PromiseMode)0>*), boost::_bi::list5<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >, boost::_bi::value<impala::ThreadDebugInfo*>, boost::_bi::value<impala::Promise<long, (impala::PromiseMode)0>*> > >::operator()() (this=0x13557db8) at /var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/bind/bind.hpp:1222
#14 0x000000000259246a in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(std::string const&, std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*, impala::Promise<long, (impala::PromiseMode)0>*), boost::_bi::list5<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >, boost::_bi::value<impala::ThreadDebugInfo*>, boost::_bi::value<impala::Promise<long, (impala::PromiseMode)0>*> > > >::run() (this=0x13557c00) at /var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/thread/detail/thread.hpp:116
#15 0x0000000003dc1cba in thread_proxy ()
#16 0x00007f28cd127e25 in start_thread () from /lib64/libpthread.so.0
#17 0x00007f28c9c8b34d in clone () from /lib64/libc.so.6{code}
However, in the master branch, it's another symptom: IMPALA-11344. We will fix it separately.
> The executor has some resident threads that occupy CPU abnormally.
> ------------------------------------------------------------------
>
> Key: IMPALA-11296
> URL: https://issues.apache.org/jira/browse/IMPALA-11296
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 3.4.0
> Reporter: zhi tang
> Assignee: zhi tang
> Priority: Major
> Attachments: image-2022-05-17-16-40-52-110.png, top_info.png
>
>
> The executor has some resident threads that occupy CPU abnormally. The following is the call stack information of a thread:
> !image-2022-05-17-16-40-52-110.png!
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org