You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2023/01/13 02:50:51 UTC

[GitHub] [doris] Gabriel39 opened a new issue, #15891: [Bug]

Gabriel39 opened a new issue, #15891:
URL: https://github.com/apache/doris/issues/15891

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   master
   
   ### What's Wrong?
   
   ==3286108==ERROR: AddressSanitizer: heap-use-after-free on address 0x6040025d38f0 at pc 0x55cfb377fe5c bp 0x7f55960ec470 sp 0x7f55960ec
   460
   READ of size 8 at 0x6040025d38f0 thread T1128
   #0 0x55cfb377fe5b in std::__uniq_ptr_impl<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> >::_M_ptr() c
   onst /var/local/ldb_toolchain/include/c++/11/bits/unique_ptr.h:173
   #1 0x55cfb377ab65 in std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> >::get() const /va
   r/local/ldb_toolchain/include/c++/11/bits/unique_ptr.h:422
   #2 0x55cfb3777f0b in std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> >::operator*() con
   st /var/local/ldb_toolchain/include/c++/11/bits/unique_ptr.h:408
   #3 0x55cfb376fd20 in doris::pipeline::ExchangeSinkBuffer::_send_rpc(long) /home/zcp/repo_center/doris_master/doris/be/src/pipeline/
   exec/exchange_sink_buffer.cpp:196
   #4 0x55cfb376f50a in operator() /home/zcp/repo_center/doris_master/doris/be/src/pipeline/exec/exchange_sink_buffer.cpp:190
   #5 0x55cfb377175e in __invoke_impl<void, doris::pipeline::ExchangeSinkBuffer::_send_rpc(doris::pipeline::InstanceLoId)::<lambda(con
   st InstanceLoId&, bool const&, const doris::PTransmitDataResult&)>&, long int const&, bool const&, const doris::PTransmitDataResult&> /
   var/local/ldb_toolchain/include/c++/11/bits/invoke.h:61
   #6 0x55cfb377147c in __invoke_r<void, doris::pipeline::ExchangeSinkBuffer::_send_rpc(doris::pipeline::InstanceLoId)::<lambda(const
   InstanceLoId&, bool const&, const doris::PTransmitDataResult&)>&, long int const&, bool const&, const doris::PTransmitDataResult&> /var
   /local/ldb_toolchain/include/c++/11/bits/invoke.h:111
   #7 0x55cfb3770eee in _M_invoke /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:291
   #8 0x55cfb37a9617 in std::function<void (long const&, bool const&, doris::PTransmitDataResult const&)>::operator()(long const&, boo
   l const&, doris::PTransmitDataResult const&) const /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:560
   #9 0x55cfb37a8f91 in doris::pipeline::SelfDeleteClosure<doris::PTransmitDataResult>::Run() /home/zcp/repo_center/doris_master/doris
   /be/src/pipeline/exec/exchange_sink_buffer.cpp:57
   #10 0x55cfb458af3a in brpc::Controller::EndRPC(brpc::Controller::CompletionInfo const&) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/do
   ris_be+0x23b49f3a)
   #11 0x55cfb45b569e in brpc::policy::ProcessRpcResponse(brpc::InputMessageBase*) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0
   x23b7469e)
   #12 0x55cfb45ac6c6 in brpc::ProcessInputMessage(void*) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x23b6b6c6)
   #13 0x55cfb45ad5e0 in brpc::InputMessenger::OnNewMessages(brpc::Socket*) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x23b6c5
   e0)
   #14 0x55cfb46cfe1d in brpc::Socket::ProcessEvent(void*) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x23c8ee1d)
   #15 0x55cfb454131e in bthread::TaskGroup::task_runner(long) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x23b0031e)
   #16 0x55cfb453e790 in bthread_make_fcontext (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x23afd790)
   
   0x6040025d38f0 is located 32 bytes inside of 40-byte region [0x6040025d38d0,0x6040025d38f8)
   freed by thread T219 (TaskSchedulerTh) here:
   #0 0x55cfa27db767 in operator delete(void*, unsigned long) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x11d9a767)
   #1 0x55cfb378850a in __gnu_cxx::new_allocator<phmap::priv::Deallocate<8ul, std::allocator<std::pair<long const, std::unique_ptr<dor
   is::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >(std::allocator<std::pair<long const, std::unique_ptr<d
   oris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > >, void, unsigned long)::M>::deallocate(phmap::priv:
   eallocate<8ul, std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDat
   aParams> > > > >(std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitD
   ataParams> > > >, void, unsigned long)::M*, unsigned long) /var/local/ldb_toolchain/include/c++/11/ext/new_allocator.h:139
   #2 0x55cfb3783ec3 in phmap::allocator_traits<std::allocator<phmap::priv::Deallocate<8ul, std::allocator<std::pair<long const, std::
   unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >(std::allocator<std::pair<long const, std
   ::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > >, void, unsigned long)::M> >::deallocat
   e(std::allocator<phmap::priv::Deallocate<8ul, std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::def
   ault_delete<doris::PTransmitDataParams> > > > >(std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::d
   efault_delete<doris::PTransmitDataParams> > > >, void, unsigned long)::M>&, phmap::priv::Deallocate<8ul, std::allocator<std::pair<lon
   g const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >(std::allocator<std::pair<l
   ong const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > >, void, unsigned long)::M
   *, unsigned long) /home/zcp/repo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap_base.h:1483
   #3 0x55cfb377ed08 in void phmap::priv::Deallocate<8ul, std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataPar
   ams, std::default_delete<doris::PTransmitDataParams> > > > >(std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataP
   arams, std::default_delete<doris::PTransmitDataParams> > > >, void, unsigned long) /home/zcp/repo_center/doris_master/doris/thirdpart
   y/installed/include/parallel_hashmap/phmap_base.h:4381
   #4 0x55cfb379b157 in phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std
   ::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::un
   ique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::resize(unsigned long) /home/zcp/repo_cent
   er/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:1893
   #5 0x55cfb3793a21 in phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std
   ::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::un
   ique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::rehash_and_grow_if_necessary() /home/zcp/
   repo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:1969
   #6 0x55cfb3790118 in phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std
   ::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::un
   ique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::prepare_insert(unsigned long) /home/zcp/r
   epo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2060
   #7 0x55cfb378cde7 in std::pair<unsigned long, bool> phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<
   doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocato
   r<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::find_or_pr
   epare_insert<long>(long const&, unsigned long) /home/zcp/repo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/p
   hmap.h:2048
   #8 0x55cfb37874f4 in std::pair<unsigned long, bool> phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<
   doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocato
   r<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::find_or_pr
   epare_insert<long>(long const&) /home/zcp/repo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2053
   #9 0x55cfb3782756 in std::pair<phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataP
   arams, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long cons
   t, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::iterator, bool> phmap::priv::ra
   w_hash_map<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataPar
   ams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std
   ::default_delete<doris::PTransmitDataParams> > > > >::try_emplace_impl<long const&>(long const&) /home/zcp/repo_center/doris_master/dor
   is/thirdparty/installed/include/parallel_hashmap/phmap.h:2328
   #10 0x55cfb377c407 in std::pair<phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitData
   Params, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long con
   st, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::iterator, bool> phmap::priv::r
   aw_hash_map<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataPa
   rams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, st
   d::default_delete<doris::PTransmitDataParams> > > > >::try_emplace<long, , 0>(long const&) /home/zcp/repo_center/doris_master/doris/thi
   rdparty/installed/include/parallel_hashmap/phmap.h:2276
   #11 0x55cfb3777c80 in decltype (phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std::default_delet
   e<doris::PTransmitDataParams> > >::value(addressof((declval<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::defa
   ult_delete<doris::PTransmitDataParams> > >&>)()))) phmap::priv::raw_hash_map<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris
   ::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std
   ::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::operator[]<long
   , phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > >
   >(long const&) /home/zcp/repo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2312
   #12 0x55cfb376f91c in doris::pipeline::ExchangeSinkBuffer::_send_rpc(long) /home/zcp/repo_center/doris_master/doris/be/src/pipeline
   /exec/exchange_sink_buffer.cpp:167
   #13 0x55cfb376ed90 in doris::pipeline::ExchangeSinkBuffer::add_block(doris::pipeline::TransmitInfo&&) /home/zcp/repo_center/doris_m
   aster/doris/be/src/pipeline/exec/exchange_sink_buffer.cpp:150
   #14 0x55cfb2a07fa7 in doris::vectorized::PipChannel::send_block(doris::PBlock*, bool) /home/zcp/repo_center/doris_master/doris/be/s
   rc/vec/sink/vdata_stream_sender.h:383
   #15 0x55cfb29f91b3 in doris::vectorized::VDataStreamSender::send(doris::RuntimeState*, doris::vectorized::Block*, bool) /home/zcp/r
   epo_center/doris_master/doris/be/src/vec/sink/vdata_stream_sender.cpp:510
   #16 0x55cfb3765d80 in doris::pipeline::DataSinkOperator<doris::pipeline::ExchangeSinkOperatorBuilder>::sink(doris::RuntimeState*, d
   oris::vectorized::Block*, doris::pipeline::SourceState) /home/zcp/repo_center/doris_master/doris/be/src/pipeline/exec/operator.h:278
   #17 0x55cfb36afdb4 in doris::pipeline::PipelineTask::execute(bool*) /home/zcp/repo_center/doris_master/doris/be/src/pipeline/pipeli
   ne_task.cpp:180
   #18 0x55cfb36d3e67 in doris::pipeline::TaskScheduler::_do_work(unsigned long) /home/zcp/repo_center/doris_master/doris/be/src/pipel
   ine/task_scheduler.cpp:245
   #19 0x55cfb36e0c84 in void std::__invoke_impl<void, void (doris::pipeline::TaskScheduler::*&)(unsigned long), doris::pipeline::Task
   Scheduler*&, unsigned long&>(std::__invoke_memfun_deref, void (doris::pipeline::TaskScheduler::*&)(unsigned long), doris::pipeline::Tas
   kScheduler*&, unsigned long&) /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:74
   #20 0x55cfb36e0a5e in std::__invoke_result<void (doris::pipeline::TaskScheduler::*&)(unsigned long), doris::pipeline::TaskScheduler
   &, unsigned long&>::type std::__invoke<void (doris::pipeline::TaskScheduler::&)(unsigned long), doris::pipeline::TaskScheduler*&, uns
   igned long&>(void (doris::pipeline::TaskScheduler::&)(unsigned long), doris::pipeline::TaskScheduler&, unsigned long&) /var/local/ldb
   _toolchain/include/c++/11/bits/invoke.h:96
   #21 0x55cfb36e0822 in void std::_Bind<void (doris::pipeline::TaskScheduler::(doris::pipeline::TaskScheduler, unsigned long))(unsi
   gned long)>::__call<void, , 0ul, 1ul>(std::tuple<>&&, std::_Index_tuple<0ul, 1ul>) /var/local/ldb_toolchain/include/c++/11/functional:4
   20
   #22 0x55cfb36e03ac in void std::_Bind<void (doris::pipeline::TaskScheduler::(doris::pipeline::TaskScheduler, unsigned long))(unsi
   gned long)>::operator()<, void>() /var/local/ldb_toolchain/include/c++/11/functional:503
   #23 0x55cfb36dfb75 in void std::__invoke_impl<void, std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::TaskSchedul
   er*, unsigned long))(unsigned long)>&>(std::__invoke_other, std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::TaskSch
   eduler*, unsigned long))(unsigned long)>&) /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:61
   #24 0x55cfb36def73 in std::enable_if<is_invocable_r_v<void, std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::Tas
   kScheduler*, unsigned long))(unsigned long)>&>, void>::type std::__invoke_r<void, std::_Bind<void (doris::pipeline::TaskScheduler::*(do
   ris::pipeline::TaskScheduler*, unsigned long))(unsigned long)>&>(std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::Ta
   skScheduler*, unsigned long))(unsigned long)>&) /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:111
   #25 0x55cfb36dd808 in std::_Function_handler<void (), std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::TaskSched
   uler*, unsigned long))(unsigned long)> >::_M_invoke(std::_Any_data const&) /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:
   291
   #26 0x55cfa4417777 in std::function<void ()>::operator()() const /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:560
   #27 0x55cfa4df20c1 in doris::FunctionRunnable::run() /home/zcp/repo_center/doris_master/doris/be/src/util/threadpool.cpp:46
   #28 0x55cfa4ded1b3 in doris::ThreadPool::dispatch_thread() /home/zcp/repo_center/doris_master/doris/be/src/util/threadpool.cpp:535
   #29 0x55cfa4e0f199 in void std::_invoke_impl<void, void (doris::ThreadPool::&)(), doris::ThreadPool&>(std::_invoke_memfun_deref
   , void (doris::ThreadPool::&)(), doris::ThreadPool&) /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:74
   
   previously allocated by thread T219 (TaskSchedulerTh) here:
   #0 0x55cfa27da707 in operator new(unsigned long) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x11d99707)
   #1 0x55cfb37a579b in __gnu_cxx::new_allocator<phmap::priv::Allocate<8ul, std::allocator<std::pair<long const, std::unique_ptr<doris
   ::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >(std::allocator<std::pair<long const, std::unique_ptr<dor
   is::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > >*, unsigned long)::M>::allocate(unsigned long, void const
   *) /var/local/ldb_toolchain/include/c++/11/ext/new_allocator.h:121
   #2 0x55cfb37a310a in phmap::allocator_traits<std::allocator<phmap::priv::Allocate<8ul, std::allocator<std::pair<long const, std::un
   ique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >(std::allocator<std::pair<long const, std::
   unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > >*, unsigned long)::M> >::allocate(std::allo
   cator<phmap::priv::Allocate<8ul, std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<d
   oris::PTransmitDataParams> > > > >(std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete
   <doris::PTransmitDataParams> > > >*, unsigned long)::M>&, unsigned long) /home/zcp/repo_center/doris_master/doris/thirdparty/installed/
   include/parallel_hashmap/phmap_base.h:1468
   #3 0x55cfb37a1162 in void* phmap::priv::Allocate<8ul, std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataPara
   ms, std::default_delete<doris::PTransmitDataParams> > > > >(std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataPa
   rams, std::default_delete<doris::PTransmitDataParams> > > >*, unsigned long) /home/zcp/repo_center/doris_master/doris/thirdparty/instal
   led/include/parallel_hashmap/phmap_base.h:4363
   #4 0x55cfb379ee3a in phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std
   ::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::un
   ique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::initialize_slots() /home/zcp/repo_center/
   doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:1845
   #5 0x55cfb379aeb5 in phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std
   ::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::un
   ique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::resize(unsigned long) /home/zcp/repo_cent
   er/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:1877
   #6 0x55cfb379399b in phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std
   ::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::un
   ique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::rehash_and_grow_if_necessary() /home/zcp/
   repo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:1963
   #7 0x55cfb3790118 in phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std
   ::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::un
   ique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::prepare_insert(unsigned long) /home/zcp/r
   epo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2060
   #8 0x55cfb378cde7 in std::pair<unsigned long, bool> phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<
   doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocato
   r<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::find_or_pr
   epare_insert<long>(long const&, unsigned long) /home/zcp/repo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/p
   hmap.h:2048
   #9 0x55cfb37874f4 in std::pair<unsigned long, bool> phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<
   doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocato
   r<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::find_or_pr
   epare_insert<long>(long const&) /home/zcp/repo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2053
   #10 0x55cfb3782756 in std::pair<phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitData
   Params, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long con
   st, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::iterator, bool> phmap::priv::r
   aw_hash_map<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataPa
   rams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, st
   d::default_delete<doris::PTransmitDataParams> > > > >::try_emplace_impl<long const&>(long const&) /home/zcp/repo_center/doris_master/do
   ris/thirdparty/installed/include/parallel_hashmap/phmap.h:2328
   #11 0x55cfb377c407 in std::pair<phmap::priv::raw_hash_set<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitData
   Params, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long con
   st, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::iterator, bool> phmap::priv::r
   aw_hash_map<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataPa
   rams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, st
   d::default_delete<doris::PTransmitDataParams> > > > >::try_emplace<long, , 0>(long const&) /home/zcp/repo_center/doris_master/doris/thi
   rdparty/installed/include/parallel_hashmap/phmap.h:2276
   #12 0x55cfb3777c80 in decltype (phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std::default_delet
   e<doris::PTransmitDataParams> > >::value(addressof((declval<std::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::defa
   ult_delete<doris::PTransmitDataParams> > >&>)()))) phmap::priv::raw_hash_map<phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris
   ::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > >, phmap::Hash<long>, phmap::EqualTo<long>, std::allocator<std
   ::pair<long const, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > > > >::operator[]<long
   , phmap::priv::FlatHashMapPolicy<long, std::unique_ptr<doris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> > >
   >(long const&) /home/zcp/repo_center/doris_master/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2312
   #13 0x55cfb376f91c in doris::pipeline::ExchangeSinkBuffer::_send_rpc(long) /home/zcp/repo_center/doris_master/doris/be/src/pipeline
   /exec/exchange_sink_buffer.cpp:167
   #14 0x55cfb376ed90 in doris::pipeline::ExchangeSinkBuffer::add_block(doris::pipeline::TransmitInfo&&) /home/zcp/repo_center/doris_m
   aster/doris/be/src/pipeline/exec/exchange_sink_buffer.cpp:150
   #15 0x55cfb2a07fa7 in doris::vectorized::PipChannel::send_block(doris::PBlock*, bool) /home/zcp/repo_center/doris_master/doris/be/s
   rc/vec/sink/vdata_stream_sender.h:383
   #16 0x55cfb29f91b3 in doris::vectorized::VDataStreamSender::send(doris::RuntimeState*, doris::vectorized::Block*, bool) /home/zcp/r
   epo_center/doris_master/doris/be/src/vec/sink/vdata_stream_sender.cpp:510
   #17 0x55cfb3765d80 in doris::pipeline::DataSinkOperator<doris::pipeline::ExchangeSinkOperatorBuilder>::sink(doris::RuntimeState*, d
   oris::vectorized::Block*, doris::pipeline::SourceState) /home/zcp/repo_center/doris_master/doris/be/src/pipeline/exec/operator.h:278
   #18 0x55cfb36afdb4 in doris::pipeline::PipelineTask::execute(bool*) /home/zcp/repo_center/doris_master/doris/be/src/pipeline/pipeli
   ne_task.cpp:180
   #19 0x55cfb36d3e67 in doris::pipeline::TaskScheduler::_do_work(unsigned long) /home/zcp/repo_center/doris_master/doris/be/src/pipel
   ine/task_scheduler.cpp:245
   #20 0x55cfb36e0c84 in void std::__invoke_impl<void, void (doris::pipeline::TaskScheduler::*&)(unsigned long), doris::pipeline::Task
   Scheduler*&, unsigned long&>(std::__invoke_memfun_deref, void (doris::pipeline::TaskScheduler::*&)(unsigned long), doris::pipeline::Tas
   kScheduler*&, unsigned long&) /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:74
   #21 0x55cfb36e0a5e in std::__invoke_result<void (doris::pipeline::TaskScheduler::*&)(unsigned long), doris::pipeline::TaskScheduler
   &, unsigned long&>::type std::__invoke<void (doris::pipeline::TaskScheduler::&)(unsigned long), doris::pipeline::TaskScheduler*&, uns
   igned long&>(void (doris::pipeline::TaskScheduler::&)(unsigned long), doris::pipeline::TaskScheduler&, unsigned long&) /var/local/ldb
   _toolchain/include/c++/11/bits/invoke.h:96
   #22 0x55cfb36e0822 in void std::_Bind<void (doris::pipeline::TaskScheduler::(doris::pipeline::TaskScheduler, unsigned long))(unsi
   gned long)>::__call<void, , 0ul, 1ul>(std::tuple<>&&, std::_Index_tuple<0ul, 1ul>) /var/local/ldb_toolchain/include/c++/11/functional:4
   20
   #23 0x55cfb36e03ac in void std::_Bind<void (doris::pipeline::TaskScheduler::(doris::pipeline::TaskScheduler, unsigned long))(unsi
   gned long)>::operator()<, void>() /var/local/ldb_toolchain/include/c++/11/functional:503
   #24 0x55cfb36dfb75 in void std::__invoke_impl<void, std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::TaskSchedul
   er*, unsigned long))(unsigned long)>&>(std::__invoke_other, std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::TaskSch
   eduler*, unsigned long))(unsigned long)>&) /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:61
   #25 0x55cfb36def73 in std::enable_if<is_invocable_r_v<void, std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::Tas
   kScheduler*, unsigned long))(unsigned long)>&>, void>::type std::__invoke_r<void, std::_Bind<void (doris::pipeline::TaskScheduler::*(do
   ris::pipeline::TaskScheduler*, unsigned long))(unsigned long)>&>(std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::Ta
   skScheduler*, unsigned long))(unsigned long)>&) /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:111
   #26 0x55cfb36dd808 in std::_Function_handler<void (), std::_Bind<void (doris::pipeline::TaskScheduler::*(doris::pipeline::TaskSched
   uler*, unsigned long))(unsigned long)> >::_M_invoke(std::_Any_data const&) /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:
   291
   #27 0x55cfa4417777 in std::function<void ()>::operator()() const /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:560
   #28 0x55cfa4df20c1 in doris::FunctionRunnable::run() /home/zcp/repo_center/doris_master/doris/be/src/util/threadpool.cpp:46
   #29 0x55cfa4ded1b3 in doris::ThreadPool::dispatch_thread() /home/zcp/repo_center/doris_master/doris/be/src/util/threadpool.cpp:535
   
   Thread T1128 created by T0 here:
   #0 0x55cfa277d061 in pthread_create (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x11d3c061)
   #1 0x55cfb452c3cb in bthread::TaskControl::add_workers(int) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x23aeb3cb)
   #2 0x55cfb4528eac in bthread_setconcurrency (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x23ae7eac)
   #3 0x55cfb469a0d9 in brpc::Server::StartInternal(butil::EndPoint const&, brpc::PortRange const&, brpc::ServerOptions const*) (/mnt/
   ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x23c590d9)
   #4 0x55cfb469bfc9 in brpc::Server::Start(butil::EndPoint const&, brpc::ServerOptions const*) (/mnt/ssd01/doris-master/VEC_ASAN/be/l
   ib/doris_be+0x23c5afc9)
   #5 0x55cfb469c161 in brpc::Server::Start(int, brpc::ServerOptions const*) (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x23c5b
   161)
   #6 0x55cfa4a1e34b in doris::BRpcService::start(int, int) /home/zcp/repo_center/doris_master/doris/be/src/service/brpc_service.cpp:5
   2
   #7 0x55cfa282b44d in main /home/zcp/repo_center/doris_master/doris/be/src/service/doris_main.cpp:435
   #8 0x7f58dd87b0b2 in __libc_start_main (/lib/x86_64-linux-gnu/libc.so.6+0x240b2)
   
   Thread T219 (TaskSchedulerTh) created by T0 here:
   #0 0x55cfa277d061 in pthread_create (/mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be+0x11d3c061)
   #1 0x55cfa4dcc301 in doris::Thread::start_thread(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > co
   nst&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::function<void ()> const&, unsigned l
   ong, scoped_refptr<doris::Thread>*) /home/zcp/repo_center/doris_master/doris/be/src/util/thread.cpp:407
   #2 0x55cfa4df6a2d in doris::Status doris::Thread::create<void (doris::ThreadPool::)(), doris::ThreadPool>(std::__cxx11::basic_str
   ing<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocato
   r<char> > const&, void (doris::ThreadPool::* const&)(), doris::ThreadPool* const&, scoped_refptr<doris::Thread>*) /home/zcp/repo_center
   /doris_master/doris/be/src/util/thread.h:57
   #3 0x55cfa4dee9b6 in doris::ThreadPool::create_thread() /home/zcp/repo_center/doris_master/doris/be/src/util/threadpool.cpp:604
   #4 0x55cfa4de86eb in doris::ThreadPool::init() /home/zcp/repo_center/doris_master/doris/be/src/util/threadpool.cpp:263
   #5 0x55cfa4de5163 in doris::ThreadPoolBuilder::build(std::unique_ptr<doris::ThreadPool, std::default_delete<doris::ThreadPool> >*)
   const /home/zcp/repo_center/doris_master/doris/be/src/util/threadpool.cpp:78
   #6 0x55cfb36d2bce in doris::pipeline::TaskScheduler::start() /home/zcp/repo_center/doris_master/doris/be/src/pipeline/task_schedule
   r.cpp:199
   #7 0x55cfa43fb97b in doris::ExecEnv::init_pipeline_task_scheduler() /home/zcp/repo_center/doris_master/doris/be/src/runtime/exec_en
   v_init.cpp:187
   #8 0x55cfa43f9db4 in doris::ExecEnv::init(std::vector<doris::StorePath, std::allocator<doris::StorePath> > const&) /home/zcp/repo
   center/doris_master/doris/be/src/runtime/exec_env_init.cpp:132
   #9 0x55cfa43f8be9 in doris::ExecEnv::init(doris::ExecEnv*, std::vector<doris::StorePath, std::allocator<doris::StorePath> > const&)
   /home/zcp/repo_center/doris_master/doris/be/src/runtime/exec_env_init.cpp:78
   #10 0x55cfa282ac22 in main /home/zcp/repo_center/doris_master/doris/be/src/service/doris_main.cpp:398
   #11 0x7f58dd87b0b2 in __libc_start_main (/lib/x86_64-linux-gnu/libc.so.6+0x240b2)
   
   SUMMARY: AddressSanitizer: heap-use-after-free /var/local/ldb_toolchain/include/c++/11/bits/unique_ptr.h:173 in std::__uniq_ptr_impl<do
   ris::PTransmitDataParams, std::default_delete<doris::PTransmitDataParams> >::_M_ptr() const
   
   ### What You Expected?
   
   do not crash
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] yiguolei closed issue #15891: [Bug] pipeline bug

Posted by GitBox <gi...@apache.org>.
yiguolei closed issue #15891: [Bug] pipeline bug
URL: https://github.com/apache/doris/issues/15891


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org