You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/07/21 10:19:57 UTC

[GitHub] [doris] yixiutt opened a new issue, #11079: [Bug] doris master ProcessHashTableProbe core

yixiutt opened a new issue, #11079:
URL: https://github.com/apache/doris/issues/11079

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   master
   
   ### What's Wrong?
   
   0x0000558fa1d341c8 in doris::signal::(anonymous namespace)::FailureSignalHandler (signal_number=11, signal_info=0x7f66e429e370, ucontext=0x7f66e429e240) at /home/zcp/repo_center/doris_master/be/src/common/signal_handler.h:372 #1 <signal handler called> #2 0x0000558fa1d341c8 in doris::signal::(anonymous namespace)::FailureSignalHandler (signal_number=6, signal_info=0x7f66e429ea30, ucontext=0x7f66e429e900) at /home/zcp/repo_center/doris_master/be/src/common/signal_handler.h:372 #3 <signal handler called> #4 _GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50 #5 0x00007f693536e859 in __GI_abort () at abort.c:79 #6 0x0000558fa1d0a42e in __sanitizer::Abort() () #7 0x0000558fa1d15d18 in __sanitizer::Die() () #8 0x0000558fa1cf5ae4 in __asan::ScopedInErrorReport::~ScopedInErrorReport() () #9 0x0000558fa1cf53a1 in __asan::ReportGenericError(unsigned long, unsigned long, unsigned long, unsigned long, bool, unsigned long, unsigned int, bool) () #10 0x0000558fa1cf6117 in __as
 an_report_load8 () #11 0x0000558fa21082d1 in doris::vectorized::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 15ul, 16ul>::capacity (this=0x6032139b9300) at /home/zcp/repo_center/doris_master/be/src/vec/common/pod_array.h:203 #12 0x0000558fa2100aa2 in doris::vectorized::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 15ul, 16ul>::reserve<>(unsigned long) ( this=0x6032139b9300, n=1) at /home/zcp/repo_center/doris_master/be/src/vec/common/pod_array.h:212 #13 0x0000558fa4ea1701 in doris::vectorized::ColumnVector<unsigned char>::replicate (this=0x6040027cfe90, counts=0x602000cfa010, target_size=1, column=...) at /home/zcp/repo_center/doris_master/be/src/vec/columns/column_vector.cpp:374 #14 0x0000558fa5b90431 in doris::vectorized::ProcessHashTableProbe<doris::vectorized::SerializedHashTableContext, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)1>, false>::probe_side_output_column (this=0x7f66e42a18d0, mcol=..., output_slot_flags=..., size=1) at /home/zcp/rep
 o_center/doris_master/be/src/vec/exec/join/vhash_join_node.cpp:258 #15 0x0000558fa55bca4c in doris::vectorized::ProcessHashTableProbe<doris::vectorized::SerializedHashTableContext, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)1>, false>::do_process_with_other_join_conjunts (this=0x7f66e42a18d0, hash_table_ctx=..., null_map=0x604002f68960, mutable_block=..., output_block=0x60700270b450) at /home/zcp/repo_center/doris_master/be/src/vec/exec/join/vhash_join_node.cpp:488 #16 0x0000558fa541eaa0 in operator()<doris::vectorized::SerializedHashTableContext&, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)1>&, std::integral_constant<bool, true>, std::integral_constant<bool, false> > (closure=0x7f66e42a2650, arg=..., join_op_variants=..., have_other_join_conjunct=..., probe_ignore_null=...) at /home/zcp/repo_center/doris_master/be/src/vec/exec/join/vhash_join_node.cpp:928 #17 0x0000558fa557717b in std::invoke_impl<void, doris::vectorized::HashJoinNode
 ::get_next(doris::RuntimeState*, doris::vectorized::Block*, bool*)::<lambda(auto:32&&, auto:33&&, auto:34, auto:35)>, doris::vectorized::SerializedHashTableContext&, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)1>&, std::integral_constant<bool, true>, std::integral_constant<bool, false> >(std::invoke_other, struct {...} &&) ( -Type <RET> for more, q to quit, c to continue without paging- __f=...) at /var/local/ldb_toolchain/include/c+/11/bits/invoke.h:61 #18 0x0000558fa555e7e1 in std::invoke<doris::vectorized::HashJoinNode::get_next(doris::RuntimeState*, doris::vectorized::Block*, bool*)::<lambda(auto:32&&, auto:33&&, auto:34, auto:35)>, doris::vectorized::SerializedHashTableContext&, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)1>&, std::integral_constant<bool, true>, std::integral_constant<bool, false> >(struct {...} &&) (fn=...) at /var/local/ldb_toolchain/include/c/11/bits/invoke.h:96 #19 0x0000558fa541ed24 in std::detail::variant::gen
 _vtable_impl<std::detail::variant::_Multi_array<std::detail::variant::deduce_visit_result<void> (doris::vectorized::HashJoinNode::get_next(doris::RuntimeState*, doris::vectorized::Block*, bool*)::<lambda(auto:32&&, auto:33&&, auto:34, auto:35)>&&, std::variant<std::monostate, doris::vectorized::SerializedHashTableContext, doris::vectorized::PrimaryTypeHashTableContext<unsigned char>, doris::vectorized::PrimaryTypeHashTableContext<short unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<long unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<doris::vectorized::UInt128>, doris::vectorized::PrimaryTypeHashTableContext<doris::vectorized::UInt256>, doris::vectorized::FixedKeyHashTableContext<long unsigned int, true>, doris::vectorized::FixedKeyHashTableContext<long unsigned int, false>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt128, true>, doris::vectorized::FixedKeyHashTableConte
 xt<doris::vectorized::UInt128, false>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt256, true>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt256, false> >&, std::variant<std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)0>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)2>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)8>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)1>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)4>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)3>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)5>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)7>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)9>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)10> >&, std::variant<std::integral_constant<bool, false>, std::integral_const
 ant<bool, true> >&&, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> >&&)>, std::integer_sequence<long unsigned int, 1, 3, 1, 0> >::visit_invoke(struct {...} &&, std::variant<std::monostate, doris::vectorized::SerializedHashTableContext, doris::vectorized::PrimaryTypeHashTableContext<unsigned char>, doris::vectorized::PrimaryTypeHashTableContext<unsigned short>, doris::vectorized::PrimaryTypeHashTableContext<unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<unsigned long>, doris::vectorized::PrimaryTypeHashTableContext<doris::vectorized::UInt128>, doris::vectorized::PrimaryTypeHashTableContext<doris::vectorized::UInt256>, doris::vectorized::FixedKeyHashTableContext<unsigned long, true>, doris::vectorized::FixedKeyHashTableContext<unsigned long, false>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt128, true>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt128, false>, doris::vectorized::FixedKe
 yHashTableContext<doris::vectorized::UInt256, true>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt256, false> > &, std::variant<std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)0>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)2>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)8>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)1>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)4>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)3>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)5>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)7>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)9>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)10> > &, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> > &&, std::variant<std::integral_constant<bool,
  false>, std::integral_const-Type <RET> for more, q to quit, c to continue without paging- ant<bool, true> > &&) (visitor=..., __vars#0=..., __vars#1=..., __vars#2=..., __vars#3=...) at /var/local/ldb_toolchain/include/c/11/variant:1013 #20 0x0000558fa5520f57 in std::do_visit<std::detail::variant::deduce_visit_result<void>, doris::vectorized::HashJoinNode::get_next(doris::RuntimeState*, doris::vectorized::Block*, bool*)::<lambda(auto:32&&, auto:33&&, auto:34, auto:35)>, std::variant<std::monostate, doris::vectorized::SerializedHashTableContext, doris::vectorized::PrimaryTypeHashTableContext<unsigned char>, doris::vectorized::PrimaryTypeHashTableContext<short unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<long unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<doris::vectorized::UInt128>, doris::vectorized::PrimaryTypeHashTableContext<doris::vectorized::UInt256>, doris::vectorized::FixedKeyHashTab
 leContext<long unsigned int, true>, doris::vectorized::FixedKeyHashTableContext<long unsigned int, false>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt128, true>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt128, false>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt256, true>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt256, false> >&, std::variant<std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)0>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)2>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)8>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)1>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)4>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)3>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)5>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinO
 p::type)7>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)9>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)10> >&, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> >, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> > >(struct {...} &&) (visitor=...) at /var/local/ldb_toolchain/include/c/11/variant:1714 #21 0x0000558fa5521045 in std::visit<doris::vectorized::HashJoinNode::get_next(doris::RuntimeState*, doris::vectorized::Block*, bool*)::<lambda(auto:32&&, auto:33&&, auto:34, auto:35)>, std::variant<std::monostate, doris::vectorized::SerializedHashTableContext, doris::vectorized::PrimaryTypeHashTableContext<unsigned char>, doris::vectorized::PrimaryTypeHashTableContext<short unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<long unsigned int>, doris::vectorized::PrimaryTypeHashTableContext<doris::v
 ectorized::UInt128>, doris::vectorized::PrimaryTypeHashTableContext<doris::vectorized::UInt256>, doris::vectorized::FixedKeyHashTableContext<long unsigned int, true>, doris::vectorized::FixedKeyHashTableContext<long unsigned int, false>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt128, true>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt128, false>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt256, true>, doris::vectorized::FixedKeyHashTableContext<doris::vectorized::UInt256, false> >&, std::variant<std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)0>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)2>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)8>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)1>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)4>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)3>,
  std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)5>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)7>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)9>, std::integral_constant<doris::TJoinOp::type, (doris::TJoinOp::type)10> >&, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> >, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> > >(struct {...} &&) (visitor=...) at /var/local/ldb_toolchain/include/c/11/variant:1769 #22 0x0000558fa554c7df in doris::vectorized::HashJoinNode::get_next (this=0x61b000edac80, state=0x6200001a3080, output_block=0x60700270b450, -Type <RET> for more, q to quit, c to continue without paging- eos=0x62100259ba49) at /home/zcp/repo_center/doris_master/be/src/vec/exec/join/vhash_join_node.cpp:915 #23 0x0000558fa36b1349 in doris::PlanFragmentExecutor::get_vectorized_internal (this=0x62100259b970, block=0x7f66e42a5770) at /home/zcp/rep
 o_center/doris_master/be/src/runtime/plan_fragment_executor.cpp:333 #24 0x0000558fa36b037a in doris::PlanFragmentExecutor::open_vectorized_internal (this=0x62100259b970) at /home/zcp/repo_center/doris_master/be/src/runtime/plan_fragment_executor.cpp:281 #25 0x0000558fa36af2ad in doris::PlanFragmentExecutor::open (this=0x62100259b970) at /home/zcp/repo_center/doris_master/be/src/runtime/plan_fragment_executor.cpp:237 #26 0x0000558fa3662215 in doris::FragmentExecState::execute (this=0x62100259b900) at /home/zcp/repo_center/doris_master/be/src/runtime/fragment_mgr.cpp:246 #27 0x0000558fa366a6af in doris::FragmentMgr::_exec_actual(std::shared_ptr<doris::FragmentExecState>, std::function<void (doris::PlanFragmentExecutor*)>) (this=0x614000053840, exec_state=..., cb=...) at /home/zcp/repo_center/doris_master/be/src/runtime/fragment_mgr.cpp:501 #28 0x0000558fa366c835 in operator() (closure=0x608000a1bca0) at /home/zcp/repo_center/doris_master/be/src/runtime/fragment_mgr.cpp:684 #29 0x00005
 58fa3677092 in std::invoke_impl<void, doris::FragmentMgr::exec_plan_fragment(const doris::TExecPlanFragmentParams&, doris::FragmentMgr::FinishCallback)::<lambda()>&>(std::invoke_other, struct {...} &) (f=...) at /var/local/ldb_toolchain/include/c/11/bits/invoke.h:61 #30 0x0000558fa3676c68 in std::invoke_r<void, doris::FragmentMgr::exec_plan_fragment(const doris::TExecPlanFragmentParams&, doris::FragmentMgr::FinishCallback)::<lambda()>&>(struct {...} &) (fn=...) at /var/local/ldb_toolchain/include/c+/11/bits/invoke.h:111 #31 0x0000558fa3676592 in std::_Function_handler<void(), doris::FragmentMgr::exec_plan_fragment(const doris::TExecPlanFragmentParams&, doris::FragmentMgr::FinishCallback)::<lambda()> >::_M_invoke(const std::_Any_data &) (_functor=...)
   
   ### What You Expected?
   
   fix
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org