You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2023/01/12 07:56:59 UTC

[GitHub] [doris] jacktengg opened a new issue, #15863: [Bug] spill sort coredump

jacktengg opened a new issue, #15863:
URL: https://github.com/apache/doris/issues/15863

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   master 0fbdf8e3e16a11f48c016a98ae0e2ce69ecae9d4
   
   ### What's Wrong?
   
   be coredump when doing spill sort with the following sql:
   ```
   WITH  cte_0 AS (select       case when subq_0.`c0` is not NULL then case when subq_0.`c0` is NULL then bitmap_empty() else bitmap_empty() end          else case when subq_0.`c0` is NULL then bitmap_empty() else bitmap_empty() end          end        as c0,      ref_2.`availqty` as c1,      ref_2.`availqty` as c2,      subq_0.`c0` as c3   from      (select             ref_0.`supplycost` as c0,            ref_0.`supplycost` as c1         from            regression_test_with_clause_p0.tpch_tiny_partsupp as ref_0             right join regression_test_tpch_sf0_1_p1.lineitem as ref_1             on (ref_0.`availqty` = ref_1.`L_ORDERKEY` )         where ref_0.`availqty` is not NULL) as subq_0       inner join regression_test_query_p0_limit.tpch_tiny_partsupp as ref_2       on (false)   where ref_2.`partkey` is not NULL order by subq_0.`c1` desc  limit 128 offset 159 ) select       ref_43.`wr_order_number` as c0,      ref_16.`wr_return_tax` as c1,      ref_16.`wr_refunded_addr_sk` as c2,
       ref_41.`wr_returning_hdemo_sk` as c3,      ref_43.`wr_return_amt` as c4,      ref_41.`wr_order_number` as c5,      ref_41.`wr_account_credit` as c6,      ref_16.`wr_returned_date_sk` as c7,      ref_43.`wr_reason_sk` as c8,      ref_16.`wr_refunded_customer_sk` as c9,      bitmap_empty() as c10   from      regression_test_tpcds_sf1_unique_p1.web_returns as ref_16       inner join regression_test_tpcds_sf1_unique_p1.web_returns as ref_41       on (true)       left join regression_test_tpcds_sf1_unique_p1.customer as ref_42       on (ref_41.`wr_returning_customer_sk` = ref_42.`c_customer_sk` )       left join regression_test_tpcds_sf1_unique_p1.web_returns as ref_43       on (ref_41.`wr_fee` = ref_43.`wr_return_amt` )   where ref_43.`wr_refunded_cash` is not NULL order by ref_43.`wr_order_number`
   
   ```
   
   coredump stask:
   ```
   *** Query id: 639c15e1a67a49c1-8cdd32935b5427cd ***
   *** Aborted at 1673420022 (unix time) try "date -d @1673420022" if you are using GNU date ***
   *** Current BE git commitID: 89aa85f9b ***
   *** SIGSEGV address not mapped to object (@0x0) received by PID 670212 (TID 0x7e2b72dfd700) from PID 0; stack trace: ***
    0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /mnt/disk1/tengjianping/doris-test/be/src/common/signal_handler.h:420
    1# os::Linux::chained_handler(int, siginfo*, void*) in /mnt/disk1/tengjianping/local/jdk1.8.0_131/jre/lib/amd64/server/libjvm.so
    2# JVM_handle_linux_signal in /mnt/disk1/tengjianping/local/jdk1.8.0_131/jre/lib/amd64/server/libjvm.so
    3# signalHandler(int, siginfo*, void*) in /mnt/disk1/tengjianping/local/jdk1.8.0_131/jre/lib/amd64/server/libjvm.so
    4# 0x00007F4EB6F8CC20 in /lib64/libpthread.so.0
    5# __GI__IO_fwrite in /lib64/libc.so.6
    6# doris::LocalFileWriter::write(unsigned char const*, unsigned long, unsigned long*) at /mnt/disk1/tengjianping/doris-test/be/src/io/local_file_writer.cpp:56
    7# doris::vectorized::BlockSpillWriter::close() at /mnt/disk1/tengjianping/doris-test/be/src/vec/core/block_spill_writer.cpp:56
    8# std::unique_ptr<doris::vectorized::BlockSpillWriter, std::default_delete<doris::vectorized::BlockSpillWriter> >::~unique_ptr() at /mnt/disk1/tengjianping/local/ldb_toolchain_clang13/include/c++/11/bits/unique_ptr.h:361
    9# doris::vectorized::MergeSorterState::add_sorted_block(doris::vectorized::Block&) at /mnt/disk1/tengjianping/doris-test/be/src/vec/common/sort/sorter.cpp:70
   10# doris::vectorized::FullSorter::_do_sort() at /mnt/disk1/tengjianping/doris-test/be/src/vec/common/sort/sorter.cpp:351
   11# doris::vectorized::FullSorter::append_block(doris::vectorized::Block*) at /mnt/disk1/tengjianping/doris-test/be/src/vec/common/sort/sorter.cpp:310
   12# doris::vectorized::VSortNode::sink(doris::RuntimeState*, doris::vectorized::Block*, bool) at /mnt/disk1/tengjianping/doris-test/be/src/vec/exec/vsort_node.cpp:116
   13# doris::vectorized::VSortNode::open(doris::RuntimeState*) at /mnt/disk1/tengjianping/doris-test/be/src/vec/exec/vsort_node.cpp:166
   14# doris::PlanFragmentExecutor::open_vectorized_internal() at /mnt/disk1/tengjianping/doris-test/be/src/runtime/plan_fragment_executor.cpp:266
   15# doris::PlanFragmentExecutor::open() at /mnt/disk1/tengjianping/doris-test/be/src/runtime/plan_fragment_executor.cpp:241
   16# doris::FragmentExecState::execute() at /mnt/disk1/tengjianping/doris-test/be/src/runtime/fragment_mgr.cpp:250
   17# doris::FragmentMgr::_exec_actual(std::shared_ptr<doris::FragmentExecState>, std::function<void (doris::RuntimeState*, doris::Status*)>) at /mnt/disk1/tengjianping/doris-test/be/src/runtime/fragment_mgr.cpp:490
   18# std::_Function_handler<void (), doris::FragmentMgr::exec_plan_fragment(doris::TExecPlanFragmentParams const&, std::function<void (doris::RuntimeState*, doris::Status*)>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /mnt/disk1/tengjianping/local/ldb_toolchain_clang13/include/c++/11/bits/std_function.h:291
   19# doris::ThreadPool::dispatch_thread() at /mnt/disk1/tengjianping/doris-test/be/src/util/threadpool.cpp:543
   20# doris::Thread::supervise_thread(void*) at /mnt/disk1/tengjianping/doris-test/be/src/util/thread.cpp:454
   21# start_thread in /lib64/libpthread.so.0
   22# __GI___clone in /lib64/libc.so.6
   ```
   
   ### What You Expected?
   
   sql runs OK.
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] yiguolei closed issue #15863: [Bug] spill sort coredump

Posted by GitBox <gi...@apache.org>.
yiguolei closed issue #15863: [Bug] spill sort coredump
URL: https://github.com/apache/doris/issues/15863


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org