You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/11/21 10:56:09 UTC
[GitHub] [doris] freemandealer opened a new issue, #14447: [Bug] ZoneMapIndexReader DCHECK(num_to_read == num_read) failed
freemandealer opened a new issue, #14447:
URL: https://github.com/apache/doris/issues/14447
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
Nov 15 master
### What's Wrong?
```
start time: Mon 14 Nov 2022 08:05:12 PM CST
F1115 00:08:50.003960 1323563 zone_map_index.cpp:156] Check failed: num_to_read == num_read
*** Check failure stack trace: ***
@ 0x560899fa83fd google::LogMessage::Fail()
@ 0x560899faa939 google::LogMessage::SendToLog()
@ 0x560899fa7f66 google::LogMessage::Flush()
@ 0x560899faafa9 google::LogMessageFatal::~LogMessageFatal()
@ 0x56088f305280 doris::segment_v2::ZoneMapIndexReader::load()
@ 0x56088ef12765 doris::segment_v2::ColumnReader::_load_zone_map_index()
@ 0x56088ef2f4ef _ZZN5doris10segment_v212ColumnReader20_ensure_index_loadedEvENKUlvE_clEv
@ 0x56088ef347b7 _ZZN5doris13DorisCallOnceINS_6StatusEE4callIZNS_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES1_T_ENKUlvE_clEv
@ 0x56088ef42908 _ZSt13__invoke_implIvZN5doris13DorisCallOnceINS0_6StatusEE4callIZNS0_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES2_T_EUlvE_JEES8_St14__invoke_otherOT0_DpOT1_
@ 0x56088ef409e6 _ZSt8__invokeIZN5doris13DorisCallOnceINS0_6StatusEE4callIZNS0_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES2_T_EUlvE_JEENSt15__invoke_resultIS8_JDpT0_EE4typeEOS8_DpOSB_
@ 0x56088ef3b460 _ZZSt9call_onceIZN5doris13DorisCallOnceINS0_6StatusEE4callIZNS0_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES2_T_EUlvE_JEEvRSt9once_flagOS8_DpOT0_ENKUlvE_clEv
@ 0x56088ef40a09 _ZZNSt9once_flag18_Prepare_executionC4IZSt9call_onceIZN5doris13DorisCallOnceINS3_6StatusEE4callIZNS3_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES5_T_EUlvE_JEEvRS_OSB_DpOT0_EUlvE_EERSB_ENKUlvE_clEv
@ 0x56088ef40a1a _ZZNSt9once_flag18_Prepare_executionC4IZSt9call_onceIZN5doris13DorisCallOnceINS3_6StatusEE4callIZNS3_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES5_T_EUlvE_JEEvRS_OSB_DpOT0_EUlvE_EERSB_ENUlvE_4_FUNEv
@ 0x7fbf8b3bd47f __pthread_once_slow
@ 0x56088ef04d18 __gthread_once()
@ 0x56088ef3b561 _ZSt9call_onceIZN5doris13DorisCallOnceINS0_6StatusEE4callIZNS0_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES2_T_EUlvE_JEEvRSt9once_flagOS8_DpOT0_
@ 0x56088ef349fd _ZN5doris13DorisCallOnceINS_6StatusEE4callIZNS_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES1_T_
@ 0x56088ef2fc57 doris::segment_v2::ColumnReader::_ensure_index_loaded()
@ 0x56088ef13573 doris::segment_v2::ColumnReader::seek_at_or_before()
@ 0x56088ef1aaa4 doris::segment_v2::FileColumnIterator::seek_to_ordinal()
@ 0x56088f1a4333 doris::segment_v2::SegmentIterator::_seek_columns()
@ 0x56088f1ab3a6 doris::segment_v2::SegmentIterator::_read_columns_by_index()
@ 0x56088f1ae474 doris::segment_v2::SegmentIterator::next_batch()
@ 0x5608992177e5 doris::vectorized::VMergeIteratorContext::_load_next_block()
@ 0x560899216971 doris::vectorized::VMergeIteratorContext::init()
@ 0x560899218346 doris::vectorized::VMergeIterator::init()
@ 0x56088fd52d1c doris::BetaRowsetReader::init()
@ 0x56089923514c doris::vectorized::BlockReader::_init_collect_iter()
@ 0x56089923724d doris::vectorized::BlockReader::init()
@ 0x56088e280679 doris::Merger::vmerge_rowsets()
@ 0x56088e249434 doris::Compaction::do_compaction_impl()
@ 0x56088e247e37 doris::Compaction::do_compaction()
*** Query id: 0-0 ***
*** Aborted at 1668442130 (unix time) try "date -d @1668442130" if you are using GNU date ***
*** Current BE git commitID: b0ff852d7 ***
*** SIGABRT unkown detail explain (@0x142e46) received by PID 1322566 (TID 0x7fbe03ede700) from PID 1322566; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_master/be/src/common/signal_handler.h:420
1# 0x00007FBF8B4120C0 in /lib/x86_64-linux-gnu/libc.so.6
2# raise in /lib/x86_64-linux-gnu/libc.so.6
3# abort in /lib/x86_64-linux-gnu/libc.so.6
4# 0x0000560899FB2DE9 in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be
5# 0x0000560899FA83FD in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be
6# google::LogMessage::SendToLog() in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be
7# google::LogMessage::Flush() in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be
8# google::LogMessageFatal::~LogMessageFatal() in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be
9# doris::segment_v2::ZoneMapIndexReader::load(bool, bool) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/zone_map_index.cpp:156
10# doris::segment_v2::ColumnReader::_load_zone_map_index(bool, bool) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.cpp:351
11# doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}::operator()() const at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.h:167
12# doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}::operator()() const at /home/zcp/repo_center/doris_master/be/src/util/once.h:57 13# void std::__invoke_impl<void, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::__invoke_other, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:61
14# std::__invoke_result<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>::type std::__invoke<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:97
15# std::call_once<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::once_flag&, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&)::{lambda()#1}::operator()() const at /var/local/ldb_toolchain/include/c++/11/mutex:775
16# std::once_flag::_Prepare_execution::_Prepare_execution<std::call_once<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::once_flag&, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&)::{lambda()#1}>(doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&)::{lambda()#1}::operator()() const at /var/local/ldb_toolchain/include/c++/11/mutex:712
17# std::once_flag::_Prepare_execution::_Prepare_execution<std::call_once<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::once_flag&, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&)::{lambda()#1}>(doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&)::{lambda()#1}::_FUN() at /var/local/ldb_toolchain/include/c++/11/mutex:712
18# __pthread_once_slow at /build/glibc-sMfBJT/glibc-2.31/nptl/pthread_once.c:118
19# __gthread_once(int*, void (*)()) at /var/local/ldb_toolchain/include/x86_64-linux-gnu/c++/11/bits/gthr-default.h:700
20# void std::call_once<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::once_flag&, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&) at /var/local/ldb_toolchain/include/c++/11/mutex:783
21# doris::Status doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}) at /home/zcp/repo_center/doris_master/be/src/util/once.h:57
22# doris::segment_v2::ColumnReader::_ensure_index_loaded() at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.h:173
23# doris::segment_v2::ColumnReader::seek_at_or_before(unsigned long, doris::segment_v2::OrdinalPageIndexIterator*) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.cpp:382
24# doris::segment_v2::FileColumnIterator::seek_to_ordinal(unsigned long) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.cpp:650
25# doris::segment_v2::SegmentIterator::_seek_columns(std::vector<unsigned int, std::allocator<unsigned int> > const&, unsigned int) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/segment_iterator.cpp:582
26# doris::segment_v2::SegmentIterator::_read_columns_by_index(unsigned int, unsigned int&, bool) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/segment_iterator.cpp:954
27# doris::segment_v2::SegmentIterator::next_batch(doris::vectorized::Block*) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/segment_iterator.cpp:1112
28# doris::vectorized::VMergeIteratorContext::_load_next_block() at /home/zcp/repo_center/doris_master/be/src/vec/olap/vgeneric_iterators.cpp:294
29# doris::vectorized::VMergeIteratorContext::init(doris::StorageReadOptions const&) at /home/zcp/repo_center/doris_master/be/src/vec/olap/vgeneric_iterators.cpp:254
30# doris::vectorized::VMergeIterator::init(doris::StorageReadOptions const&) at /home/zcp/repo_center/doris_master/be/src/vec/olap/vgeneric_iterators.cpp:321
31# doris::BetaRowsetReader::init(doris::RowsetReaderContext*) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/beta_rowset_reader.cpp:203
32# doris::vectorized::BlockReader::_init_collect_iter(doris::TabletReader::ReaderParams const&, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > >*) at /home/zcp/repo_center/doris_master/be/src/vec/olap/block_reader.cpp:54
33# doris::vectorized::BlockReader::init(doris::TabletReader::ReaderParams const&) at /home/zcp/repo_center/doris_master/be/src/vec/olap/block_reader.cpp:130
34# doris::Merger::vmerge_rowsets(std::shared_ptr<doris::Tablet>, doris::ReaderType, std::shared_ptr<doris::TabletSchema>, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > > const&, doris::RowsetWriter*, doris::Merger::Statistics*) at /home/zcp/repo_center/doris_master/be/src/olap/merger.cpp:142
35# doris::Compaction::do_compaction_impl(long) at /home/zcp/repo_center/doris_master/be/src/olap/compaction.cpp:163
36# doris::Compaction::do_compaction(long) at /home/zcp/repo_center/doris_master/be/src/olap/compaction.cpp:112
37# doris::CumulativeCompaction::execute_compact_impl() at /home/zcp/repo_center/doris_master/be/src/olap/cumulative_compaction.cpp:77
38# doris::Compaction::execute_compact() at /home/zcp/repo_center/doris_master/be/src/olap/compaction.cpp:50
39# doris::Tablet::execute_compaction(doris::CompactionType) at /home/zcp/repo_center/doris_master/be/src/olap/tablet.cpp:1580
40# doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}::operator()() const at /home/zcp/repo_center/doris_master/be/src/olap/olap_server.cpp:636
41# void std::__invoke_impl<void, doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&>(std::__invoke_other, doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:61
42# std::enable_if<is_invocable_r_v<void, doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&>, void>::type std::__invoke_r<void, doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&>(doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:117
43# std::_Function_handler<void (), doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:292
44# std::function<void ()>::operator()() const at /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:560
45# doris::FunctionRunnable::run() at /home/zcp/repo_center/doris_master/be/src/util/threadpool.cpp:45
46# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_master/be/src/util/threadpool.cpp:542
47# void std::__invoke_impl<void, void (doris::ThreadPool::*&)(), doris::ThreadPool*&>(std::__invoke_memfun_deref, void (doris::ThreadPool::*&)(), doris::ThreadPool*&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:74
48# std::__invoke_result<void (doris::ThreadPool::*&)(), doris::ThreadPool*&>::type std::__invoke<void (doris::ThreadPool::*&)(), doris::ThreadPool*&>(void (doris::ThreadPool::*&)(), doris::ThreadPool*&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:97
49# void std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>::__call<void, , 0ul>(std::tuple<>&&, std::_Index_tuple<0ul>) at /var/local/ldb_toolchain/include/c++/11/functional:422
50# void std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>::operator()<, void>() at /var/local/ldb_toolchain/include/c++/11/functional:505
51# void std::__invoke_impl<void, std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&>(std::__invoke_other, std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:61
52# std::enable_if<is_invocable_r_v<void, std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&>, void>::type std::__invoke_r<void, std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&>(std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:117
53# std::_Function_handler<void (), std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()> >::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:292
54# std::function<void ()>::operator()() const at /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:560
55# doris::Thread::supervise_thread(void*) at /home/zcp/repo_center/doris_master/be/src/util/thread.cpp:455
```
### What You Expected?
check success
### How to Reproduce?
haven't reproduce yet.
maybe enable_segcompaction
### Anything Else?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] ZoneMapIndexReader DCHECK(num_to_read == num_read) failed [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman closed issue #14447: [Bug] ZoneMapIndexReader DCHECK(num_to_read == num_read) failed
URL: https://github.com/apache/doris/issues/14447
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org