You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "lhjw9810 (via GitHub)" <gi...@apache.org> on 2024/02/19 06:57:56 UTC

[I] [Bug] BE crash when enable auto_compaction [doris]

lhjw9810 opened a new issue, #31098:
URL: https://github.com/apache/doris/issues/31098

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   2.0.4
   
   ### What's Wrong?
   
   auto_compact is enabled and the BE crashes When the BE starting
   
   ### What You Expected?
   
   normal start
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   `start time: Mon Feb 19 11:38:18 CST 2024
   INFO: java_cmd /usr/lib/jvm/java-1.8.0/bin/java
   INFO: jdk_version 8
   SLF4J: Class path contains multiple SLF4J bindings.
   SLF4J: Found binding in [jar:file:/home/be/data5/doris/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: Found binding in [jar:file:/home/be/data5/doris/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: Found binding in [jar:file:/home/be/data5/doris/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
   SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
   terminate called after throwing an instance of 'std::bad_alloc'
     what():  std::bad_alloc
   *** Query id: 0-0 ***
   *** tablet id: 84551 ***
   *** Aborted at 1708313901 (unix time) try "date -d @1708313901" if you are using GNU date ***
   *** Current BE git commitID: 003a815b63 ***
   *** SIGABRT unknown detail explain (@0xf40a) received by PID 62474 (TID 64084 OR 0x7fe3c6df8700) from PID 62474; stack trace: ***
    0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_release/doris/be/src/common/signal_handler.h:417
    1# 0x00007FE6DED12270 in /lib64/libc.so.6
    2# raise in /lib64/libc.so.6
    3# abort in /lib64/libc.so.6
    4# __gnu_cxx::__verbose_terminate_handler() [clone .cold] at ../../../../libstdc++-v3/libsupc++/vterminate.cc:75
    5# __cxxabiv1::__terminate(void (*)()) at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:48
    6# 0x000055B7B9725AD1 in /home/be/data5/doris/be/lib/doris_be
    7# 0x000055B7B9725C24 in /home/be/data5/doris/be/lib/doris_be
    8# 0x000055B7B9726016 in /home/be/data5/doris/be/lib/doris_be
    9# doris::segment_v2::InvertedIndexColumnWriterImpl<(doris::FieldType)26>::add_array_values(unsigned long, void const*, unsigned char const*, unsigned char const*, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/inverted_index_writer.cpp:367
   10# doris::segment_v2::ArrayColumnWriter::append_data(unsigned char const**, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/column_writer.cpp:965
   11# doris::segment_v2::ArrayColumnWriter::append_nullable(unsigned char const*, unsigned char const**, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/column_writer.cpp:983
   12# doris::segment_v2::ColumnWriter::append(unsigned char const*, void const*, unsigned long) in /home/be/data5/doris/be/lib/doris_be
   13# doris::segment_v2::SegmentWriter::append_block(doris::vectorized::Block const*, unsigned long, unsigned long) in /home/be/data5/doris/be/lib/doris_be
   14# doris::VerticalBetaRowsetWriter::add_columns(doris::vectorized::Block const*, std::vector<unsigned int, std::allocator<unsigned int> > const&, bool, unsigned int) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/vertical_beta_rowset_writer.cpp:123
   15# doris::Merger::vertical_compact_one_group(std::shared_ptr<doris::Tablet>, doris::ReaderType, std::shared_ptr<doris::TabletSchema>, bool, std::vector<unsigned int, std::allocator<unsigned int> > const&, doris::vectorized::RowSourcesBuffer*, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > > const&, doris::RowsetWriter*, long, doris::Merger::Statistics*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/merger.cpp:245
   16# doris::Merger::vertical_merge_rowsets(std::shared_ptr<doris::Tablet>, doris::ReaderType, std::shared_ptr<doris::TabletSchema>, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > > const&, doris::RowsetWriter*, long, doris::Merger::Statistics*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/merger.cpp:349
   17# doris::Compaction::do_compaction_impl(long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/compaction.cpp:354
   18# doris::Compaction::do_compaction(long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/compaction.cpp:125
   19# doris::CumulativeCompaction::execute_compact_impl() at /home/zcp/repo_center/doris_release/doris/be/src/olap/cumulative_compaction.cpp:79
   20# doris::Compaction::execute_compact() at /home/zcp/repo_center/doris_release/doris/be/src/olap/compaction.cpp:107
   21# doris::Tablet::execute_compaction(doris::Compaction&) at /home/zcp/repo_center/doris_release/doris/be/src/olap/tablet.cpp:1910
   22# std::_Function_handler<void (), doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType, bool)::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291
   23# doris::ThreadPool::dispatch_thread() in /home/be/data5/doris/be/lib/doris_be
   24# doris::Thread::supervise_thread(void*) at /home/zcp/repo_center/doris_release/doris/be/src/util/thread.cpp:499
   25# start_thread in /lib64/libpthread.so.0
   26# __clone in /lib64/libc.so.6`
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [I] [Bug] BE crash when enable auto_compaction [doris]

Posted by "lhjw9810 (via GitHub)" <gi...@apache.org>.
lhjw9810 closed issue #31098: [Bug] BE crash when enable auto_compaction
URL: https://github.com/apache/doris/issues/31098


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [I] [Bug] BE crash when enable auto_compaction [doris]

Posted by "zhbdesign (via GitHub)" <gi...@apache.org>.
zhbdesign commented on issue #31098:
URL: https://github.com/apache/doris/issues/31098#issuecomment-1953324946

   这个是怎么解决的


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org