You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/04/02 13:57:39 UTC

[GitHub] [incubator-doris] zenoyang opened a new issue #8835: [Bug] dict col convert to predicate column cause be core dump

zenoyang opened a new issue #8835:
URL: https://github.com/apache/incubator-doris/issues/8835


   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   master lastest
   
   ### What's Wrong?
   
   When `enable_low_cardinality_optimize = true`, and trigger the execution of `ColumnDictionary::convert_to_predicate_column_if_dictionary`, BE will Core
   
   stack:
   ```c++
   Thread 65 (crashed)
    0  palo_be!tcmalloc::CentralFreeList::FetchFromOneSpans(int, void**, void**) [central_freelist.cc : 299 + 0x0]
    1  palo_be!tcmalloc::CentralFreeList::RemoveRange(void**, void**, int) [central_freelist.cc : 262 + 0x8]
    2  palo_be!tcmalloc::ThreadCache::FetchFromCentralCache(unsigned int, int, void* (*)(unsigned long)) [thread_cache.cc : 125 + 0x5]
    3  palo_be!tcmalloc::allocate_full_malloc_oom(unsigned long) [thread_cache.h : 380 + 0xb]
    4  palo_be!bshuf_untrans_bit_elem_AVX_avx2 + 0x26
    5  palo_be!bshuf_decompress_lz4_block_avx2 + 0xc4
    6  palo_be!bshuf_blocked_wrap_fun_avx2 + 0x8f
    7  palo_be!doris::segment_v2::BitShufflePageDecoder<(doris::FieldType)5>::init() [bitshuffle_page.h : 389 + 0x5]
    8  palo_be!doris::segment_v2::BinaryDictPageDecoder::init() [binary_dict_page.cpp : 221 + 0x5]
    9  palo_be!doris::segment_v2::FileColumnIterator::_read_data_page(doris::segment_v2::OrdinalPageIndexIterator const&) [parsed_page.h : 57 + 0x10]
   10  palo_be!doris::segment_v2::FileColumnIterator::seek_to_ordinal(unsigned long) [column_reader.cpp : 480 + 0xe]
   11  palo_be!doris::segment_v2::SegmentIterator::_seek_columns(std::vector<unsigned int, std::allocator<unsigned int> > const&, unsigned int) [segment_iterator.cpp : 467 + 0x16]
   12  palo_be!doris::segment_v2::SegmentIterator::_read_columns_by_index(unsigned int, unsigned int&, bool) [segment_iterator.cpp : 779 + 0x19]
   13  palo_be!doris::segment_v2::SegmentIterator::next_batch(doris::vectorized::Block*) [segment_iterator.cpp : 903 + 0xc]
   14  palo_be!doris::BetaRowsetReader::next_block(doris::vectorized::Block*) [beta_rowset_reader.cpp : 186 + 0xc]
   15  palo_be!doris::vectorized::VCollectIterator::Level1Iterator::next(doris::vectorized::Block*) [vcollect_iterator.cpp : 366 + 0x9]
   16  palo_be!doris::vectorized::BlockReader::_direct_next_block(doris::vectorized::Block*, doris::MemPool*, doris::ObjectPool*, bool*) [block_reader.cpp : 175 + 0x5]
   17  palo_be!doris::vectorized::VOlapScanner::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) [volap_scanner.cpp : 56 + 0x10]
   18  palo_be!doris::vectorized::VOlapScanNode::scanner_thread(doris::vectorized::VOlapScanner*) [volap_scan_node.cpp : 219 + 0x5]
   19  libpthread.so.0 + 0xc7d0
   ```
   
   
   ### What You Expected?
   
   Avoid core, return correct result.
   
   ### How to Reproduce?
   
   When `enable_low_cardinality_optimize = true`, for the TPCH dataset, using the following SQL query will Core.
   ```sql
   select count(*) from lineitem where l_comment = 'ously even exc';
   ```
   
   ### Anything Else?
   
   no
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org