[GitHub] [incubator-doris] gaodayue opened a new issue #3828: BE cores when insert null into bitmap column

[GitBox <gi...@apache.org>]

gaodayue opened a new issue #3828:
URL: https://github.com/apache/incubator-doris/issues/3828


   **Describe the bug**
   BE cores when doing compaction with the following stacktrace.
   ```
   *** SIGSEGV (@0x0) received by PID 112258 (TID 0x7f8dce949700) from PID 0; stack trace: ***
       @     0x7f8e2b94f5f0 (unknown)
       @           0xe8a591 doris::AggregateFuncTraits<>::init()
       @           0xe77dc0 doris::Reader::_agg_key_next_row()
       @           0xe64f4d doris::Merger::merge_rowsets()
       @           0xe59b1d doris::Compaction::do_compaction_impl()
       @           0xe5bc9d doris::Compaction::do_compaction()
       @           0xe533c4 doris::BaseCompaction::compact()
       @           0xde096c doris::StorageEngine::_perform_base_compaction()
       @           0xdd1f8b doris::StorageEngine::_base_compaction_thread_callback()
       @          0x256ce3f execute_native_thread_routine
       @     0x7f8e2b947e65 start_thread
       @     0x7f8e2ad4c88d __clone
   ```
   
   **To Reproduce**
   ```
   create table t1 (
   id int,
   user_id bitmap bitmap_union
   )
   aggregate key(`id`) distributed by hash(`id`) buckets 1
   properties("replication_num"="1");
   
   insert into t1 (id, user_id) values (1, to_bitmap(null));
   insert into t1 (id, user_id) values (2, to_bitmap(null));
   insert into t1 (id, user_id) values (3, to_bitmap(''));
   ```
   
   The above `to_bitmap` expressions will insert null into bitmap column, which is not allowed according to aggregate_func.h. However the insert statements run successfully and BE cores later during compaction.
   ```
   // when data load, after bitmap_init fucntion, bitmap_union column won't be null
   // so when init, update bitmap, the src is not null
   template <>
   struct AggregateFuncTraits<OLAP_FIELD_AGGREGATION_BITMAP_UNION, OLAP_FIELD_TYPE_OBJECT> {
       static void init(RowCursorCell* dst, const char* src, bool src_null, MemPool* mem_pool, ObjectPool* agg_pool) {
           DCHECK_EQ(src_null, false);
           dst->set_not_null();
   ```
   
   **Expected behavior**
   Row with null bitmap should be invalid and filtered.
   
   **Additional context**
   Version: 0.12


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org

[GitHub] [incubator-doris] gaodayue closed issue #3828: BE cores when insert null into bitmap column

[GitBox <gi...@apache.org>]

gaodayue closed issue #3828:
URL: https://github.com/apache/incubator-doris/issues/3828


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org