You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "jacktengg (via GitHub)" <gi...@apache.org> on 2023/08/09 07:38:34 UTC

[GitHub] [doris] jacktengg opened a new issue, #22771: [Bug] [master] old planner, pipeline on, plan fragment 0 is not sent to BE

jacktengg opened a new issue, #22771:
URL: https://github.com/apache/doris/issues/22771

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   master-edd36fe86b
   
   ### What's Wrong?
   
   schema and test data:
   ```
   CREATE TABLE test_orthog_bitmap_intersect (
               tag int NOT NULL,
               hid int NOT NULL,
               id_bitmap bitmap BITMAP_UNION NULL
           ) ENGINE = OLAP AGGREGATE KEY(tag, hid)
           DISTRIBUTED BY HASH(hid) BUCKETS 1 properties("replication_num"="1");
   
   insert into test_orthog_bitmap_intersect
               select 0, 1, to_bitmap(1) as id_bitmap;
   
   set experimental_enable_nereids_planner=false; 
   set experimental_enable_pipeline_engine=true;
   set parallel_pipeline_task_num = 2;
   ```
   
   test sql:
   ```
   select count(distinct tag) as count1,
               orthogonal_bitmap_intersect_count(id_bitmap, tag, 0) as count2_bitmap from test_orthog_bitmap_intersect;
   ```
   
   explain plan:
   ```
   mysql [regression_test_query_p0_sql_functions_bitmap_functions]>explain select count(distinct tag) as count1,             orthogonal_bitmap_intersect_count(id_bitmap, tag, 0) as count2_bitmap from test_orthog_bitmap_intersect;
   +--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
   | Explain String                                                                                                                                                                                               |
   +--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
   | PLAN FRAGMENT 0                                                                                                                                                                                              |
   |   OUTPUT EXPRS:                                                                                                                                                                                              |
   |     <slot 8> count(<slot 2> `tag`)                                                                                                                                                                           |
   |     <slot 9> <slot 3> orthogonal_bitmap_intersect_count(`id_bitmap`, `tag`, 0)                                                                                                                               |
   |   PARTITION: UNPARTITIONED                                                                                                                                                                                   |
   |                                                                                                                                                                                                              |
   |   VRESULT SINK                                                                                                                                                                                               |
   |                                                                                                                                                                                                              |
   |   6:VAGGREGATE (merge finalize)                                                                                                                                                                              |
   |   |  output: count(<slot 6> count(<slot 2> `tag`)), orthogonal_bitmap_intersect_count(<slot 7> <slot 3> orthogonal_bitmap_intersect_count(`id_bitmap`, `tag`, 0))                                            |
   |   |  group by:                                                                                                                                                                                               |
   |   |  cardinality=-1                                                                                                                                                                                          |
   |   |                                                                                                                                                                                                          |
   |   5:VEXCHANGE                                                                                                                                                                                                |
   |      offset: 0                                                                                                                                                                                               |
   |                                                                                                                                                                                                              |
   | PLAN FRAGMENT 1                                                                                                                                                                                              |
   |                                                                                                                                                                                                              |
   |   PARTITION: HASH_PARTITIONED: <slot 2> `tag`                                                                                                                                                                |
   |                                                                                                                                                                                                              |
   |   STREAM DATA SINK                                                                                                                                                                                           |
   |     EXCHANGE ID: 05                                                                                                                                                                                          |
   |     UNPARTITIONED                                                                                                                                                                                            |
   |                                                                                                                                                                                                              |
   |   2:VAGGREGATE (update serialize)                                                                                                                                                                            |
   |   |  output: count(<slot 2> `tag`), orthogonal_bitmap_intersect_count(<slot 3> orthogonal_bitmap_intersect_count(`id_bitmap`, `tag`, 0))                                                                     |
   |   |  group by:                                                                                                                                                                                               |
   |   |  cardinality=1                                                                                                                                                                                           |
   |   |                                                                                                                                                                                                          |
   |   4:VAGGREGATE (merge serialize)                                                                                                                                                                             |
   |   |  output: orthogonal_bitmap_intersect_count(<slot 3> orthogonal_bitmap_intersect_count(`id_bitmap`, `tag`, 0))                                                                                            |
   |   |  group by: <slot 2> `tag`                                                                                                                                                                                |
   |   |  cardinality=-1                                                                                                                                                                                          |
   |   |                                                                                                                                                                                                          |
   |   3:VEXCHANGE                                                                                                                                                                                                |
   |      offset: 0                                                                                                                                                                                               |
   |                                                                                                                                                                                                              |
   | PLAN FRAGMENT 2                                                                                                                                                                                              |
   |                                                                                                                                                                                                              |
   |   PARTITION: HASH_PARTITIONED: `default_cluster:regression_test_query_p0_sql_functions_bitmap_functions`.`test_orthog_bitmap_intersect`.`hid`                                                                |
   |                                                                                                                                                                                                              |
   |   STREAM DATA SINK                                                                                                                                                                                           |
   |     EXCHANGE ID: 03                                                                                                                                                                                          |
   |     HASH_PARTITIONED: <slot 2> `tag`                                                                                                                                                                         |
   |                                                                                                                                                                                                              |
   |   1:VAGGREGATE (update serialize)                                                                                                                                                                            |
   |   |  STREAMING                                                                                                                                                                                               |
   |   |  output: orthogonal_bitmap_intersect_count(`id_bitmap`, `tag`, 0)                                                                                                                                        |
   |   |  group by: `tag`                                                                                                                                                                                         |
   |   |  cardinality=-1                                                                                                                                                                                          |
   |   |                                                                                                                                                                                                          |
   |   0:VOlapScanNode                                                                                                                                                                                            |
   |      TABLE: default_cluster:regression_test_query_p0_sql_functions_bitmap_functions.test_orthog_bitmap_intersect(test_orthog_bitmap_intersect), PREAGGREGATION: OFF. Reason: aggExpr has more than one child |
   |      partitions=1/1, tablets=1/1, tabletList=21511                                                                                                                                                           |
   |      cardinality=1, avgRowSize=2275.0, numNodes=1                                                                                                                                                            |
   |      pushAggOp=NONE                                                                                                                                                                                          |
   +--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
   56 rows in set (0.00 sec)
   ```
   
   Add log in BE, plan fragment 0 is not received:
   ```
   W0809 14:54:29.134781 2414287 pipeline_fragment_context.cpp:321] orthog bitmap exec plan:  id=2 type=AGGREGATION_NODE tuple_ids=[3, ]
    id=4 type=AGGREGATION_NODE tuple_ids=[1, ]
    id=3 type=EXCHANGE_NODE tuple_ids=[1, ]
   W0809 14:54:29.134863 2414279 pipeline_fragment_context.cpp:321] orthog bitmap exec plan:  id=2 type=AGGREGATION_NODE tuple_ids=[3, ]
    id=4 type=AGGREGATION_NODE tuple_ids=[1, ]
    id=3 type=EXCHANGE_NODE tuple_ids=[1, ]
   
   W0809 14:54:29.143564 2414287 pipeline_fragment_context.cpp:321] orthog bitmap exec plan:  id=1 type=AGGREGATION_NODE tuple_ids=[1, ]
    id=0 type=OLAP_SCAN_NODE tuple_ids=[0, ]
   W0809 14:54:29.143568 2414279 pipeline_fragment_context.cpp:321] orthog bitmap exec plan:  id=1 type=AGGREGATION_NODE tuple_ids=[1, ]
    id=0 type=OLAP_SCAN_NODE tuple_ids=[0, ]
   ```
   
   ### What You Expected?
   
   Receive full plan.
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [I] [Bug] [master] old planner, pipeline on, plan fragment 0 is not sent to BE [doris]

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman closed issue #22771: [Bug] [master] old planner, pipeline on, plan fragment 0 is not sent to BE
URL: https://github.com/apache/doris/issues/22771


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org