[GitHub] [incubator-doris] caiconghui edited a comment on pull request #6397: [Optimize] Support send batch parallelism for olap table sink

[GitBox <gi...@apache.org>]

caiconghui edited a comment on pull request #6397:
URL: https://github.com/apache/incubator-doris/pull/6397#issuecomment-903682565


   > How much is this performance improvement?
   
   This is the first step to speed up olap table sink. and the bottleneck for olaptable sink is still need to be deep solved.
   I make a test in my environment with 5 node in cluster
   
   MySQL [test]> insert into info_p1 select * from info_p1;
   ERROR 5024 (HY000): errCode = 2, detailMessage = Execute timeout
   MySQL [test]> set send_batch_parallelism=1;
   Query OK, 0 rows affected (0.00 sec)
   
   MySQL [test]> set send_batch_parallelism=5;
   Query OK, 0 rows affected (0.00 sec)
   
   MySQL [test]> insert into info_p1 select * from info_p1;
   Query OK, 84272656 rows affected (3 min 24.68 sec)
   {'label':'insert_a88e439072c74d4b-927690bb54979af0', 'status':'VISIBLE', 'txnId':'76736'}


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org