[GitHub] [incubator-doris] morningman opened a new issue #2383: Lots of COMMITTED transactions of routine load tasks

[GitBox <gi...@apache.org>]

morningman opened a new issue #2383: Lots of COMMITTED transactions of routine load tasks
URL: https://github.com/apache/incubator-doris/issues/2383
 
 
   **Bug describe**
   In some cases, you will find a large number of transactions in the COMMITTED state 
   shown in `show proc "/ transactions"`. The number of these transactions is much 
   larger than config `max_running_txn_num_per_db`.
   
   These transactions are load transactions related to the routine load task. 
   There are two reasons:
   1. We do not limit the total number of routine load tasks, which causes new tasks 
   to be executed continuously.
   2. A new task will be generated and executed after the previous task is in the COMMITTED 
   state. And if there is a problem in the publish process, it will accumulate a large number of 
   transactions in the COMMITTED state.
   
   **How to fix**
   
   1. Limit the total number of routine load task transactions in progress.
   2. After the transaction is visible, generate a new task.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org