[GitHub] [incubator-doris] morningman edited a comment on issue #2065: Routine Load may takes too many FE memory

[GitBox <gi...@apache.org>]

morningman edited a comment on issue #2065: Routine Load may takes too many FE memory
URL: https://github.com/apache/incubator-doris/issues/2065#issuecomment-547371213
 
 
   Mainly fix the following issues:
   
   1. A null pointer exception is raised when a database or table is dropped. The expected behavior is that the routine load job is stopped.
   2. Memory leaks. Batch routine load task submissions are no longer performed, and modifications are submitted separately for each task.
   3. Unreasonable task timeout.
   
       Routine load tasks should not be queued in the BE thread pool for execution. The task sent to the BE should be executed immediately, otherwise the task in the FE will be timeout first. Eventually leads to constant timeout for all subsequent tasks.
   
   4. All routine load job should be scheduled once it being submitted. Not waiting the available BE slot. Otherwise, all later submitted jobs may not be scheduled forever.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org