[GitHub] [druid] zhangyue19921010 commented on pull request #10524: Dynamic auto scale Kafka-Stream ingest tasks

[GitBox <gi...@apache.org>]

zhangyue19921010 commented on pull request #10524:
URL: https://github.com/apache/druid/pull/10524#issuecomment-759414528


   Hi @jihoonson @capistrant @himanshug @clintropolis. Sorry to bother you guys. Could you please take a look this PR at your convenience? I believe this PR is worthy to be reviewed because I have deployed this pr to our PRD Druid Cluster for running about half a year and everything works fine for now.
   
   Here is the monitor for taskCount metrics
   
   <img width="1406" alt="屏幕快照 2021-01-13 下午8 18 24" src="https://user-images.githubusercontent.com/69956021/104451475-8eb00b00-55dc-11eb-8620-5d7ba4221968.png">
   
   As you can see,  tasks number can be adjusted sensitively and automatically based on Kafka lag which can help improve data SLA and save resources.
   
   I really appreciate your help, and  look forward to your reply :)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org