[GitHub] [druid] pjain1 commented on pull request #10524: Dynamic auto scale Kafka-Stream ingest tasks

[GitBox <gi...@apache.org>]

pjain1 commented on pull request #10524:
URL: https://github.com/apache/druid/pull/10524#issuecomment-787795538


   @zhangyue19921010 I was wondering if you have thought of the case when the desired task count becomes more than the number of topic partitions. In that case the number of actual tasks will remain equal to the number of topic partitions and will not grow beyond that. In case the overall lag is still higher than threshold increasing the desired task count will not help and I think as per the logic every time dynamic allocate task notice is run it will increase the desired task count by scaleOutStep. Do you see this as a problem ?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org