You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by GitBox <gi...@apache.org> on 2020/11/03 17:36:58 UTC

[GitHub] [kafka] seankumar-tl commented on pull request #9319: KAFKA-10413 Allow even distribution of lost/new tasks when more than one worker j…

seankumar-tl commented on pull request #9319:
URL: https://github.com/apache/kafka/pull/9319#issuecomment-721276005


   I can confirm seeing the behavior that @kkonstantine has reported. This is with Spot instances and running multiple connectors for topics with a large number of partitions. Task distribution does not take into consideration new workers that have joined and continues to result in an uneven distribution of tasks. 
   
   <img width="934" alt="Screen Shot 2020-11-03 at 12 35 59 PM" src="https://user-images.githubusercontent.com/65565095/98020615-3b962c80-1dd1-11eb-8160-db691849adf7.png">
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org