You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Joel Koshy (JIRA)" <ji...@apache.org> on 2013/04/30 19:14:17 UTC

[jira] [Commented] (KAFKA-890) The list of brokers for fetching metadata should be shuffled

    [ https://issues.apache.org/jira/browse/KAFKA-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13645736#comment-13645736 ] 

Joel Koshy commented on KAFKA-890:
----------------------------------

+1

It is worth noting that this is useful even in the presence of a VIP since the consumers don't currently use a VIP to to look up metadata.
                
> The list of brokers for fetching metadata should be shuffled 
> -------------------------------------------------------------
>
>                 Key: KAFKA-890
>                 URL: https://issues.apache.org/jira/browse/KAFKA-890
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.8
>            Reporter: Neha Narkhede
>            Assignee: Neha Narkhede
>            Priority: Blocker
>              Labels: kafka-0.8, p1
>         Attachments: kafka-890.patch
>
>
> The list of brokers in the metadata request is never shuffled. Which means that if some clients are not using a VIP for metadata requests, the first broker ends up servicing most metadata requests, leaving imbalanced load on the brokers. This issue is even more pronounced when there are several thousand clients talking to a cluster each using a broker list to fetch metadata.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira