You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Neha Narkhede (JIRA)" <ji...@apache.org> on 2013/09/13 19:00:54 UTC

[jira] [Commented] (KAFKA-972) MetadataRequest returns stale list of brokers

    [ https://issues.apache.org/jira/browse/KAFKA-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13766639#comment-13766639 ] 

Neha Narkhede commented on KAFKA-972:
-------------------------------------

Is this repetitive or the metadata starts returning consistent data after some time ? Since the metadata is communicated to the brokers by the controller, it is possible that there is a time window after an event has happened and before all the brokers have learned of the event.
                
> MetadataRequest returns stale list of brokers
> ---------------------------------------------
>
>                 Key: KAFKA-972
>                 URL: https://issues.apache.org/jira/browse/KAFKA-972
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.8
>            Reporter: Vinicius Carvalho
>
> When we issue an metadatarequest towards the cluster, the list of brokers is stale. I mean, even when a broker is down, it's returned back to the client. The following are examples of two invocations one with both brokers online and the second with a broker down:
> {
>     "brokers": [
>         {
>             "nodeId": 0,
>             "host": "10.139.245.106",
>             "port": 9092,
>             "byteLength": 24
>         },
>         {
>             "nodeId": 1,
>             "host": "localhost",
>             "port": 9093,
>             "byteLength": 19
>         }
>     ],
>     "topicMetadata": [
>         {
>             "topicErrorCode": 0,
>             "topicName": "foozbar",
>             "partitions": [
>                 {
>                     "replicas": [
>                         0
>                     ],
>                     "isr": [
>                         0
>                     ],
>                     "partitionErrorCode": 0,
>                     "partitionId": 0,
>                     "leader": 0,
>                     "byteLength": 26
>                 },
>                 {
>                     "replicas": [
>                         1
>                     ],
>                     "isr": [
>                         1
>                     ],
>                     "partitionErrorCode": 0,
>                     "partitionId": 1,
>                     "leader": 1,
>                     "byteLength": 26
>                 },
>                 {
>                     "replicas": [
>                         0
>                     ],
>                     "isr": [
>                         0
>                     ],
>                     "partitionErrorCode": 0,
>                     "partitionId": 2,
>                     "leader": 0,
>                     "byteLength": 26
>                 },
>                 {
>                     "replicas": [
>                         1
>                     ],
>                     "isr": [
>                         1
>                     ],
>                     "partitionErrorCode": 0,
>                     "partitionId": 3,
>                     "leader": 1,
>                     "byteLength": 26
>                 },
>                 {
>                     "replicas": [
>                         0
>                     ],
>                     "isr": [
>                         0
>                     ],
>                     "partitionErrorCode": 0,
>                     "partitionId": 4,
>                     "leader": 0,
>                     "byteLength": 26
>                 }
>             ],
>             "byteLength": 145
>         }
>     ],
>     "responseSize": 200,
>     "correlationId": -1000
> }
> {
>     "brokers": [
>         {
>             "nodeId": 0,
>             "host": "10.139.245.106",
>             "port": 9092,
>             "byteLength": 24
>         },
>         {
>             "nodeId": 1,
>             "host": "localhost",
>             "port": 9093,
>             "byteLength": 19
>         }
>     ],
>     "topicMetadata": [
>         {
>             "topicErrorCode": 0,
>             "topicName": "foozbar",
>             "partitions": [
>                 {
>                     "replicas": [
>                         0
>                     ],
>                     "isr": [],
>                     "partitionErrorCode": 5,
>                     "partitionId": 0,
>                     "leader": -1,
>                     "byteLength": 22
>                 },
>                 {
>                     "replicas": [
>                         1
>                     ],
>                     "isr": [
>                         1
>                     ],
>                     "partitionErrorCode": 0,
>                     "partitionId": 1,
>                     "leader": 1,
>                     "byteLength": 26
>                 },
>                 {
>                     "replicas": [
>                         0
>                     ],
>                     "isr": [],
>                     "partitionErrorCode": 5,
>                     "partitionId": 2,
>                     "leader": -1,
>                     "byteLength": 22
>                 },
>                 {
>                     "replicas": [
>                         1
>                     ],
>                     "isr": [
>                         1
>                     ],
>                     "partitionErrorCode": 0,
>                     "partitionId": 3,
>                     "leader": 1,
>                     "byteLength": 26
>                 },
>                 {
>                     "replicas": [
>                         0
>                     ],
>                     "isr": [],
>                     "partitionErrorCode": 5,
>                     "partitionId": 4,
>                     "leader": -1,
>                     "byteLength": 22
>                 }
>             ],
>             "byteLength": 133
>         }
>     ],
>     "responseSize": 188,
>     "correlationId": -1000
> }

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira