[jira] [Commented] (KAFKA-4610) getting error:Batch containing 3 record(s) expired due to timeout while requesting metadata from brokers for test2R2P2-1

["Ewen Cheslack-Postava (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814103#comment-15814103 ] 

Ewen Cheslack-Postava commented on KAFKA-4610:
----------------------------------------------

Are any of your messages making it to Kafka correctly? The error means that the app is trying to get basic metadata about the cluster for so long that it eventually gives up on sending the data. Given that it repeats, this suggests something is wrong with your broker list or the network between your client and your broker.

If you're seeing it with all the provided clients, it probably means your brokers aren't listening on the interfaces you expect or your brokers are not routable from your client machine. Can you ping the brokers? Can you open a telnet session from the machine you are running the client on to the broker IP+port? If not, you may need to adjust the listeners and advertised.listeners settings to ensure the broker listens on the right interface and other nodes are using the correct address to reach it.

> getting error:Batch containing 3 record(s) expired due to timeout while requesting metadata from brokers for test2R2P2-1
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-4610
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4610
>             Project: Kafka
>          Issue Type: Bug
>         Environment: Dev
>            Reporter: sandeep kumar singh
>
> i a getting below error when running producer client, which take messages from an input file kafka_message.log. this log file is pilled with 100000 records per second of each message of length 4096
> error - 
> [2017-01-09 14:45:24,813] ERROR Error when sending message to topic test2R2P2 with key: null, value: 4096 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s) expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2 with key: null, value: 4096 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s) expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2 with key: null, value: 4096 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s) expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2 with key: null, value: 4096 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s) expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2 with key: null, value: 4096 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s) expired due to timeout while requesting metadata from brokers for test2R2P2-0
> command i run :
> $ bin/kafka-console-producer.sh --broker-list x.x.x.x:xxxx,x.x.x.x:xxxx --batch-size 1000 --message-send-max-retries 10 --request-required-acks 1 --topic test2R2P2 <~/kafka_message.log
> there are 2 brokers running and the topic has partitions = 2 and replication factor 2. 
> Could you please help me understand what does that error means?
> also i see message loss when i manually restart one of the broker and while kafak-producer-perf-test command is running? is this a expected behavior?
> thanks
> Sandeep



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)