You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Arindam Paul <ap...@sapient.com> on 2013/10/22 13:58:09 UTC

Kafka 0.8.0-beta1 with Spark Streaming

Hi,

I have built Spark 0.8.0 with Kafka 0.8.0-beta1 and when I am running the producer code, I am getting the following error.
I have checked that I am using the latest property attributes in my code, like, metadata.broker.list (props.put("metadata.broker.list", brokers))
Please help me understand what's wrong here.

2013-10-22 09:59:14 INFO  ClientUtils$:67 - Fetching metadata from broker id:0,host:x.x.x.x,port:9092 with correlation id 0 for 1 topic(s) Set(topic-test)
2013-10-22 09:59:14 INFO  SyncProducer:67 - Connected to x.x.x.x:9092 for producing
2013-10-22 09:59:14 INFO  SyncProducer:67 - Disconnecting from x.x.x.x:9092
2013-10-22 10:00:18 ERROR SyncProducer:102 - Producer connection to x.x.x.x:9092 unsuccessful
java.net.ConnectException: Connection timed out
::::
2013-10-22 10:00:18 WARN  DefaultEventHandler:88 - Failed to send producer request with correlation id 4 to broker 1 with data for partitions [topic-test,0]
java.net.ConnectException: Connection timed out
        at sun.nio.ch.Net.connect0(Native Method)


Thanks.

Re: Kafka 0.8.0-beta1 with Spark Streaming

Posted by Neha Narkhede <ne...@gmail.com>.

Are you able to telnet from the producer machine to the broker?

Thanks,
Neha
On Oct 22, 2013 7:13 AM, "Arindam Paul" <ap...@sapient.com> wrote:

> Hi,
>
> I have built Spark 0.8.0 with Kafka 0.8.0-beta1 and when I am running the
> producer code, I am getting the following error.
> I have checked that I am using the latest property attributes in my code,
> like, metadata.broker.list (props.put("metadata.broker.list", brokers))
> Please help me understand what's wrong here.
>
> 2013-10-22 09:59:14 INFO  ClientUtils$:67 - Fetching metadata from broker
> id:0,host:x.x.x.x,port:9092 with correlation id 0 for 1 topic(s)
> Set(topic-test)
> 2013-10-22 09:59:14 INFO  SyncProducer:67 - Connected to x.x.x.x:9092 for
> producing
> 2013-10-22 09:59:14 INFO  SyncProducer:67 - Disconnecting from x.x.x.x:9092
> 2013-10-22 10:00:18 ERROR SyncProducer:102 - Producer connection to
> x.x.x.x:9092 unsuccessful
> java.net.ConnectException: Connection timed out
> ::::
> 2013-10-22 10:00:18 WARN  DefaultEventHandler:88 - Failed to send producer
> request with correlation id 4 to broker 1 with data for partitions
> [topic-test,0]
> java.net.ConnectException: Connection timed out
>         at sun.nio.ch.Net.connect0(Native Method)
>
>
> Thanks.
>