You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Chinmay Soman <ch...@gmail.com> on 2015/08/05 21:12:15 UTC
Question regarding Kafka EventThread
Hey guys,
We're using Kafka version 0.8.2.0 and using the Java producer
(KafkaProducer) to write to a single Kafka broker with acks=1. There's a
callback defined on every produce request which takes corrective action if
the write fails.
What we see is that, if the broker is down for an extended period of time,
any write to the producer gets stuck, with this message:
[2015-08-05 12:02:04,743] WARN Error in I/O with /........
(org.apache.kafka.common.network.Selector:276)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at org.apache.kafka.common.network.Selector.poll(Selector.java:238)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
at java.lang.Thread.run(Thread.java:745)
This goes on repeatedly and the callback is never invoked. Is there a way
to get the Kafka EventThread to give up after a while ?
--
Thanks and regards
Chinmay Soman
Re: Question regarding Kafka EventThread
Posted by Mayuresh Gharat <gh...@gmail.com>.
What do you mean by Broker is down? Has the process shutdown and exited or
is the broker not reachable?
Thanks,
Mayuresh
On Wed, Aug 5, 2015 at 12:12 PM, Chinmay Soman <ch...@gmail.com>
wrote:
> Hey guys,
>
> We're using Kafka version 0.8.2.0 and using the Java producer
> (KafkaProducer) to write to a single Kafka broker with acks=1. There's a
> callback defined on every produce request which takes corrective action if
> the write fails.
>
> What we see is that, if the broker is down for an extended period of time,
> any write to the producer gets stuck, with this message:
>
> [2015-08-05 12:02:04,743] WARN Error in I/O with /........
> (org.apache.kafka.common.network.Selector:276)
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:238)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> at java.lang.Thread.run(Thread.java:745)
>
> This goes on repeatedly and the callback is never invoked. Is there a way
> to get the Kafka EventThread to give up after a while ?
>
>
> --
> Thanks and regards
>
> Chinmay Soman
>
--
-Regards,
Mayuresh R. Gharat
(862) 250-7125
Re: Question regarding Kafka EventThread
Posted by Mayuresh Gharat <gh...@gmail.com>.
Your producer might get stuck if the kafka Broker becomes unreachable since
there is no socketTimeout on new producer. We are adding that in KAFKA-2120.
Thanks,
Mayuresh
On Wed, Aug 5, 2015 at 3:47 PM, Chinmay Soman <ch...@gmail.com>
wrote:
> After digging in the 0.8.2 code, it seems like the callback is not getting
> invoked since 'handleDisconnections' is not adding a disconnected
> ClientResponse to the list of responses. I do see a 'Node 0 disconnected'
> message. However, I don't see a 'Cancelled request due to node being
> disconnected' message.
>
> Is this expected ? Is any of this because I'm only using 1 Kafka broker
> node ? Will the producer get stuck if the Kafka cluster is not reachable
> for whatever reason ?
>
> On Wed, Aug 5, 2015 at 12:12 PM, Chinmay Soman <ch...@gmail.com>
> wrote:
>
> > Hey guys,
> >
> > We're using Kafka version 0.8.2.0 and using the Java producer
> > (KafkaProducer) to write to a single Kafka broker with acks=1. There's a
> > callback defined on every produce request which takes corrective action
> if
> > the write fails.
> >
> > What we see is that, if the broker is down for an extended period of
> time,
> > any write to the producer gets stuck, with this message:
> >
> > [2015-08-05 12:02:04,743] WARN Error in I/O with /........
> > (org.apache.kafka.common.network.Selector:276)
> > java.net.ConnectException: Connection refused
> > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> > at org.apache.kafka.common.network.Selector.poll(Selector.java:238)
> > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> > at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> > at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> > at java.lang.Thread.run(Thread.java:745)
> >
> > This goes on repeatedly and the callback is never invoked. Is there a way
> > to get the Kafka EventThread to give up after a while ?
> >
> >
> > --
> > Thanks and regards
> >
> > Chinmay Soman
> >
>
>
>
> --
> Thanks and regards
>
> Chinmay Soman
>
--
-Regards,
Mayuresh R. Gharat
(862) 250-7125
Re: Question regarding Kafka EventThread
Posted by Chinmay Soman <ch...@gmail.com>.
After digging in the 0.8.2 code, it seems like the callback is not getting
invoked since 'handleDisconnections' is not adding a disconnected
ClientResponse to the list of responses. I do see a 'Node 0 disconnected'
message. However, I don't see a 'Cancelled request due to node being
disconnected' message.
Is this expected ? Is any of this because I'm only using 1 Kafka broker
node ? Will the producer get stuck if the Kafka cluster is not reachable
for whatever reason ?
On Wed, Aug 5, 2015 at 12:12 PM, Chinmay Soman <ch...@gmail.com>
wrote:
> Hey guys,
>
> We're using Kafka version 0.8.2.0 and using the Java producer
> (KafkaProducer) to write to a single Kafka broker with acks=1. There's a
> callback defined on every produce request which takes corrective action if
> the write fails.
>
> What we see is that, if the broker is down for an extended period of time,
> any write to the producer gets stuck, with this message:
>
> [2015-08-05 12:02:04,743] WARN Error in I/O with /........
> (org.apache.kafka.common.network.Selector:276)
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:238)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> at java.lang.Thread.run(Thread.java:745)
>
> This goes on repeatedly and the callback is never invoked. Is there a way
> to get the Kafka EventThread to give up after a while ?
>
>
> --
> Thanks and regards
>
> Chinmay Soman
>
--
Thanks and regards
Chinmay Soman