You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Banerjee, Aparup" <ap...@paypal.com> on 2013/10/31 05:03:05 UTC
Connection reset by peer Error in Kafka server.log
Hi,
I keep getting this error in Kafka server.log. I don't see anything in my producer or consumer log. Any idea what can be going on here?
Aparup
2013-10-31 02:37:13,917] INFO Closing socket connection to /x.x.x.x. (kafka.network.Processor)
[2013-10-31 02:37:21,645] INFO Closing socket connection to /x.x.x.x. (kafka.network.Processor)
[2013-10-31 02:37:21,713] ERROR Closing socket for /x.x.x.x because of error (kafka.network.Processor)
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
at kafka.utils.Utils$.read(Utils.scala:394)
at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
at kafka.network.Processor.read(SocketServer.scala:339)
at kafka.network.Processor.run(SocketServer.scala:245)
at java.lang.Thread.run(Thread.java:744)
Re: Connection reset by peer Error in Kafka server.log
Posted by Neha Narkhede <ne...@gmail.com>.
Hmm, I would suspect GC to give a Connection timeout instead of Connection
reset, but I could be wrong.
On Thu, Oct 31, 2013 at 9:42 PM, Banerjee, Aparup <ap...@paypal.com>wrote:
> That was my initial hunch, but consumer logs are clean. Could it be some
> GC stuff on consumer?
>
> Thanks,
> Aparup
>
> > On Oct 31, 2013, at 9:36 PM, "Neha Narkhede" <ne...@gmail.com>
> wrote:
> >
> > Is the consumer being shutdown or interrupted? Do you see any relevant
> > errors in your consumer's logs?
> >
> > Thanks,
> > Neha
> >
> >
> > On Thu, Oct 31, 2013 at 9:31 PM, Banerjee, Aparup <apbanerjee@paypal.com
> >wrote:
> >
> >> No I am not using a LB. Infact I keep getting the same error even if my
> >> Kafka server and consumer are on same box. The client here is consumer
> btw.
> >>
> >> Aparup
> >>
> >>> On Oct 31, 2013, at 9:28 PM, "Jun Rao" <ju...@gmail.com> wrote:
> >>>
> >>> That typically means the client closed the socket in the middle of a
> >>> request. Are you using hardware load balancer?
> >>>
> >>> Thanks,
> >>>
> >>> Jun
> >>>
> >>>
> >>> On Wed, Oct 30, 2013 at 9:03 PM, Banerjee, Aparup <
> apbanerjee@paypal.com
> >>> wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> I keep getting this error in Kafka server.log. I don't see anything in
> >> my
> >>>> producer or consumer log. Any idea what can be going on here?
> >>>>
> >>>> Aparup
> >>>>
> >>>> 2013-10-31 02:37:13,917] INFO Closing socket connection to /x.x.x.x.
> >>>> (kafka.network.Processor)
> >>>> [2013-10-31 02:37:21,645] INFO Closing socket connection to /x.x.x.x.
> >>>> (kafka.network.Processor)
> >>>> [2013-10-31 02:37:21,713] ERROR Closing socket for /x.x.x.x because of
> >>>> error (kafka.network.Processor)
> >>>> java.io.IOException: Connection reset by peer
> >>>> at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
> >>>> at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
> >>>> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
> >>>> at sun.nio.ch.IOUtil.read(IOUtil.java:197)
> >>>> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
> >>>> at kafka.utils.Utils$.read(Utils.scala:394)
> >>>> at
> >>
> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
> >>>> at kafka.network.Processor.read(SocketServer.scala:339)
> >>>> at kafka.network.Processor.run(SocketServer.scala:245)
> >>>> at java.lang.Thread.run(Thread.java:744)
> >>
>
Re: Connection reset by peer Error in Kafka server.log
Posted by "Banerjee, Aparup" <ap...@paypal.com>.
That was my initial hunch, but consumer logs are clean. Could it be some GC stuff on consumer?
Thanks,
Aparup
> On Oct 31, 2013, at 9:36 PM, "Neha Narkhede" <ne...@gmail.com> wrote:
>
> Is the consumer being shutdown or interrupted? Do you see any relevant
> errors in your consumer's logs?
>
> Thanks,
> Neha
>
>
> On Thu, Oct 31, 2013 at 9:31 PM, Banerjee, Aparup <ap...@paypal.com>wrote:
>
>> No I am not using a LB. Infact I keep getting the same error even if my
>> Kafka server and consumer are on same box. The client here is consumer btw.
>>
>> Aparup
>>
>>> On Oct 31, 2013, at 9:28 PM, "Jun Rao" <ju...@gmail.com> wrote:
>>>
>>> That typically means the client closed the socket in the middle of a
>>> request. Are you using hardware load balancer?
>>>
>>> Thanks,
>>>
>>> Jun
>>>
>>>
>>> On Wed, Oct 30, 2013 at 9:03 PM, Banerjee, Aparup <apbanerjee@paypal.com
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> I keep getting this error in Kafka server.log. I don't see anything in
>> my
>>>> producer or consumer log. Any idea what can be going on here?
>>>>
>>>> Aparup
>>>>
>>>> 2013-10-31 02:37:13,917] INFO Closing socket connection to /x.x.x.x.
>>>> (kafka.network.Processor)
>>>> [2013-10-31 02:37:21,645] INFO Closing socket connection to /x.x.x.x.
>>>> (kafka.network.Processor)
>>>> [2013-10-31 02:37:21,713] ERROR Closing socket for /x.x.x.x because of
>>>> error (kafka.network.Processor)
>>>> java.io.IOException: Connection reset by peer
>>>> at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>>>> at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>>>> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
>>>> at sun.nio.ch.IOUtil.read(IOUtil.java:197)
>>>> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
>>>> at kafka.utils.Utils$.read(Utils.scala:394)
>>>> at
>> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
>>>> at kafka.network.Processor.read(SocketServer.scala:339)
>>>> at kafka.network.Processor.run(SocketServer.scala:245)
>>>> at java.lang.Thread.run(Thread.java:744)
>>
Re: Connection reset by peer Error in Kafka server.log
Posted by Neha Narkhede <ne...@gmail.com>.
Is the consumer being shutdown or interrupted? Do you see any relevant
errors in your consumer's logs?
Thanks,
Neha
On Thu, Oct 31, 2013 at 9:31 PM, Banerjee, Aparup <ap...@paypal.com>wrote:
> No I am not using a LB. Infact I keep getting the same error even if my
> Kafka server and consumer are on same box. The client here is consumer btw.
>
> Aparup
>
> > On Oct 31, 2013, at 9:28 PM, "Jun Rao" <ju...@gmail.com> wrote:
> >
> > That typically means the client closed the socket in the middle of a
> > request. Are you using hardware load balancer?
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Wed, Oct 30, 2013 at 9:03 PM, Banerjee, Aparup <apbanerjee@paypal.com
> >wrote:
> >
> >> Hi,
> >>
> >> I keep getting this error in Kafka server.log. I don't see anything in
> my
> >> producer or consumer log. Any idea what can be going on here?
> >>
> >> Aparup
> >>
> >> 2013-10-31 02:37:13,917] INFO Closing socket connection to /x.x.x.x.
> >> (kafka.network.Processor)
> >> [2013-10-31 02:37:21,645] INFO Closing socket connection to /x.x.x.x.
> >> (kafka.network.Processor)
> >> [2013-10-31 02:37:21,713] ERROR Closing socket for /x.x.x.x because of
> >> error (kafka.network.Processor)
> >> java.io.IOException: Connection reset by peer
> >> at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
> >> at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
> >> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
> >> at sun.nio.ch.IOUtil.read(IOUtil.java:197)
> >> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
> >> at kafka.utils.Utils$.read(Utils.scala:394)
> >> at
> >>
> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
> >> at kafka.network.Processor.read(SocketServer.scala:339)
> >> at kafka.network.Processor.run(SocketServer.scala:245)
> >> at java.lang.Thread.run(Thread.java:744)
> >>
> >>
>
Re: Connection reset by peer Error in Kafka server.log
Posted by "Banerjee, Aparup" <ap...@paypal.com>.
No I am not using a LB. Infact I keep getting the same error even if my Kafka server and consumer are on same box. The client here is consumer btw.
Aparup
> On Oct 31, 2013, at 9:28 PM, "Jun Rao" <ju...@gmail.com> wrote:
>
> That typically means the client closed the socket in the middle of a
> request. Are you using hardware load balancer?
>
> Thanks,
>
> Jun
>
>
> On Wed, Oct 30, 2013 at 9:03 PM, Banerjee, Aparup <ap...@paypal.com>wrote:
>
>> Hi,
>>
>> I keep getting this error in Kafka server.log. I don't see anything in my
>> producer or consumer log. Any idea what can be going on here?
>>
>> Aparup
>>
>> 2013-10-31 02:37:13,917] INFO Closing socket connection to /x.x.x.x.
>> (kafka.network.Processor)
>> [2013-10-31 02:37:21,645] INFO Closing socket connection to /x.x.x.x.
>> (kafka.network.Processor)
>> [2013-10-31 02:37:21,713] ERROR Closing socket for /x.x.x.x because of
>> error (kafka.network.Processor)
>> java.io.IOException: Connection reset by peer
>> at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>> at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
>> at sun.nio.ch.IOUtil.read(IOUtil.java:197)
>> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
>> at kafka.utils.Utils$.read(Utils.scala:394)
>> at
>> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
>> at kafka.network.Processor.read(SocketServer.scala:339)
>> at kafka.network.Processor.run(SocketServer.scala:245)
>> at java.lang.Thread.run(Thread.java:744)
>>
>>
Re: Connection reset by peer Error in Kafka server.log
Posted by Jun Rao <ju...@gmail.com>.
That typically means the client closed the socket in the middle of a
request. Are you using hardware load balancer?
Thanks,
Jun
On Wed, Oct 30, 2013 at 9:03 PM, Banerjee, Aparup <ap...@paypal.com>wrote:
> Hi,
>
> I keep getting this error in Kafka server.log. I don't see anything in my
> producer or consumer log. Any idea what can be going on here?
>
> Aparup
>
> 2013-10-31 02:37:13,917] INFO Closing socket connection to /x.x.x.x.
> (kafka.network.Processor)
> [2013-10-31 02:37:21,645] INFO Closing socket connection to /x.x.x.x.
> (kafka.network.Processor)
> [2013-10-31 02:37:21,713] ERROR Closing socket for /x.x.x.x because of
> error (kafka.network.Processor)
> java.io.IOException: Connection reset by peer
> at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
> at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
> at sun.nio.ch.IOUtil.read(IOUtil.java:197)
> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
> at kafka.utils.Utils$.read(Utils.scala:394)
> at
> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
> at kafka.network.Processor.read(SocketServer.scala:339)
> at kafka.network.Processor.run(SocketServer.scala:245)
> at java.lang.Thread.run(Thread.java:744)
>
>