You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Avi Asulin <av...@plarium.com> on 2016/06/19 10:24:50 UTC

Error closing Socet for ...

Hi
We are using kafka 0.8.2 with scala 2.10 version
We currently have 3 brokers and we are working with ~ 170 producers
We frequently get the Error

ERROR Closing socket for /170.144.181.50 because of error
(kafka.network.Processor)
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
        at sun.nio.ch.IOUtil.read(IOUtil.java:197)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:384)
        at kafka.utils.Utils$.read(Utils.scala:380)
        at
kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
        at kafka.network.Processor.read(SocketServer.scala:444)
        at kafka.network.Processor.run(SocketServer.scala:340)
        at java.lang.Thread.run(Thread.java:745)

we get the error on many producers ips
Can somone explain what can cause this error and what can be done to get
rid of it?

Thanks
Avi

Re: Error closing Socet for ...

Posted by OGrandeDiEnne <og...@gmail.com>.
Looks like the producers lose the connection to the brokers.

Do the brokers have enough resources to handle all the producers? Does the
network support that throughput?

On Sun, 19 Jun 2016, 17:27 Avi Asulin, <av...@plarium.com> wrote:

> Hi
> We are using kafka 0.8.2 with scala 2.10 version
> We currently have 3 brokers and we are working with ~ 170 producers
> We frequently get the Error
>
> ERROR Closing socket for /170.144.181.50 because of error
> (kafka.network.Processor)
> java.io.IOException: Connection reset by peer
>         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
>         at sun.nio.ch.IOUtil.read(IOUtil.java:197)
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:384)
>         at kafka.utils.Utils$.read(Utils.scala:380)
>         at
>
> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
>         at kafka.network.Processor.read(SocketServer.scala:444)
>         at kafka.network.Processor.run(SocketServer.scala:340)
>         at java.lang.Thread.run(Thread.java:745)
>
> we get the error on many producers ips
> Can somone explain what can cause this error and what can be done to get
> rid of it?
>
> Thanks
> Avi
>