You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by the_palakkaran <ji...@suntecsbs.com> on 2018/10/17 08:52:40 UTC
Failed to process selector key error
Hi,
While loading data using streamer, I have the below exception. Why do i get
this error?
From another thread, there was a hint that it causes due to network lags.
Even if this error occurs, data loading gets complete without any problem.
[grid-nio-worker-tcp-comm-0-#25][TcpCommunicationSpi] Failed to process
selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker
[super=AbstractNioClientWorker [idx=0, bytesRcvd=276409905,
bytesSent=480474228, bytesRcvd0=13319971, bytesSent0=12535268, select=true,
super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=null,
finished=false, hashCode=510309409, interrupted=false,
runner=grid-nio-worker-tcp-comm-0-#25]]],
writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
inRecovery=GridNioRecoveryDescriptor [acked=442016, resendCnt=0,
rcvCnt=502951, sentCnt=442032, reserved=true, lastAck=502944,
nodeLeft=false, node=TcpDiscoveryNode
[id=e7651c3d-52cb-42d5-a112-7c7e346a25d0, addrs=[0:0:0:0:0:0:0:1%lo,
127.0.0.1, 192.168.11.134], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500,
/127.0.0.1:47500, sbstjvmlx222.suntecsbs.com/192.168.11.134:47500],
discPort=47500, order=2, intOrder=2, lastExchangeTime=1539762572477,
loc=false, ver=2.6.0#20180710-sha1:669feacc, isClient=false],
connected=false, connectCnt=1, queueLimit=4096, reserveCnt=2,
pairedConnections=false], outRecovery=GridNioRecoveryDescriptor
[acked=442016, resendCnt=0, rcvCnt=502951, sentCnt=442032, reserved=true,
lastAck=502944, nodeLeft=false, node=TcpDiscoveryNode
[id=e7651c3d-52cb-42d5-a112-7c7e346a25d0, addrs=[0:0:0:0:0:0:0:1%lo,
127.0.0.1, 192.168.11.134], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500,
/127.0.0.1:47500, sbstjvmlx222.suntecsbs.com/192.168.11.134:47500],
discPort=47500, order=2, intOrder=2, lastExchangeTime=1539762572477,
loc=false, ver=2.6.0#20180710-sha1:669feacc, isClient=false],
connected=false, connectCnt=1, queueLimit=4096, reserveCnt=2,
pairedConnections=false], super=GridNioSessionImpl
[locAddr=/192.168.11.130:36356,
rmtAddr=sbstjvmlx222.suntecsbs.com/192.168.11.134:47100,
createTime=1539762655890, closeTime=0, bytesSent=478235463,
bytesRcvd=264250879, bytesSent0=12535268, bytesRcvd0=13319971,
sndSchedTime=1539762655890, lastSndTime=1539762724840,
lastRcvTime=1539762724840, readsPaused=false,
filterChain=FilterChain[filters=[GridNioCodecFilter
[parser=o.a.i.i.util.nio.GridDirectParser@b36d8a, directMode=true],
GridConnectionBytesVerifyFilter], accepted=false]]]
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:51)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at
org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processWrite0(GridNioServer.java:1649)
at
org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processWrite(GridNioServer.java:1306)
at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2342)
at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2110)
at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
at java.lang.Thread.run(Thread.java:748)
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Failed to process selector key error
Posted by aealexsandrov <ae...@gmail.com>.
Hi,
Your client was disconnected from the server. It could be because of
different reasons:
1. Network problems on your client.
2. Very long GC pause on the server side.
I guess that you face first because you note that possible you had the
network problems.
In this case, the server will not able to get metrics from the client node
for some time and close the connection. Data streamer operation will fail in
this case because the connection was closed.
However, you can try to set up failure detection as it described here is
related section:
https://www.gridgain.com/sdk/pe/latest/javadoc/org/apache/ignite/spi/discovery/tcp/TcpDiscoverySpi.html
BR,
Andrei
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Failed to process selector key error
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
I have seen this problem under heavy workloads and my recommendation will
be to increase socketWriteTimeout:
<property name="communicationSpi">
<bean
class="org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi">
<property name="socketWriteTimeout" value="5000"/>
<property name="usePairedConnections" value="true"/>
</bean>
</property>
Regards,
--
Ilya Kasnacheev
ср, 17 окт. 2018 г. в 11:52, the_palakkaran <ji...@suntecsbs.com>:
>
> Hi,
>
> While loading data using streamer, I have the below exception. Why do i get
> this error?
>
> From another thread, there was a hint that it causes due to network lags.
> Even if this error occurs, data loading gets complete without any problem.
>
> [grid-nio-worker-tcp-comm-0-#25][TcpCommunicationSpi] Failed to process
> selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker
> [super=AbstractNioClientWorker [idx=0, bytesRcvd=276409905,
> bytesSent=480474228, bytesRcvd0=13319971, bytesSent0=12535268, select=true,
> super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=null,
> finished=false, hashCode=510309409, interrupted=false,
> runner=grid-nio-worker-tcp-comm-0-#25]]],
> writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
> readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
> inRecovery=GridNioRecoveryDescriptor [acked=442016, resendCnt=0,
> rcvCnt=502951, sentCnt=442032, reserved=true, lastAck=502944,
> nodeLeft=false, node=TcpDiscoveryNode
> [id=e7651c3d-52cb-42d5-a112-7c7e346a25d0, addrs=[0:0:0:0:0:0:0:1%lo,
> 127.0.0.1, 192.168.11.134], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500,
> /127.0.0.1:47500, sbstjvmlx222.suntecsbs.com/192.168.11.134:47500],
> discPort=47500, order=2, intOrder=2, lastExchangeTime=1539762572477,
> loc=false, ver=2.6.0#20180710-sha1:669feacc, isClient=false],
> connected=false, connectCnt=1, queueLimit=4096, reserveCnt=2,
> pairedConnections=false], outRecovery=GridNioRecoveryDescriptor
> [acked=442016, resendCnt=0, rcvCnt=502951, sentCnt=442032, reserved=true,
> lastAck=502944, nodeLeft=false, node=TcpDiscoveryNode
> [id=e7651c3d-52cb-42d5-a112-7c7e346a25d0, addrs=[0:0:0:0:0:0:0:1%lo,
> 127.0.0.1, 192.168.11.134], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500,
> /127.0.0.1:47500, sbstjvmlx222.suntecsbs.com/192.168.11.134:47500],
> discPort=47500, order=2, intOrder=2, lastExchangeTime=1539762572477,
> loc=false, ver=2.6.0#20180710-sha1:669feacc, isClient=false],
> connected=false, connectCnt=1, queueLimit=4096, reserveCnt=2,
> pairedConnections=false], super=GridNioSessionImpl
> [locAddr=/192.168.11.130:36356,
> rmtAddr=sbstjvmlx222.suntecsbs.com/192.168.11.134:47100,
> createTime=1539762655890, closeTime=0, bytesSent=478235463,
> bytesRcvd=264250879, bytesSent0=12535268, bytesRcvd0=13319971,
> sndSchedTime=1539762655890, lastSndTime=1539762724840,
> lastRcvTime=1539762724840, readsPaused=false,
> filterChain=FilterChain[filters=[GridNioCodecFilter
> [parser=o.a.i.i.util.nio.GridDirectParser@b36d8a, directMode=true],
> GridConnectionBytesVerifyFilter], accepted=false]]]
> java.io.IOException: Connection reset by peer
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
> at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
> at sun.nio.ch.IOUtil.write(IOUtil.java:51)
> at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
> at
>
> org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processWrite0(GridNioServer.java:1649)
> at
>
> org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processWrite(GridNioServer.java:1306)
> at
>
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2342)
> at
>
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2110)
> at
>
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
> at java.lang.Thread.run(Thread.java:748)
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>