[jira] [Created] (IGNITE-20267) Infinite loop of SockeException

["Sebastian Fabisz (Jira)" <ji...@apache.org>]

Sebastian Fabisz created IGNITE-20267:
-----------------------------------------

             Summary: Infinite loop of SockeException
                 Key: IGNITE-20267
                 URL: https://issues.apache.org/jira/browse/IGNITE-20267
             Project: Ignite
          Issue Type: Bug
          Components: thin client
    Affects Versions: 2.15
            Reporter: Sebastian Fabisz


Some of our ignite instances are experiencing infinite loop of same error:

{{ERROR 2023-07-27 08:26:44,876 [grid-nio-worker-tcp-comm-2-#25%TcpCommunicationSpi%] o.a.i.s.c.t.TcpCommunicationSpi traceId="" spanId="" - Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=2, bytesRcvd=21528, bytesSent=15345, bytesRcvd0=0, bytesSent0=0, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-2, igniteInstanceName=TcpCommunicationSpi, finished=false, heartbeatTs=1690442803865, hashCode=2102759141, interrupted=false, runner=grid-nio-worker-tcp-comm-2-#25%TcpCommunicationSpi%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=null, outRecovery=null, closeSocket=true, outboundMessagesQueueSizeMetric=o.a.i.i.processors.metric.impl.LongAdderMetric@69a257d1, super=GridNioSessionImpl [locAddr=\{removed}, rmtAddr=\{removed}, createTime=1690249023154, closeTime=0, bytesSent=18, bytesRcvd=3, bytesSent0=0, bytesRcvd0=0, sndSchedTime=1690442567813, lastSndTime=1690249023154, lastRcvTime=1690442567813, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@1fff7116, directMode=true], GridConnectionBytesVerifyFilter], accepted=true, markedForClose=false]]] java.net.SocketException: Connection reset at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394) at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:411) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1351) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeys(GridNioServer.java:2575) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2271) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) at java.base/java.lang.Thread.run(Thread.java:833)}}

Each error contains same message except of heartbeatTs field.

This error repeats approximately every second. Not all of Ignite instances are affected. We have figured out that problem is caused by Nessus security scanner. It walks over all boxes and runs some security checks. It looks like one of security checks (which can be http request) causes Ignite to fall into infinite loop of errors. We think that nessus opens a connection to Ignite, then connection is closed by nessus, but Iginite won't kill the socket.

 

We have already updated Ignite to latest version.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)