You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ivan Bessonov (Jira)" <ji...@apache.org> on 2021/10/18 09:11:00 UTC
[jira] [Updated] (IGNITE-15767) Need to workaround JDK bug
JDK-8247750
[ https://issues.apache.org/jira/browse/IGNITE-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ivan Bessonov updated IGNITE-15767:
-----------------------------------
Description:
See [https://bugs.openjdk.java.net/browse/JDK-8247750]
ServerSocket.accept() with no timeout may throw SocketTimeoutException when the process receives a signal. It can cause unexpected exception in the disco reader:
{noformat}
[09:52:26,301][SEVERE][tcp-disco-srvr-[:47500]-#3-#71][TcpDiscoverySpi] Failed to accept TCP connection.[09:52:26,301][SEVERE][tcp-disco-srvr-[:47500]-#3-#71][TcpDiscoverySpi] Failed to accept TCP connection.java.net.SocketTimeoutException: Accept timed out at java.base/java.net.PlainSocketImpl.socketAccept(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
at java.base/java.net.ServerSocket.implAccept(ServerSocket.java:565)
at java.base/java.net.ServerSocket.accept(ServerSocket.java:533)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServer.body(ServerImpl.java:6750)
at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:119)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServerThread.body(ServerImpl.java:6673)
at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:57){noformat}
There are mentions of this on StackOverflow and userlist, and we also see it when running Docker on Alpine 3.15. Speculation is that this is caused by a combination of a specific version of Linux kernel and environment.
Sidenote: based on strace analysis on Alpine, it doesn't even receive any signals; it could be so that Alpine interrupts the syscall "as if" by a signal.
The bug is not fixed in JDK 11 (surprisingly). WA is easy though - wrap the accept in try-catch, and retry if getting the unexpected timeout exception.
was:
See [https://bugs.openjdk.java.net/browse/JDK-8247750]
ServerSocket.accept() with no timeout may throw SocketTimeoutException when the process receives a signal. It can cause unexpected exception in the disco reader:
{noformat}
[09:52:26,301][SEVERE][tcp-disco-srvr-[:47500]-#3-#71][TcpDiscoverySpi] Failed to accept TCP connection.[09:52:26,301][SEVERE][tcp-disco-srvr-[:47500]-#3-#71][TcpDiscoverySpi] Failed to accept TCP connection.java.net.SocketTimeoutException: Accept timed out at java.base/java.net.PlainSocketImpl.socketAccept(Native Method) at java.base/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458) at java.base/java.net.ServerSocket.implAccept(ServerSocket.java:565) at java.base/java.net.ServerSocket.accept(ServerSocket.java:533) at org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServer.body(ServerImpl.java:6750) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:119) at org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServerThread.body(ServerImpl.java:6673) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:57){noformat}
{{}}
There are mentions of this on StackOverflow and userlist, and we also see it when running Docker on Alpine 3.15. Speculation is that this is caused by a combination of a specific version of Linux kernel and environment.
Sidenote: based on strace analysis on Alpine, it doesn't even receive any signals; it could be so that Alpine interrupts the syscall "as if" by a signal.
The bug is not fixed in JDK 11 (surprisingly). WA is easy though - wrap the accept in try-catch, and retry if getting the unexpected timeout exception.
> Need to workaround JDK bug JDK-8247750
> --------------------------------------
>
> Key: IGNITE-15767
> URL: https://issues.apache.org/jira/browse/IGNITE-15767
> Project: Ignite
> Issue Type: Improvement
> Reporter: Ivan Bessonov
> Priority: Major
> Fix For: 2.13
>
>
> See [https://bugs.openjdk.java.net/browse/JDK-8247750]
> ServerSocket.accept() with no timeout may throw SocketTimeoutException when the process receives a signal. It can cause unexpected exception in the disco reader:
> {noformat}
> [09:52:26,301][SEVERE][tcp-disco-srvr-[:47500]-#3-#71][TcpDiscoverySpi] Failed to accept TCP connection.[09:52:26,301][SEVERE][tcp-disco-srvr-[:47500]-#3-#71][TcpDiscoverySpi] Failed to accept TCP connection.java.net.SocketTimeoutException: Accept timed out at java.base/java.net.PlainSocketImpl.socketAccept(Native Method)
> at java.base/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
> at java.base/java.net.ServerSocket.implAccept(ServerSocket.java:565)
> at java.base/java.net.ServerSocket.accept(ServerSocket.java:533)
> at org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServer.body(ServerImpl.java:6750)
> at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:119)
> at org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServerThread.body(ServerImpl.java:6673)
> at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:57){noformat}
> There are mentions of this on StackOverflow and userlist, and we also see it when running Docker on Alpine 3.15. Speculation is that this is caused by a combination of a specific version of Linux kernel and environment.
> Sidenote: based on strace analysis on Alpine, it doesn't even receive any signals; it could be so that Alpine interrupts the syscall "as if" by a signal.
> The bug is not fixed in JDK 11 (surprisingly). WA is easy though - wrap the accept in try-catch, and retry if getting the unexpected timeout exception.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)