You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mina.apache.org by "Feng Jiajie (Jira)" <ji...@apache.org> on 2020/09/01 09:55:00 UTC

[jira] [Created] (SSHD-1070) OutOfMemoryError when use port forwarding

Feng Jiajie created SSHD-1070:
---------------------------------

             Summary: OutOfMemoryError when use port forwarding
                 Key: SSHD-1070
                 URL: https://issues.apache.org/jira/browse/SSHD-1070
             Project: MINA SSHD
          Issue Type: Bug
    Affects Versions: 2.5.1
            Reporter: Feng Jiajie


Hi [~gnodet], I found this commit implemented asynchronous port forwarding:

[https://github.com/apache/mina-sshd/commit/45f84aab59b2e11d72942cffe9d810e37ab64959#diff-33823b8546f71d77bb1d653358ecde70]

However, when a large amount of data is returned from upstream application, it is possible to cause an OOM in SSHD.

Step1. SSHD server:
{code:java}
import org.apache.sshd.common.FactoryManager;
import org.apache.sshd.common.PropertyResolverUtils;
import org.apache.sshd.common.util.security.SecurityUtils;
import org.apache.sshd.server.SshServer;
import org.apache.sshd.server.forward.AcceptAllForwardingFilter;
import org.apache.sshd.server.keyprovider.SimpleGeneratorHostKeyProvider;

import java.io.IOException;
import java.nio.file.Paths;

public class TestSshd2 {

  public static void main(String[] args) throws IOException, InterruptedException {
    SecurityUtils.setAPrioriDisabledProvider("BC", true);
    SshServer sshd = SshServer.setUpDefaultServer();

    sshd.setPort(12133);
    sshd.setKeyPairProvider(new SimpleGeneratorHostKeyProvider(Paths.get("/tmp/aa.key")));
    sshd.setPasswordAuthenticator((username, password, session) -> true);
    sshd.setForwardingFilter(AcceptAllForwardingFilter.INSTANCE);

    sshd.start();

    Thread.sleep(100000000);
  }
}

{code}
Step2. start ssh client and iperf3 server: 
{code:java}
ssh -o 'ExitOnForwardFailure yes' -p 12133 -f -x -N -T -L 0.0.0.0:15678:127.0.0.1:12345 test5@127.0.0.1

iperf3 -s -p 12345
{code}
Step3. run iperf3 client: 
{code:java}
iperf3 -c 127.0.0.1  -i 1 -t 120 -p 15678 -P 8 --reverse
{code}
*-R, --reverse run in reverse mode (server sends, client receives)*

SSHD will receive a lot of data but will not be able to forward it in time.

log when OOM:
{code:java}

17:52:25.195 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-1] WARN org.apache.sshd.common.io.nio2.Nio2Session - exceptionCaught(Nio2Session[local=/127.0.0.1:33524, remote=/127.0.0.1:12345]) Exception handler threw OutOfMemoryError, closing the session: GC overhead limit exceeded17:52:25.195 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-1] WARN org.apache.sshd.common.io.nio2.Nio2Session - exceptionCaught(Nio2Session[local=/127.0.0.1:33524, remote=/127.0.0.1:12345]) Exception handler threw OutOfMemoryError, closing the session: GC overhead limit exceeded at org.apache.sshd.common.io.nio2.Nio2CompletionHandler.completed(Nio2CompletionHandler.java:37) at sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:126) at sun.nio.ch.Invoker.invokeDirect(Invoker.java:157) at sun.nio.ch.UnixAsynchronousSocketChannelImpl.implWrite(UnixAsynchronousSocketChannelImpl.java:736) at sun.nio.ch.AsynchronousSocketChannelImpl.write(AsynchronousSocketChannelImpl.java:382) at sun.nio.ch.AsynchronousSocketChannelImpl.write(AsynchronousSocketChannelImpl.java:399) at org.apache.sshd.common.io.nio2.Nio2Session.doWriteCycle(Nio2Session.java:420) at org.apache.sshd.common.io.nio2.Nio2Session.startWriting(Nio2Session.java:404) at org.apache.sshd.common.io.nio2.Nio2Session.finishWrite(Nio2Session.java:495) at org.apache.sshd.common.io.nio2.Nio2Session.handleCompletedWriteCycle(Nio2Session.java:465) at org.apache.sshd.common.io.nio2.Nio2Session$2.onCompleted(Nio2Session.java:429) at org.apache.sshd.common.io.nio2.Nio2Session$2.onCompleted(Nio2Session.java:426)17:52:25.639 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-6] WARN org.apache.sshd.common.io.nio2.Nio2Session - exceptionCaught(Nio2Session[local=/127.0.0.1:33530, remote=/127.0.0.1:12345]) Exception handler threw OutOfMemoryError, closing the session: GC overhead limit exceeded at org.apache.sshd.common.io.nio2.Nio2CompletionHandler.lambda$completed$0(Nio2CompletionHandler.java:38) at java.security.AccessController.doPrivileged(Native Method) at org.apache.sshd.common.io.nio2.Nio2CompletionHandler.completed(Nio2CompletionHandler.java:37) at sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:126) at sun.nio.ch.Invoker.invokeDirect(Invoker.java:157) at sun.nio.ch.UnixAsynchronousSocketChannelImpl.implWrite(UnixAsynchronousSocketChannelImpl.java:736)17:52:26.045 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-2] DEBUG org.apache.sshd.common.io.nio2.Nio2Session - exceptionCaught(Nio2Session[local=/127.0.0.1:33522, remote=/127.0.0.1:12345]) caught OutOfMemoryError[GC overhead limit exceeded] - calling handler17:52:26.045 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-2] DEBUG org.apache.sshd.server.forward.TcpipServerChannel - exceptionCaught(TcpipServerChannel[id=3, recipient=4]-ServerSessionImpl[test5@/127.0.0.1:53702]) signal close immediately=false due to OutOfMemoryError[GC overhead limit exceeded]17:52:26.045 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-2] DEBUG org.apache.sshd.server.forward.TcpipServerChannel - close(TcpipServerChannel[id=3, recipient=4]-ServerSessionImpl[test5@/127.0.0.1:53702])[Graceful] state already Graceful17:52:26.794 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-3] WARN org.apache.sshd.common.io.nio2.Nio2Session - exceptionCaught(Nio2Session[local=/127.0.0.1:33528, remote=/127.0.0.1:12345]) Exception handler threw OutOfMemoryError, closing the session: GC overhead limit exceeded at sun.nio.ch.AsynchronousSocketChannelImpl.write(AsynchronousSocketChannelImpl.java:382) at sun.nio.ch.AsynchronousSocketChannelImpl.write(AsynchronousSocketChannelImpl.java:399) at org.apache.sshd.common.io.nio2.Nio2Session.doWriteCycle(Nio2Session.java:420) at org.apache.sshd.common.io.nio2.Nio2Session.startWriting(Nio2Session.java:404) at org.apache.sshd.common.io.nio2.Nio2Session.finishWrite(Nio2Session.java:495) at org.apache.sshd.common.io.nio2.Nio2Session.handleCompletedWriteCycle(Nio2Session.java:465) at org.apache.sshd.common.io.nio2.Nio2Session$2.onCompleted(Nio2Session.java:429) at org.apache.sshd.common.io.nio2.Nio2Session$2.onCompleted(Nio2Session.java:426) at org.apache.sshd.common.io.nio2.Nio2CompletionHandler.lambda$completed$0(Nio2CompletionHandler.java:38)17:52:26.045 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-2] DEBUG org.apache.sshd.common.io.nio2.Nio2Session - close(Nio2Session[local=/127.0.0.1:33522, remote=/127.0.0.1:12345]) Closing immediately at java.security.AccessController.doPrivileged(Native Method)17:52:26.869 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-2] DEBUG org.apache.sshd.common.io.nio2.Nio2Session - doCloseImmediately(Nio2Session[local=/127.0.0.1:33522, remote=/127.0.0.1:12345]) closing socket=sun.nio.ch.UnixAsynchronousSocketChannelImpl[connected local=/127.0.0.1:33522 remote=/127.0.0.1:12345] at org.apache.sshd.common.io.nio2.Nio2CompletionHandler.completed(Nio2CompletionHandler.java:37) at sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:126) at sun.nio.ch.Invoker.invokeDirect(Invoker.java:157)17:52:27.568 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-6] DEBUG org.apache.sshd.common.io.nio2.Nio2Session - exceptionCaught(Nio2Session[local=/127.0.0.1:33530, remote=/127.0.0.1:12345]) caught OutOfMemoryError[GC overhead limit exceeded] - calling handler17:52:27.568 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-6] DEBUG org.apache.sshd.server.forward.TcpipServerChannel - exceptionCaught(TcpipServerChannel[id=7, recipient=8]-ServerSessionImpl[test5@/127.0.0.1:53702]) signal close immediately=false due to OutOfMemoryError[GC overhead limit exceeded]17:52:27.568 [sshd-SshServer[5bcea91b](port=12133)-nio2-thread-6] DEBUG org.apache.sshd.server.forward.TcpipServerChannel - close(TcpipServerChannel[id=7, recipient=8]-ServerSessionImpl[test5@/127.0.0.1:53702])[Graceful] state already Graceful at sun.nio.ch.UnixAsynchronousSocketChannelImpl.implWrite(UnixAsynchronousSocketChannelImpl.java:736) at sun.nio.ch.AsynchronousSocketChannelImpl.write(AsynchronousSocketChannelImpl.java:382)

{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@mina.apache.org
For additional commands, e-mail: dev-help@mina.apache.org