You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mina.apache.org by "zhaizeyu (Jira)" <ji...@apache.org> on 2021/12/13 03:09:00 UTC

[jira] [Comment Edited] (SSHD-1169) Sftp Server throughput is lagging for concurrent threads

    [ https://issues.apache.org/jira/browse/SSHD-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17458136#comment-17458136 ] 

zhaizeyu edited comment on SSHD-1169 at 12/13/21, 3:08 AM:
-----------------------------------------------------------

I tried to do a comparative experiment, using jsch implementation of the java client to connect to the SFTP server. Compared with groups 1 and 3, 9 and 10, restarting the SFTP server does not increase the throughput. The SFTP performance may not deteriorate due to time-lapse, but may be affected by other causes.[~gnodet] 
|No.|threads|cycles|file size(M)|Number of files|Total Execution Time|Execution duration when no file is transferred|Actual SFTP Duration|Throughput(M/s)|Throughput/threads|Remarks|
|1|20|10|109|200|121.1|23.2|97.9|222.68|11.1338| |
|2|20|1|109|20|11|2.7|8.3|262.65|13.1325| |
|3|20|10|109|200|117.6|21.5|96.1|226.85|11.3424|After the SFTP server is restarted|
|4|1|10|109|10|87.1|39.9|47.2|23.093|23.0932| |
|5|1|1|109|1|4.62|2.2|2.42|45.041|45.0413| |
|6|20|100|2.6|2000|290.4|238.2|52.2|99.617|4.98084| |
|7|20|1|2.6|20|4.4|3.9|0.5|104|5.2| |
|8|20|10|2.6|200|28.6|23.5|5.1|101.96|5.09804| |
|9|20|100|109|2000|1229.4|242.7|986.7|220.94|11.0469| |
|10|20|100|109|2000|1230.2|241.3|988.9|220.45|11.0223|After the SFTP server is restarted|


was (Author: JIRAUSER281606):
I tried to do a comparative experiment, using jsch implementation of the java client to connect to the SFTP server. Compared with groups 1 and 3, 9 and 10, restarting the SFTP server does not increase the throughput. The SFTP performance may not deteriorate due to time-lapse, but may be affected by other causes.
|No.|threads|cycles|file size(M)|Number of files|Total Execution Time|Execution duration when no file is transferred|Actual SFTP Duration|Throughput(M/s)|Throughput/threads|Remarks|
|1|20|10|109|200|121.1|23.2|97.9|222.68|11.1338| |
|2|20|1|109|20|11|2.7|8.3|262.65|13.1325| |
|3|20|10|109|200|117.6|21.5|96.1|226.85|11.3424|After the SFTP server is restarted|
|4|1|10|109|10|87.1|39.9|47.2|23.093|23.0932| |
|5|1|1|109|1|4.62|2.2|2.42|45.041|45.0413| |
|6|20|100|2.6|2000|290.4|238.2|52.2|99.617|4.98084| |
|7|20|1|2.6|20|4.4|3.9|0.5|104|5.2| |
|8|20|10|2.6|200|28.6|23.5|5.1|101.96|5.09804| |
|9|20|100|109|2000|1229.4|242.7|986.7|220.94|11.0469| |
|10|20|100|109|2000|1230.2|241.3|988.9|220.45|11.0223|After the SFTP server is restarted|

> Sftp Server throughput is lagging for concurrent threads
> --------------------------------------------------------
>
>                 Key: SSHD-1169
>                 URL: https://issues.apache.org/jira/browse/SSHD-1169
>             Project: MINA SSHD
>          Issue Type: Improvement
>    Affects Versions: 2.5.1
>            Reporter: Susmit Sarkar
>            Priority: Blocker
>         Attachments: image-2021-05-19-10-27-20-261.png
>
>
> Hello Team,
> We are seeing a considerably low throughput for large-sized file (100Mb sized file during concurrent execution)
> We did some load testing and the throughputs sometimes increase (when we do a VM reboot for 1st run) and sometimes its pretty low compare to commercial servers
>  
> *2000 cycle runs | 20 concurrent threads | 100mb files == Throughput is 0.94 documents per seconds*
> For a commercial server, it's around 1.17 documents per second.
> Now if we do a server reboot and re-execute the test then the throughput increases by leaps and bounds
> *2000 cycle runs | 20 concurrent threads | 100 MB files == Throughput is 1.90 documents per seconds (More than 100 percent)*
> *cycle means 100 MB file upload times, 2000 means 2000times*100 MB which got distributed by 20 concurrent sftp sessions*
>  I am using IO Factory as NIO2, and below are the combinations for different NIO worker threads
> !image-2021-05-19-10-27-20-261.png!
> We are pretty confused and need help. For small files, Apache performed very well the throughput was 30 percent better than commercial server, but for large files, we are seeing these issues sometimes (mostly with reboot it performs good, but after that run its starts lagging)
> nio-workers ===> *varies from the chart above*
>  max-auth-requests ===> 3
>  Compression ===> NONE
>  max-concurrent-sessions ===> 2147483647
>   packet-size ===> 65536
>  idle-timeout ===> 300000
>  server-identification ===> SFTP Server
>  window-size ===> 4194304
> we are setting currently all this properties to *SshServer*, is there any performance tuning parameter can be used?
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@mina.apache.org
For additional commands, e-mail: dev-help@mina.apache.org