You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@commons.apache.org by "Mario Ivankovits (JIRA)" <ji...@apache.org> on 2007/01/16 11:35:27 UTC

[jira] Commented: (VFS-107) large Sftp transfers fail with OutOfMemoryError: Java heap space

    [ https://issues.apache.org/jira/browse/VFS-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12465113 ] 

Mario Ivankovits commented on VFS-107:
--------------------------------------

Hi!

The stream-based methods were dog slow in the past. And when I say dog slow, I mean they were "double dog slow" - to an unusable extent ;-)
As far as I remember it had something to do with the piped streams jsch has to use internally in case of stream based operations.

I dont know if this has been fixed now, should give it another try.

> large Sftp transfers fail with OutOfMemoryError: Java heap space
> ----------------------------------------------------------------
>
>                 Key: VFS-107
>                 URL: https://issues.apache.org/jira/browse/VFS-107
>             Project: Commons VFS
>          Issue Type: Bug
>    Affects Versions: Nightly Builds
>         Environment: java version "1.5.0_04"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_04-b05)
> Java HotSpot(TM) Client VM (build 1.5.0_04-b05, mixed mode, sharing)
> Linux version 2.6.17-1.2142_FC4 (bhcompile@hs20-bc1-4.build.redhat.com) (gcc version 4.0.2 20051125 (Red Hat 4.0.2-8)) #1 Tue Jul 11 22:41:14 EDT 2006
>            Reporter: Marty Lamb
>
> Calling SftpFileObject.getOutputStream() returns a descendant of ByteArrayOutputStream; nothing is written to the remote sftp server until the OutputStream is closed.  For large data transfers, this exhausts local resources.
> This is noted in the source for SftpFileObject:
> 	protected OutputStream doGetOutputStream(boolean bAppend) throws Exception
> 	{
> 		// TODO - Don't write the entire file into memory. Use the stream-based
> 		// methods on ChannelSftp once the work properly
> 		final ChannelSftp channel = fileSystem.getChannel();
> 		return new SftpOutputStream(channel);
> 	}
> although it is not clear what "once the[y] work properly" is referring to.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: commons-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: commons-dev-help@jakarta.apache.org