You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@subversion.apache.org by Brian Buesker <bb...@qualcomm.com> on 2004/10/20 18:00:32 UTC

svn switch: Possible Memory Leak

I posted the following message to the users mailing list but did not 
receive any responses. Are there any ideas on the cause of this? Are 
there any objections to me putting this into the issue tracker?

I have a source tree which I checkout containing approximately 360 MB in 
about 240 K files. I access the repository through ra_dav (either HTTP 
or HTTPS). When I svn switch my working copy to another URL and watch 
the memory usage in top, I see it continuously growing. It does not stop 
growing until the switch completes, and the RSS eventually reaches above 
700 MB. I believe it is related more to the number of files in the 
working copy rather than the total size, as I tested the same sequence 
of steps with only a single file of the same size, and no leak was 
observed.

The repository is an FSFS repository, although it shouldn't matter as 
this problem is occurring on the client side.

Sequence of steps to reproduce:

1. Create a repository with many files in the trunk (ie. by importing a 
large open source project such as ACE, TAO, and CIAO 
(http://deuce.doc.wustl.edu/ACE+TAO+CIAO.tar.gz))
2. Create a tag from the trunk
3. Checkout from the trunk
4. Switch to the tag, watching the memory usage grow as displayed in top

Here is my environment:

OS: CentOS 3.1 (equivalent to RedHat Enterprise Linux 3 Update 2)

SVN Version:
$ svn --version
svn, version 1.1.0 (Release Candidate 3)
 compiled Sep 27 2004, 09:12:49

Copyright (C) 2000-2004 CollabNet.
Subversion is open source software, see http://subversion.tigris.org/
This product includes software developed by CollabNet 
(http://www.Collab.Net/).

The following repository access (RA) modules are available:

* ra_dav : Module for accessing a repository via WebDAV (DeltaV) protocol.
- handles 'http' schema
- handles 'https' schema
* ra_local : Module for accessing a repository on local disk.
- handles 'file' schema
* ra_svn : Module for accessing a repository using the svn network 
protocol.
- handles 'svn' schema

Compiler:
$ gcc --version
gcc (GCC) 3.2.3 20030502 (Red Hat Linux 3.2.3-34)
Copyright (C) 2002 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Perl Version:
$ perl -v

This is perl, v5.8.5 built for i386-linux-thread-multi

Copyright 1987-2004, Larry Wall

Perl may be copied only under the terms of either the Artistic License 
or the
GNU General Public License, which may be found in the Perl 5 source kit.

Complete documentation for Perl, including FAQ lists, should be found on
this system using `man perl' or `perldoc perl'.  If you have access to the
Internet, point your browser at http://www.perl.com/, the Perl Home Page.

Berkeley DB Version: 4.2.52

Please let me know if there is any more information I can provide to 
help debug this problem.

Thanks,
Brian Buesker

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org

Re: svn switch: Possible Memory Leak

Posted by Brian Buesker <bb...@qualcomm.com>.
kfogel@collab.net wrote:

>Brian Buesker <bb...@qualcomm.com> writes:
>  
>
>>I posted the following message to the users mailing list but did not
>>receive any responses. Are there any ideas on the cause of this? Are
>>there any objections to me putting this into the issue tracker?
>>    
>>
>
>Can you reproduce this with the latest trunk Subversion?  If so, yes,
>filing an issue would be great.
>  
>
I just tried reproducing it with the trunk, and yes, I am still able to 
reproduce it. I've filed an issue (#2106). Please let me know if there 
is anything more you want me to do.

Thanks,
Brian

>(If you don't have time to try the reproduction, please let us know
>here.)
>
>Thanks,
>-Karl
>
>  
>
>>I have a source tree which I checkout containing approximately 360 MB
>>in about 240 K files. I access the repository through ra_dav (either
>>HTTP or HTTPS). When I svn switch my working copy to another URL and
>>watch the memory usage in top, I see it continuously growing. It does
>>not stop growing until the switch completes, and the RSS eventually
>>reaches above 700 MB. I believe it is related more to the number of
>>files in the working copy rather than the total size, as I tested the
>>same sequence of steps with only a single file of the same size, and
>>no leak was observed.
>>
>>The repository is an FSFS repository, although it shouldn't matter as
>>this problem is occurring on the client side.
>>
>>Sequence of steps to reproduce:
>>
>>1. Create a repository with many files in the trunk (ie. by importing
>>a large open source project such as ACE, TAO, and CIAO
>>(http://deuce.doc.wustl.edu/ACE+TAO+CIAO.tar.gz))
>>2. Create a tag from the trunk
>>3. Checkout from the trunk
>>4. Switch to the tag, watching the memory usage grow as displayed in top
>>
>>Here is my environment:
>>
>>OS: CentOS 3.1 (equivalent to RedHat Enterprise Linux 3 Update 2)
>>
>>SVN Version:
>>$ svn --version
>>svn, version 1.1.0 (Release Candidate 3)
>> compiled Sep 27 2004, 09:12:49
>>
>>Copyright (C) 2000-2004 CollabNet.
>>Subversion is open source software, see http://subversion.tigris.org/
>>This product includes software developed by CollabNet
>>(http://www.Collab.Net/).
>>
>>The following repository access (RA) modules are available:
>>
>>* ra_dav : Module for accessing a repository via WebDAV (DeltaV) protocol.
>>- handles 'http' schema
>>- handles 'https' schema
>>* ra_local : Module for accessing a repository on local disk.
>>- handles 'file' schema
>>* ra_svn : Module for accessing a repository using the svn network
>>protocol.
>>- handles 'svn' schema
>>
>>Compiler:
>>$ gcc --version
>>gcc (GCC) 3.2.3 20030502 (Red Hat Linux 3.2.3-34)
>>Copyright (C) 2002 Free Software Foundation, Inc.
>>This is free software; see the source for copying conditions.  There is NO
>>warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
>>
>>Perl Version:
>>$ perl -v
>>
>>This is perl, v5.8.5 built for i386-linux-thread-multi
>>
>>Copyright 1987-2004, Larry Wall
>>
>>Perl may be copied only under the terms of either the Artistic License
>>or the
>>GNU General Public License, which may be found in the Perl 5 source kit.
>>
>>Complete documentation for Perl, including FAQ lists, should be found on
>>this system using `man perl' or `perldoc perl'.  If you have access to the
>>Internet, point your browser at http://www.perl.com/, the Perl Home Page.
>>
>>Berkeley DB Version: 4.2.52
>>
>>Please let me know if there is any more information I can provide to
>>help debug this problem.
>>
>>Thanks,
>>Brian Buesker
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
>>For additional commands, e-mail: dev-help@subversion.tigris.org
>>    
>>
>
>  
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org

Re: svn switch: Possible Memory Leak

Posted by kf...@collab.net.
Brian Buesker <bb...@qualcomm.com> writes:
> I posted the following message to the users mailing list but did not
> receive any responses. Are there any ideas on the cause of this? Are
> there any objections to me putting this into the issue tracker?

Can you reproduce this with the latest trunk Subversion?  If so, yes,
filing an issue would be great.

(If you don't have time to try the reproduction, please let us know
here.)

Thanks,
-Karl

> I have a source tree which I checkout containing approximately 360 MB
> in about 240 K files. I access the repository through ra_dav (either
> HTTP or HTTPS). When I svn switch my working copy to another URL and
> watch the memory usage in top, I see it continuously growing. It does
> not stop growing until the switch completes, and the RSS eventually
> reaches above 700 MB. I believe it is related more to the number of
> files in the working copy rather than the total size, as I tested the
> same sequence of steps with only a single file of the same size, and
> no leak was observed.
> 
> The repository is an FSFS repository, although it shouldn't matter as
> this problem is occurring on the client side.
> 
> Sequence of steps to reproduce:
> 
> 1. Create a repository with many files in the trunk (ie. by importing
> a large open source project such as ACE, TAO, and CIAO
> (http://deuce.doc.wustl.edu/ACE+TAO+CIAO.tar.gz))
> 2. Create a tag from the trunk
> 3. Checkout from the trunk
> 4. Switch to the tag, watching the memory usage grow as displayed in top
> 
> Here is my environment:
> 
> OS: CentOS 3.1 (equivalent to RedHat Enterprise Linux 3 Update 2)
> 
> SVN Version:
> $ svn --version
> svn, version 1.1.0 (Release Candidate 3)
>  compiled Sep 27 2004, 09:12:49
> 
> Copyright (C) 2000-2004 CollabNet.
> Subversion is open source software, see http://subversion.tigris.org/
> This product includes software developed by CollabNet
> (http://www.Collab.Net/).
> 
> The following repository access (RA) modules are available:
> 
> * ra_dav : Module for accessing a repository via WebDAV (DeltaV) protocol.
> - handles 'http' schema
> - handles 'https' schema
> * ra_local : Module for accessing a repository on local disk.
> - handles 'file' schema
> * ra_svn : Module for accessing a repository using the svn network
> protocol.
> - handles 'svn' schema
> 
> Compiler:
> $ gcc --version
> gcc (GCC) 3.2.3 20030502 (Red Hat Linux 3.2.3-34)
> Copyright (C) 2002 Free Software Foundation, Inc.
> This is free software; see the source for copying conditions.  There is NO
> warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
> 
> Perl Version:
> $ perl -v
> 
> This is perl, v5.8.5 built for i386-linux-thread-multi
> 
> Copyright 1987-2004, Larry Wall
> 
> Perl may be copied only under the terms of either the Artistic License
> or the
> GNU General Public License, which may be found in the Perl 5 source kit.
> 
> Complete documentation for Perl, including FAQ lists, should be found on
> this system using `man perl' or `perldoc perl'.  If you have access to the
> Internet, point your browser at http://www.perl.com/, the Perl Home Page.
> 
> Berkeley DB Version: 4.2.52
> 
> Please let me know if there is any more information I can provide to
> help debug this problem.
> 
> Thanks,
> Brian Buesker
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: dev-help@subversion.tigris.org

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org