You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Amol Karnik <am...@coventor.com> on 2005/07/01 18:00:51 UTC

Huge memory leaks from svn using https

Hi all,

i looked through the archives and found one earlier incident which 
seemed similar to my problems, but there were no solutions there. 
(Besides that was with a 0.x version of subversion)

I'm in the process of migrating my company's repository from cvs to svn 
and testing it out.  The size of my svn repository dir is 1.68Gb with 
around 130,000 or so files in it...mostly source code.

I have svn 1.2.0 running with apache 2.0 using SSL.

If i checkout the trunk of my repository, my memory usage goes up like 
crazy.
I checked the output from top and memory usage on an idle newly rebooted 
svn server machine *went from around 200Mb to 1.1 Gb*. 
After the checkout finished, the memory* decreased only slightly from 
1.1Gb to 999Mb.* 
I stopped httpd, and the memory usage *went down from 999Mb to 976Mb*.
When i start httpd again, the memory usage as reported in top, *went 
from 976 to 983Mb.

*It looks like svn is chewing up a lot of RAM but not returning it. This 
is very critical for me because i will have 4 builds atleast running 
each night and checking out the source code, (not to mention 20 dev 
engineers during the day).......my server wont be able to handle this at 
all.

Is there anything i can do to troubleshoot this? Has anyone else come 
across this problem before? I would really appreciate any help and am 
willing to test out patches or whatever. I downloaded the svn rpms from 
the subversion website and installed them directly.

Here's my machine details :

Server: Dell 1.3 ghz P4, 1 Gb RAM
OS     : Red Hat Enterprise Linux 4.0

*Subversion related packages*:-
httpd-suexec-2.0.52-9.ent
system-config-httpd-1.3.1-1
httpd-manual-2.0.52-9.ent
httpd-2.0.52-9.ent
subversion-perl-1.2.0-1
subversion-1.2.0-1
subversion-python-1.2.0-1
subversion-tools-1.2.0-1
mod_dav_svn-1.2.0-1

Here's a few snippets from my svn a*pache config file*:

====================================================
<Location /rep>

        DAV svn
        SVNParentPath /var/svn/rep

        SVNIndexXSLT "/svn/style.xsl"

        SSLRequireSSL

        AuthzSVNAccessFile /var/svn/config/svn-access-file

        Require valid-user

        AuthType Basic
        AuthName "Coventor Subversion Repository"
        AuthUserFile /var/svn/config/svn-auth-file

</Location>
=================================================


thanks!

- amol


-- 
-----------------------------------------------
Amol Karnik
Manager, Product Development
Coventor, Inc.
625 Mount Auburn Street
Cambridge MA, 02138

Work : (617) 497-6880 x248
Cell : (617) 304-4199
Fax  : (617) 497-6882

Email: amol@coventor.com
Web  : http://www.coventor.com
-----------------------------------------------

Re: Huge memory leaks from svn using https

Posted by Amol Karnik <am...@coventor.com>.
ohhhh sorry...i  had to idea about that fact about linux. I looked at 
the output of "top" and "free" and made the assumption...i'm new to 
linux, been working on solaris and windows  all this while.

thanks...this helps remove one major confusion!

- amol


Jamie Lawrence wrote:

>On Fri, 01 Jul 2005, Amol Karnik wrote:
>
>  
>
>>If i checkout the trunk of my repository, my memory usage goes up like 
>>crazy.
>>I checked the output from top and memory usage on an idle newly rebooted 
>>svn server machine *went from around 200Mb to 1.1 Gb*. 
>>After the checkout finished, the memory* decreased only slightly from 
>>1.1Gb to 999Mb.* 
>>I stopped httpd, and the memory usage *went down from 999Mb to 976Mb*.
>>When i start httpd again, the memory usage as reported in top, *went 
>>from 976 to 983Mb.
>>    
>>
>
>Are you looking at the mem used value in top? If so, you do realize that
>Linux uses all unused RAM as a cache, right? You can verify this for
>yourself by doing something on a large file. Say, reboot your machine,
>grep a 2G file for something, and you'll have the same effect.
>
>The RAM is released on demand, as applications use it. In general, let a
>linux box run for a few days, and you will see the Mem free value stay
>roughly flat at some very small value, fluxuating only when a large app
>exits.
>
>The only thing to be concerned about is if, say httpd had a huge memory
>usage.
>
>-j
>
>
>  
>

Re: Huge memory leaks from svn using https

Posted by Jamie Lawrence <ja...@jal.org>.
On Fri, 01 Jul 2005, Amol Karnik wrote:

> If i checkout the trunk of my repository, my memory usage goes up like 
> crazy.
> I checked the output from top and memory usage on an idle newly rebooted 
> svn server machine *went from around 200Mb to 1.1 Gb*. 
> After the checkout finished, the memory* decreased only slightly from 
> 1.1Gb to 999Mb.* 
> I stopped httpd, and the memory usage *went down from 999Mb to 976Mb*.
> When i start httpd again, the memory usage as reported in top, *went 
> from 976 to 983Mb.

Are you looking at the mem used value in top? If so, you do realize that
Linux uses all unused RAM as a cache, right? You can verify this for
yourself by doing something on a large file. Say, reboot your machine,
grep a 2G file for something, and you'll have the same effect.

The RAM is released on demand, as applications use it. In general, let a
linux box run for a few days, and you will see the Mem free value stay
roughly flat at some very small value, fluxuating only when a large app
exits.

The only thing to be concerned about is if, say httpd had a huge memory
usage.

-j


-- 
Jamie Lawrence                                        jal@jal.org


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org