svn get very very very slow or no response when accessing a dir with 10 thousand files in it

[Gilbert Fine <gf...@corp.netease.com>]

Hi All,

        We are running a repository (using HTTP/HTTPS protocol) on FreeBSD, subversion is 1.0.0. After commiting a dir with near 10 thousand files in it (total size is about 60M Bytes), other people cannot checkout this dir, or even 'svn list' on this dir. If using TSVN, you may get timeout message. If using svn command line, you may get the result, but you have to be very patient.

        This is top status of the server when 'svn up' timeout'ed on this dir:

last pid:  1169;  load averages:  0.10,  0.22,  0.34    up 6+08:26:33  20:58:40
46 processes:  1 running, 45 sleeping
CPU states:  6.0% user,  0.0% nice,  1.8% system,  0.4% interrupt, 91.8% idle
Mem: 462M Active, 1083M Inact, 237M Wired, 12K Cache, 199M Buf, 227M Free
Swap: 4096M Total, 4096M Free

  PID USERNAME PRI NICE  SIZE    RES STATE  C   TIME   WCPU    CPU COMMAND
 1127 svn       -2   0   163M 54792K ffsfsn 0   0:50 14.70% 14.70% httpd
 6943 root       2   0 17128K  3280K select 0  18:23  0.00%  0.00% nmbd
 1118 svn        2   0   438M   400M poll   0   7:52  0.00%  0.00% httpd

    Finally, I restart Apache.


    Things is a little different when use 'svn list' on it. httpd use much memory, almost no I/O, but I can get the result finally.

    To my surprise, using browser to list this dir is fast (as fast as visiting other dir).

    And I have modify some parametes in DB_CONFIG (and then run svnadmin recover):
set_lk_max_locks   200000
set_lk_max_lockers 200000
set_lk_max_objects 200000
    I don't know it helps or not.


Gilbert Fine

Re: svn get very very very slow or no response when accessing a dir with 10 thousand files in it

[Philip Martin <ph...@codematters.co.uk>]

"Gilbert Fine" <gf...@corp.netease.com> writes:

>
>         We are running a repository (using HTTP/HTTPS protocol) on
> FreeBSD, subversion is 1.0.0. After commiting a dir with near 10
> thousand files in it (total size is about 60M Bytes), other people
> cannot checkout this dir, or even 'svn list' on this dir.

This sounds like issue 1492.  My measurements in that issue (see
25-Aug-2003) show that PROPFIND scales badly with directory size.

-- 
Philip Martin

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org