Subversion performance on large directories

[ma...@ipcmedia.com]

Hi all,

I'm having some performance issues with Subversion 1.01, and would
appreciate some advice...

I'm running a "proof of concept" system on Solaris 8 - the subversion
server is only a lowly Sun Ultra5/330Mhz/128Mb, but I'm worried that
from the results I am seeing, performance won't be improved even when
moving up to a faster system.

The subversion repository is on a 60Gb slice, mirrored via disksuite,
with "noatime" and "logging" mount options. 

I've checked out the entire repository, which is some 2Gb or so in size,
and performed a series of tests. 
One directory has 152 sub-directories and 3,466 files (excluding .svn
dirs and contents). Running "svn status" in this directory takes 11
seconds, which is not bad considering.

However, the entire checked-out copy of the repsoitory has 1,825
sub-directories and 100,217 files - which takes a whopping 20 minutes to
get a "svn status" on.  

Is there anyway at all I can speed up this process ? Reorganising and/or
deleting things inside the repository would be a major nightmare for
historical reasons, and even then, it's unlikely that the number of
files would be reduced greatly.

Any input would be much appreciated!

-Mark
-----------------------------------------------------------------------
This E-mail is from IPC Media Ltd whose registered office is at Kings
Reach Tower, Stamford Street, London SE1 9LS, registered number 53626.
The contents and any attachments to it include information that is 
private and confidential and should only be read by those persons to 
whom they are addressed. IPC Media accepts no liability for any loss or
damage suffered by any person arising from the use of this e-mail. 
Neither IPC Media nor the sender accepts any responsibility for viruses
and it is your responsibility to check the email and attachments (if any).
No contracts may be concluded on behalf of IPC Media by means of e-mail
communications. If you have received this e-mail in error, please destroy
and delete the message from your computer. For unbeatable savings on
magazine subscriptions and great gift ideas visit www.ipcsubs.co.uk/IZAF 


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Subversion performance on large directories

[Ben Collins-Sussman <su...@collab.net>]

On Fri, 2004-04-16 at 08:17, mark_round@ipcmedia.com wrote:

> However, the entire checked-out copy of the repsoitory has 1,825
> sub-directories and 100,217 files - which takes a whopping 20 minutes to
> get a "svn status" on.  

Wow... 20 minutes to stat 100K files?  I don't know what to say.  That's
83 file-stats per second, which doesn't seem unreasonable to me.

Let me turn the question around:  when you make changes to the project,
do you do them *all over* the 1800 directories?  In other words:  is it
a realistic use case to have the entire repository checked out?  Do
developers really do that?  Or do they just checkout working copies of
subdirs?  And if they really do have the whole thing checked out, are
they going to be running 'svn status' and/or 'svn commit' from the top
of the hierarchy?





---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org