You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@subversion.apache.org by Ariel Arjona <be...@gmail.com> on 2004/09/25 18:01:07 UTC
weird performance problem
Hello,
I'm cc'ing both svndev and tsvndev lists as I'm not sure to which this
really belongs. I was hoping you guys could help me figure it out.
My setup
=========
Server:
Solaris 8 on SPARC-UE
svn 1.1.0rc4
apache 2.0.49
Everything compiled for 64-bit with -fast -xarch=v9
Test Repos: have a bdb and a fsfs copy of the same rep. About 120 MB
in size. 3 modules imported, multiple branches and tags. About 110
revisions so far. One of the modules is the Squirrelmail source tree,
which I'll use as an example.
Client:
Windows 2000 Professional SP4 fully patched
svn1.1.0rc4 precompiled command line client.
TortoiseSVN 1.1.0RC2 built against svn 1.1.0rc3 downloaded from the
tsvn website.
Network:
Client -> 100 Mbit LAN -> Server
Client -> 2 Mbit line -> Internet
My problem
===========
My problem basically is that when I'm browsing the repository with
TSVN's repo browser and I click on the [+] to expand a dir, the more
subdirs it has, the longer it takes. For example, expanding the
squirrelmail source tree at the root takes about 35 seconds. Here's a
list of the tests I've made:
Browsing
* TSVN browsing my server via http, expanding the squirrelmail trunk. 35 secs.
* TSVN browsing my server via svn://. Lightning fast, sub-second
response to all dir expansions.
* TSVN browsing http://svn.collab.net/repos/svn. Click to expand the
trunk. 5 secs.
Checkout/Commit/Log
* All combinations of clients and servers perform very well.
Web performance
* Browsing the rep with ViewCVS-dev august snapshot has good
performance. Click on /trunk of the Squirrelmail module and the
response time is roughly 1-2 seconds if visiting for the first time.
The Apache install is solely for svn purposes. The tests were
performed at a time when my server had very little load in general.
The apache logs show the following:
*** Click to expand the 20040917 folder ***
128.11.30.2 - - [25/Sep/2004:11:49:13 -0500] "PROPFIND
/svnrep/banistmo_lobby/prod/20040917 HTTP/1.1" 207 728
128.11.30.2 - - [25/Sep/2004:11:49:13 -0500] "PROPFIND
/svnrep/!svn/vcc/default HTTP/1.1" 207 396
128.11.30.2 - - [25/Sep/2004:11:49:13 -0500] "PROPFIND
/svnrep/!svn/bln/109 HTTP/1.1" 207 451
128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
/svnrep/banistmo_lobby/prod/20040917 HTTP/1.1" 207 728
128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
/svnrep/!svn/vcc/default HTTP/1.1" 207 451
128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
/svnrep/!svn/bc/109/banistmo_lobby/prod/20040917 HTTP/1.1" 207 740
128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
/svnrep/banistmo_lobby/prod/20040917 HTTP/1.1" 207 728
128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
/svnrep/!svn/vcc/default HTTP/1.1" 207 451
*wait* *wait* *wait* *wait* *wait* *wait* *wait* *wait* *wait*
128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
/svnrep/!svn/bc/109/banistmo_lobby/prod/20040917 HTTP/1.1" 207 42212
*** folder expanded ***
So what I need to do is to improve the repo browsing performance onver
HTTP on my server, to at least match the 5 seconds I get with the svn
repos over the internet. Using svnserve, unfortunately is not an
option as we depend on mod_auth_mysql for user validation. How can I
find out what's slowing the folder expansion down?
Many thanks for any insights on this problem.
Ariel
--
~
:wq
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: svn ls performance tests
Posted by Ariel Arjona <be...@gmail.com>.
On Wed, 29 Sep 2004 16:08:56 +0200, Tobias Ringström
<to...@ringstrom.mine.nu> wrote:
> Ariel Arjona wrote:
>
> >I did some testing at my home linux install:
> >
> >
> Can you add "SVNPathAuthz off" to the httpd config file and see if the
> performance goes back to normal?
>
Same results.
Also, I the tests on solaris yielded the same results as the linux
ones. rc3 = ok; rc4 = bad
Regards,
Ariel
--
~
:wq
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: svn ls performance tests
Posted by Tobias Ringström <to...@ringstrom.mine.nu>.
Ariel Arjona wrote:
>I did some testing at my home linux install:
>
>
Can you add "SVNPathAuthz off" to the httpd config file and see if the
performance goes back to normal?
/Tobias
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: svn ls performance tests
Posted by Ariel Arjona <be...@gmail.com>.
On Mon, 04 Oct 2004 08:46:04 +0200, Tobias Ringström
<to...@ringstrom.mine.nu> wrote:
> Julian Foad wrote:
>
> > Thanks for reporting this, Ariel. It certainly looks like a nasty
> > problem. I hope someone will be able to track it down.
>
> I committed a fix for this on trunk in r11211 yesterday.
>
> /Tobias
>
>
Tested on Ye Olde Sun trashcan and performance was good.
Sorry for the big mails. Will post links next time.
Regards,
Ariel
--
~
:wq
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: svn ls performance tests
Posted by Tobias Ringström <to...@ringstrom.mine.nu>.
Julian Foad wrote:
> Thanks for reporting this, Ariel. It certainly looks like a nasty
> problem. I hope someone will be able to track it down.
I committed a fix for this on trunk in r11211 yesterday.
/Tobias
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: svn ls performance tests
Posted by Julian Foad <ju...@btopenworld.com>.
Ariel Arjona wrote:
[...]
> So, it looks like a regression of some sort happened between rc3 and
> rc4. I'll perform these tests tomorrow on the solaris box to
> double-check. I'm also attaching gzipped strace logs of both the rc3
> and rc4 runs.
Thanks for reporting this, Ariel. It certainly looks like a nasty problem. I hope someone will be able to track it down.
Next time you want to make a large data file available, could I ask you not to post it to the list. The average message size is about 3KB, and posting something bigger than about 30KB is unfriendly to people on slow connections. Instead, put it on the web and post the URL, or offer to mail it directly to anybody who wants it.
- Julian
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
svn ls performance tests (was: "weird performance problem")
Posted by Ariel Arjona <be...@gmail.com>.
I did some testing at my home linux install:
I created a repository and imported the squirrelmail source. The svn
and apache that I installed here via emerge are version 1.1.0rc2 and
2.0.51-r1 respectively.
doing:
$ svn ls http://127.0.0.1/svnrep/squirrelmail/trunk
returned the directory listing in a split-second (around 26 files and
dirs). Upon running strace I noticed that on this version, while it
does contain bunches of stat/lstat calls like on the truss dump from
solaris (it was determined that it's a normal thing for apache), it
only contained those blocks for the files that were outputted by svn
ls. In other words, only 26 blocks.
Then I downloaded the apache 2.0.51 tarball from apache.org and the
1.1.0rc4 tarball from the svn site, and built them similarily to how I
have them setup in my solaris server.
Apache was built with:
./configure --prefix=/subversion/local/apache2 \
--exec-prefix=/subversion/local \
--disable-ipv6 \
--enable-shared \
--enable-dav
SVN was build with:
./configure --prefix=/subversion/local \
--with-neon=/usr \
--with-apxs=/subversion/local/bin/apxs \
--with-apr=/subversion/local \
--with-apr-util=/subversion/local \
--includedir=/subversion/local/apache2/include \
--libdir=/subversion/local/lib
And svn ls took about 3 seconds to run! The strace dump shows that
it's checking hundreds of files like on solaris.
However, just to be sure, I wiped the /subversion dir and started
over, only this time with the svn-1.1.0rc2 tarball from the svn site.
Build procedure was exactly the same and svn ls yielded a sub-second
response! The strace dump, just like with the gentoo version showed
that it was checking only the ~26 files present in the svn ls output.
I then wiped the dir again and repeated the whole thing, only with
svn-1.1.0rc3, and it worked like a charm, like rc2.
Then wipe/install rc4, for good measure: bad performance again.
It must be noted as well that the tests yielded the same results using
as client the gentoo rc2 binary or any of the ones I compiled myself.
So, it looks like a regression of some sort happened between rc3 and
rc4. I'll perform these tests tomorrow on the solaris box to
double-check. I'm also attaching gzipped strace logs of both the rc3
and rc4 runs.
Regards,
Ariel
Re: weird performance problem
Posted by Ariel Arjona <be...@gmail.com>.
Sorry about that. That's a typo. I can access the repo fine, and the
svn ls works, but it's awfully slow. Other operations seem to be
unaffected.
On Tue, 28 Sep 2004 10:33:25 -0600, Bruce Elrick <br...@elrick.ca> wrote:
> Ariel Arjona wrote:
>
> >Yeah, svn ls is being run on the right url, and it happens with any
> >url on the repository. The slowness is proportional to how many
> >elements reside in the directory.
> >
> >About apache config, I was wondering about that myself as I'm no
> >apache expert, so I'm attaching my httpd.conf file.
> >
> >UPDATE: forgot to CC the list. Many apologies to Mark who will get
> >this message twice. :(
> >
> >Regards,
> >Ariel
> >
> >
> >On Tue, 28 Sep 2004 11:53:48 -0400, Mark Benedetto King
> ><mb...@lowlatency.com> wrote:
> >
> >
> >>On Tue, Sep 28, 2004 at 10:18:28AM -0500, Ariel Arjona wrote:
> >>
> >>
> >>>I'm attaching a truss trace of httpd. I created a repository with a
> >>>single import, to isolate the problem more. I also turned off all but
> >>>the most essential modules in Apache (which I upgraded to 2.0.51).
> >>>
> >>>Upon doing svn ls http://rep/squirrelmail/trunk I see countless blocks of
> >>>
> >>>
> >>>##############################################
> >>>28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/trunk/plugins/compatibility",
> >>>0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> >>>28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
> >>>28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
> >>>
> >>>
> Your 'svn ls' is using the URL http://rep/ but your httpd.conf is
> configured to present the repository at http://svnrep/.
>
--
~
:wq
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: weird performance problem
Posted by Bruce Elrick <br...@elrick.ca>.
Ariel Arjona wrote:
>Yeah, svn ls is being run on the right url, and it happens with any
>url on the repository. The slowness is proportional to how many
>elements reside in the directory.
>
>About apache config, I was wondering about that myself as I'm no
>apache expert, so I'm attaching my httpd.conf file.
>
>UPDATE: forgot to CC the list. Many apologies to Mark who will get
>this message twice. :(
>
>Regards,
>Ariel
>
>
>On Tue, 28 Sep 2004 11:53:48 -0400, Mark Benedetto King
><mb...@lowlatency.com> wrote:
>
>
>>On Tue, Sep 28, 2004 at 10:18:28AM -0500, Ariel Arjona wrote:
>>
>>
>>>I'm attaching a truss trace of httpd. I created a repository with a
>>>single import, to isolate the problem more. I also turned off all but
>>>the most essential modules in Apache (which I upgraded to 2.0.51).
>>>
>>>Upon doing svn ls http://rep/squirrelmail/trunk I see countless blocks of
>>>
>>>
>>>##############################################
>>>28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/trunk/plugins/compatibility",
>>>0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
>>>28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
>>>28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
>>>
>>>
Your 'svn ls' is using the URL http://rep/ but your httpd.conf is
configured to present the repository at http://svnrep/.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: weird performance problem
Posted by Mark Benedetto King <mb...@lowlatency.com>.
On Tue, Sep 28, 2004 at 05:34:07PM +0100, Philip Martin wrote:
> Ariel Arjona <be...@gmail.com> writes:
>
> > Yeah, svn ls is being run on the right url, and it happens with any
> > url on the repository. The slowness is proportional to how many
> > elements reside in the directory.
>
> It was worse than linear when I measured it last year, see issue 1492.
>
Ariel's strace output shows apache calling stat() on the DAV URIs.
For example:
stat("/subversion/local/apache4/htdocs/svnrep/!svn/ver/21/
squirrelmail/branches/squirrelmail_dev_20040729/func
tions/htmlentities/utf-8.php",...)
That strikes me as Just Plain Wrong. The slowness might not be from
the stat() calls, though.
--ben
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: weird performance problem
Posted by Philip Martin <ph...@codematters.co.uk>.
Ariel Arjona <be...@gmail.com> writes:
> Yeah, svn ls is being run on the right url, and it happens with any
> url on the repository. The slowness is proportional to how many
> elements reside in the directory.
It was worse than linear when I measured it last year, see issue 1492.
--
Philip Martin
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: weird performance problem
Posted by Ariel Arjona <be...@gmail.com>.
Yeah, svn ls is being run on the right url, and it happens with any
url on the repository. The slowness is proportional to how many
elements reside in the directory.
About apache config, I was wondering about that myself as I'm no
apache expert, so I'm attaching my httpd.conf file.
UPDATE: forgot to CC the list. Many apologies to Mark who will get
this message twice. :(
Regards,
Ariel
On Tue, 28 Sep 2004 11:53:48 -0400, Mark Benedetto King
<mb...@lowlatency.com> wrote:
> On Tue, Sep 28, 2004 at 10:18:28AM -0500, Ariel Arjona wrote:
> > I'm attaching a truss trace of httpd. I created a repository with a
> > single import, to isolate the problem more. I also turned off all but
> > the most essential modules in Apache (which I upgraded to 2.0.51).
> >
> > Upon doing svn ls http://rep/squirrelmail/trunk I see countless blocks of
> >
> >
> > ##############################################
> > 28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/trunk/plugins/compatibility",
> > 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> > 28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local/apache2", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local/apache2/htdocs", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local/apache2/htdocs/svnrep",
> > 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> > 28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/branches/squirrelmail_dev_20040729/functions/htmlentities/utf-8.php",
> > 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> > 28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local/apache2", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local/apache2/htdocs", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local/apache2/htdocs/svnrep",
> > 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> > 28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/tags",
> > 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> > 28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local/apache2", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local/apache2/htdocs", 0xFFFFFFFF7FFF7EB0) = 0
> > 28171: lstat("/subversion/local/apache2/htdocs/svnrep",
> > 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> > 28171: stat("/subversion/local/apache2/htdocs/svnrep/!sv
> > #############################
> >
> >
>
> You shouldn't see this sort of thing at all; it's as if mod_dav_svn isn't
> handling the request.
>
> Are you sure you have your httpd configured properly, and that you're
> running "svn ls" on the right URL?
>
> --ben
>
>
--
~
:wq
Re: weird performance problem
Posted by Mark Benedetto King <mb...@lowlatency.com>.
On Tue, Sep 28, 2004 at 10:18:28AM -0500, Ariel Arjona wrote:
> I'm attaching a truss trace of httpd. I created a repository with a
> single import, to isolate the problem more. I also turned off all but
> the most essential modules in Apache (which I upgraded to 2.0.51).
>
> Upon doing svn ls http://rep/squirrelmail/trunk I see countless blocks of
>
>
> ##############################################
> 28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/trunk/plugins/compatibility",
> 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> 28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local/apache2", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local/apache2/htdocs", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local/apache2/htdocs/svnrep",
> 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> 28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/branches/squirrelmail_dev_20040729/functions/htmlentities/utf-8.php",
> 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> 28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local/apache2", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local/apache2/htdocs", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local/apache2/htdocs/svnrep",
> 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> 28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/tags",
> 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> 28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local/apache2", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local/apache2/htdocs", 0xFFFFFFFF7FFF7EB0) = 0
> 28171: lstat("/subversion/local/apache2/htdocs/svnrep",
> 0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
> 28171: stat("/subversion/local/apache2/htdocs/svnrep/!sv
> #############################
>
>
You shouldn't see this sort of thing at all; it's as if mod_dav_svn isn't
handling the request.
Are you sure you have your httpd configured properly, and that you're
running "svn ls" on the right URL?
--ben
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: weird performance problem
Posted by Ariel Arjona <be...@gmail.com>.
I'm attaching a truss trace of httpd. I created a repository with a
single import, to isolate the problem more. I also turned off all but
the most essential modules in Apache (which I upgraded to 2.0.51).
Upon doing svn ls http://rep/squirrelmail/trunk I see countless blocks of
##############################################
28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/trunk/plugins/compatibility",
0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local/apache2", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local/apache2/htdocs", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local/apache2/htdocs/svnrep",
0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/branches/squirrelmail_dev_20040729/functions/htmlentities/utf-8.php",
0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local/apache2", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local/apache2/htdocs", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local/apache2/htdocs/svnrep",
0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
28171: stat("/subversion/local/apache2/htdocs/svnrep/!svn/ver/21/squirrelmail/tags",
0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
28171: lstat("/subversion", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local/apache2", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local/apache2/htdocs", 0xFFFFFFFF7FFF7EB0) = 0
28171: lstat("/subversion/local/apache2/htdocs/svnrep",
0xFFFFFFFF7FFF7EB0) Err#2 ENOENT
28171: stat("/subversion/local/apache2/htdocs/svnrep/!sv
#############################
It seems to be iterating through every file in the rep. When the repos
had /squirrelmail/branches and trags, it iterates through those as
well.
Regards,
Ariel
On Sat, 25 Sep 2004 13:01:07 -0500, Ariel Arjona <be...@gmail.com> wrote:
> Hello,
>
> I'm cc'ing both svndev and tsvndev lists as I'm not sure to which this
> really belongs. I was hoping you guys could help me figure it out.
>
> My setup
> =========
> Server:
> Solaris 8 on SPARC-UE
> svn 1.1.0rc4
> apache 2.0.49
> Everything compiled for 64-bit with -fast -xarch=v9
> Test Repos: have a bdb and a fsfs copy of the same rep. About 120 MB
> in size. 3 modules imported, multiple branches and tags. About 110
> revisions so far. One of the modules is the Squirrelmail source tree,
> which I'll use as an example.
>
> Client:
> Windows 2000 Professional SP4 fully patched
> svn1.1.0rc4 precompiled command line client.
> TortoiseSVN 1.1.0RC2 built against svn 1.1.0rc3 downloaded from the
> tsvn website.
>
> Network:
> Client -> 100 Mbit LAN -> Server
> Client -> 2 Mbit line -> Internet
>
> My problem
> ===========
> My problem basically is that when I'm browsing the repository with
> TSVN's repo browser and I click on the [+] to expand a dir, the more
> subdirs it has, the longer it takes. For example, expanding the
> squirrelmail source tree at the root takes about 35 seconds. Here's a
> list of the tests I've made:
>
> Browsing
> * TSVN browsing my server via http, expanding the squirrelmail trunk. 35 secs.
> * TSVN browsing my server via svn://. Lightning fast, sub-second
> response to all dir expansions.
> * TSVN browsing http://svn.collab.net/repos/svn. Click to expand the
> trunk. 5 secs.
>
> Checkout/Commit/Log
> * All combinations of clients and servers perform very well.
>
> Web performance
> * Browsing the rep with ViewCVS-dev august snapshot has good
> performance. Click on /trunk of the Squirrelmail module and the
> response time is roughly 1-2 seconds if visiting for the first time.
> The Apache install is solely for svn purposes. The tests were
> performed at a time when my server had very little load in general.
>
> The apache logs show the following:
> *** Click to expand the 20040917 folder ***
> 128.11.30.2 - - [25/Sep/2004:11:49:13 -0500] "PROPFIND
> /svnrep/banistmo_lobby/prod/20040917 HTTP/1.1" 207 728
> 128.11.30.2 - - [25/Sep/2004:11:49:13 -0500] "PROPFIND
> /svnrep/!svn/vcc/default HTTP/1.1" 207 396
> 128.11.30.2 - - [25/Sep/2004:11:49:13 -0500] "PROPFIND
> /svnrep/!svn/bln/109 HTTP/1.1" 207 451
> 128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
> /svnrep/banistmo_lobby/prod/20040917 HTTP/1.1" 207 728
> 128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
> /svnrep/!svn/vcc/default HTTP/1.1" 207 451
> 128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
> /svnrep/!svn/bc/109/banistmo_lobby/prod/20040917 HTTP/1.1" 207 740
> 128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
> /svnrep/banistmo_lobby/prod/20040917 HTTP/1.1" 207 728
> 128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
> /svnrep/!svn/vcc/default HTTP/1.1" 207 451
>
> *wait* *wait* *wait* *wait* *wait* *wait* *wait* *wait* *wait*
>
> 128.11.30.2 - - [25/Sep/2004:11:49:14 -0500] "PROPFIND
> /svnrep/!svn/bc/109/banistmo_lobby/prod/20040917 HTTP/1.1" 207 42212
> *** folder expanded ***
>
> So what I need to do is to improve the repo browsing performance onver
> HTTP on my server, to at least match the 5 seconds I get with the svn
> repos over the internet. Using svnserve, unfortunately is not an
> option as we depend on mod_auth_mysql for user validation. How can I
> find out what's slowing the folder expansion down?
>
> Many thanks for any insights on this problem.
>
> Ariel
>
> --
> ~
> :wq
>
--
~
:wq