You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Emmanuel Blot <ma...@gmail.com> on 2005/12/06 17:07:49 UTC
Very long time to set or retrieve a revision property
Hi,
I'm facing an issue with the svn propset/propget command:
I've just created a new repository, which handles less than 100MB of
source files.
There are 3 revisions in this repository:
* 1st contains the base structure (/trunk, /branches, /tags)
* 2nd contains the imported files from a local directory (85MB of
mostly C++ files) into /trunk
* 3rd is a copy of /trunk into a new branch (/branches/test)
There is no issue checking out files from this repository, nor updated
a local copy
I then tagged a revision property onto the 2nd revision of the repository:
svn propset revision:import -r 2 --revprop MYPROP http://server/svn/project
It took about 1 minute to complete this operation, which seems far
longer than expected
Server is on the LAN, and is powered by a PIII/1GHz machine, 368MB
SDRAM, running Debian Linux, Apache 2.0.54 along with Subversion 1.2.3
tools.
Client is either a PIV/3GHz Windows XP SP2 machine with TortoiseSVN,
and the same trouble also occurs from the svn command line on the
server itself.
The problem is that it takes the same time (~ 1 minute) to retrieve
the property, using the command
svn propget revision:import -r 2 --revprop http://server/svn/project
Checking the CPU time on the server, it appears that Apache eats all
the available CPU power
(99.8%) until the command returns (when no svn command is run, the CPU
is hardly used, there is no time-eating background task running on the
server)
I've tried to convert the repository from FSFS to BDB to see if there
is any improvement (using svnadmin dump, svnadmin create --fs-type
bdb, svnadmin load), but the required time to perform either command
(propget, propset or even proplist) is pretty much equivalent.
Something other (useful ?) info:
svn log -r 2 http://server/svn/project # takes 14 seconds
svn propget svn:log --revprop -r 2 http://server/svn/project # takes ~ 1 minute
svn list -R is also very slow.
However, browsing the SVN repository from Apache is really fast, no
issues with this point.
What could go wrong ?
Thanks,
Manu
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Very long time to set or retrieve a revision property
Posted by Emmanuel Blot <ma...@gmail.com>.
Ok, looking at the strace results, the problem seems to be Apache-related:
write(3, "PROPFIND /svn/osdvideo HTTP/1.1\r"..., 300) = 300
write(3, "<?xml version=\"1.0\" encoding=\"ut"..., 300) = 300
select(4, [3], NULL, NULL, {3600, 0}) = 1 (in [3], left {3600, 0})
read(3, "HTTP/1.1 207 Multi-Status\r\nDate:"..., 4096) = 954
write(3, "PROPFIND /svn/osdvideo/!svn/vcc/"..., 300) = 300
write(3, "<?xml version=\"1.0\" encoding=\"ut"..., 82) = 82
select(4, [3], NULL, NULL, {3600, 0}
) = 1 (in [3], left {3536, 653000})
read(3, "HTTP/1.1 207 Multi-Status\r\nDate:"..., 4096) = 1828
"Select" seems to wait for 24 seconds until the server replies with
the actual property value.
Using local access - from a Python script, which read the revision
property file through the fs.svn_fs_revision_prop(fsp, revision,
property, pool) call -, there's no delay at all. There's no delay
either accessing the repository through svnserve.
The webserver shows no trouble but this very one regarding the properties.
Is there any known trouble with Apache2 on this topic ?
Thanks,
Emmanuel.
On 12/17/05, Emmanuel Blot <ma...@gmail.com> wrote:
> > WC-related things going on. Have you tried running an strace on the command?
> > Perhaps that might shed more light on the problem.
>
> No, but I definitely will (on Monday).
> I dumped into the same issue running the Cygwin svn command from a
> remote Windows XP host, but also with the svn command on the same
> machine (Linux) that runs the Apache/SVN server.
>
> Cheers,
> Manu
>
--
Manu
--
Manu
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Very long time to set or retrieve a revision property
Posted by John Szakmeister <jo...@szakmeister.net>.
On Thursday 15 December 2005 11:07, Emmanuel Blot wrote:
> Hi,
>
> Any help on this topic ?
> I do not understand the issue (except it does seem related to the
> number of files tied to a revision), but there's something really
> weird:
>
> It takes about 1 minute to retrieve the property of this revision from
> the command line (svn propget), BUT it takes less than one second to
> retrieve the same property from a Python script using the SWIG
> bindings (fs.svn_fs_revision_prop), using the same client and the same
> server.
>
> Is there any known flaw on this topic with the svn CLI client ?
No, there is no known problem with this. In fact, the python bindings are
going through the exact same interface the client is (at least to fetch the
property). The only thing I could see being the problem might be some extra
WC-related things going on. Have you tried running an strace on the command?
Perhaps that might shed more light on the problem.
-John
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Very long time to set or retrieve a revision property
Posted by Emmanuel Blot <ma...@gmail.com>.
Hi,
Any help on this topic ?
I do not understand the issue (except it does seem related to the
number of files tied to a revision), but there's something really
weird:
It takes about 1 minute to retrieve the property of this revision from
the command line (svn propget), BUT it takes less than one second to
retrieve the same property from a Python script using the SWIG
bindings (fs.svn_fs_revision_prop), using the same client and the same
server.
Is there any known flaw on this topic with the svn CLI client ?
Thanks in advance,
Emmanuel.
On 12/7/05, Emmanuel Blot <ma...@gmail.com> wrote:
> Hi,
>
> Any pointer about this question (I did not find the answer in the ML
> archives, but I'm not sure what to look for)...
>
> > Is the time required to retrieve a revision property depends on the
> > number of files tied to this revision ? (with either FSFS and BDB
> > backends)
>
> Thanks
> Manu
>
--
Manu
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Very long time to set or retrieve a revision property
Posted by Emmanuel Blot <ma...@gmail.com>.
Hi,
Any pointer about this question (I did not find the answer in the ML
archives, but I'm not sure what to look for)...
> Is the time required to retrieve a revision property depends on the
> number of files tied to this revision ? (with either FSFS and BDB
> backends)
Thanks
Manu
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Very long time to set or retrieve a revision property
Posted by Emmanuel Blot <ma...@gmail.com>.
> Something other (useful ?) info:
The trouble mostly occurs on revision 2: on other revs, time to
retrieve the property seems normal (1 second or so). Revision 2 is the
one that add the existing files to the repository (about 3800 files).
Is the time required to retrieve a revision property depends on the
number of files tied to this revision ? (with either FSFS and BDB
backends)
Thanks,
Manu
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org