Speed during import - locating the bottleneck

[DJ...@gauselmann.de]

Hi,

I've noticed that the import of projects seems to be very very slow. The
initial import of an 100 MB Binary file lasts about 5 Minutes -> 20 MB per
Minute.

Now I would like to locate the bottleneck. Any ideas howto locate this. I
don'nt want to setup several servers...

ciao
Detlef Jockheck
--
##########################
# adp Gauselmann GmbH
# IT-Support
# Detlef Jockheck
# djockheck@gauselmann.de
##########################


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Speed during import - locating the bottleneck

["Ronny T. Lampert" <te...@uni.de>]

Hi,

 > I've noticed that the import of projects seems to be very very slow. The
 > initial import of an 100 MB Binary file lasts about 5 Minutes -> 20 MB per
 > Minute.

Try setting

set_flags DB_TXN_NOSYNC

in $REPOS/db/DB_CONFIG

# Disable fsync of log files on transaction commit. Read the
# documentation about DB_TXN_NOSYNC at:
# http://www.sleepycat.com/docs/api_c/env_set_flags.html

I don't know if the sync is per file, but working with ~250MB Sources and 
20.000 files imports, this greatly improved performance.

Beware that this may harm data integrity when using non-server hardware 
(secured thru UPS, ...)

Greetings,
Ronny

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Speed during import - locating the bottleneck

[Ben Collins-Sussman <su...@collab.net>]

On Mar 9, 2005, at 5:40 AM, DJockheck@gauselmann.de wrote:

> Hi,
>
> I've noticed that the import of projects seems to be very very slow. 
> The
> initial import of an 100 MB Binary file lasts about 5 Minutes -> 20 MB 
> per
> Minute.
>
> Now I would like to locate the bottleneck. Any ideas howto locate 
> this. I
> don'nt want to setup several servers...
>

The svn client unconditionally sends binary diffs to the server, even 
when adding new files.  So you're not seeing a pure file transfer here; 
  it's taking longer for the client to compress the data and the server 
to uncompress.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org