You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Bob Archer <bo...@amsi.com> on 2009/04/19 01:51:38 UTC

How long do your svn dumps take

Hi All...

 

I am upgrading from 1.5.5 to 1.6.1 today. Up to this point I have only
been using svnadmin update. But, I decided it was time to do a dump/load
as many have recommended.

 

But, dumping one of our repo took about 5 hours. This is a 20GB repo. Is
this normal. I see in the book it talks about doing a nightly dump so
you can back up. Do people really run dumps that take 4+ hours?

 

I can't see what I am doing working. It is a pretty simple command. I
have the repository folder and the folder I am dumping to excluded from
McAfree on-demand scans.

 

Also, this isn't a slouch server. It is a 3.0Ghz dual core Xenon 5160
with 4GB of ram and raid 5 scsi raid 5.

 

Currently it is loading and has been running for almost 4 hours and is
on about rev 10k of about 32k.

 

Are these typical dump/load time.

 

BOb

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1800037

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].

RE: Re: How long do your svn dumps take

Posted by Bob Archer <bo...@amsi.com>.
> I have done SVN server setups on multiple machines (in-house and also
> at customers sites) and also get dump speeds around 5GB/h. All of those
> server (Xeon 5xxx, 4-16GB RAM) are running Linux, ext3 on hardware RAID
> 1 resp. RAID 5 and use FSFS as Subversion database format. So your
> dump times are in the range that I would expect.

Hmm... that does sound similar times. I am using a Windows 2003 server with NTFS. I just didn't expect it to take this long. People talk about it on the list like it is such a routine thing... and my 20GB repo seems small compared to some of the numbers I have seen here. 

> > Currently it is loading and has been running for almost 4 hours and is 
> > on about rev 10k of about 32k.
> 
> Yes, loading is much slower than dumping.

Yes, no doubt. It is still loading now. Over 13hours at this point and it still have about 4000 revs to go.

I am glad I started this yesterday at noon and didn't put it off till today.

Thanks for your reply.

BOb

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1808519

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].

Re: How long do your svn dumps take

Posted by Stephen Connolly <st...@gmail.com>.
What I find is even better is to do the dump/load across a network to
a different server... as it saves trashing the disks... alternatively
dump/load across disks is better...

I tend to favour dump/load via pipe rather than dump to file load from file...

And perhaps the best yet is to do the dump-load via svnsync... that
way people can continue to use the older repo until you're ready to
cut across as svnsync will let you do things incrementally

(Although dump can be incremental too, so you can achieve the same via
dump-load as long as you are careful about tracking revisions...
svnsync will track the revisions for you)

Our largest repo is about 20GB, and that took 24 hours to load from
dump file but our backing file system is on a DRBD backed file system
(to give us a HA subversion server)

-Stephen

2009/4/19 Andreas Schweigstill <an...@schweigstill.de>:
> Hallo!
>
> Bob Archer schrieb:
>> But, dumping one of our repo took about 5 hours. This is a 20GB repo.
>
> I have done SVN server setups on multiple machines (in-house and also
> at customers sites) and also get dump speeds around 5GB/h. All of those
> server (Xeon 5xxx, 4-16GB RAM) are running Linux, ext3 on hardware RAID
> 1 resp. RAID 5 and use FSFS as Subversion database format. So your
> dump times are in the range that I would expect.
>
>> Currently it is loading and has been running for almost 4 hours and is
>> on about rev 10k of about 32k.
>
> Yes, loading is much slower than dumping.
>
> Regards
> Andreas Schweigstill
>
> --
> BITTE BEACHTEN SIE UNSERE NEUE TELEFONNUMMER!
>
> Dipl.-Phys. Andreas Schweigstill
> Schweigstill IT | Embedded Systems
> Schauenburgerstraße 116, D-24118 Kiel, Germany
> Phone: (+49) 431 53035-435, Fax: (+49) 431 53035-436
> Mobile: (+49) 171 6921973, Web: http://www.schweigstill.de/
>
> ------------------------------------------------------
> http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1804475
>
> To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].
>

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1805767

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].


Re: How long do your svn dumps take

Posted by Andreas Schweigstill <an...@schweigstill.de>.
Hallo!

Bob Archer schrieb:
> But, dumping one of our repo took about 5 hours. This is a 20GB repo.

I have done SVN server setups on multiple machines (in-house and also
at customers sites) and also get dump speeds around 5GB/h. All of those
server (Xeon 5xxx, 4-16GB RAM) are running Linux, ext3 on hardware RAID
1 resp. RAID 5 and use FSFS as Subversion database format. So your
dump times are in the range that I would expect.

> Currently it is loading and has been running for almost 4 hours and is 
> on about rev 10k of about 32k.

Yes, loading is much slower than dumping.

Regards
Andreas Schweigstill

-- 
BITTE BEACHTEN SIE UNSERE NEUE TELEFONNUMMER!

Dipl.-Phys. Andreas Schweigstill
Schweigstill IT | Embedded Systems
Schauenburgerstraße 116, D-24118 Kiel, Germany
Phone: (+49) 431 53035-435, Fax: (+49) 431 53035-436
Mobile: (+49) 171 6921973, Web: http://www.schweigstill.de/

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1804475

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].


Re: How long do your svn dumps take

Posted by "Hyrum K. Wright" <hy...@mail.utexas.edu>.
On Apr 19, 2009, at 10:23 AM, Bob Archer wrote:
>
> Thanks for your help. If I knew it would take this long I would have
> just done and svnadmin upgrade and lived with the extra 10% of disk
> space that wouldn't save me.

Don't forget to run 'svnadmin pack' after the load.  Packing has to be  
performed explicitly, but it should also save some disk space.

-Hyrum

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1815708

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].

RE: How long do your svn dumps take

Posted by Bob Archer <bo...@amsi.com>.
> On Sat, Apr 18, 2009 at 09:51:38PM -0400, Bob Archer wrote:
> >    I am upgrading from 1.5.5 to 1.6.1 today. Up to this point I have
> only
> >    been using svnadmin update. But, I decided it was time to do a
> >    dump/load as many have recommended.
> >
> >
> >    But, dumping one of our repo took about 5 hours. This is a 20GB
repo.
> >    Is this normal. I see in the book it talks about doing a nightly
dump
> >    so you can back up. Do people really run dumps that take 4+
hours?
> 
> I believe there may be problem, but we need some more data.
> 
> What would really help is a run of svnadmin dump in a profiler so we
can
> see where it spends so much time. If you compile your own builds
> you can do that fairly easily. On *nix, just add -pg to CFLAGS:
>
> I don't know what the equivalent on Windows is but maybe someone else
can
> comment on that if necessary.

Yes, I am running on a Windows 2003 server. I just use the collabnet
binaries. What would be the procedure there?

> If you can even provide profiles for full / incremental dumps for
several
> versions (e.g. 1.4, 1.5, and 1.6), we have a good chance to see when
the
> problem was introduced, if it has not been there all along -- which
would
> surprise me because people would probably have complained about it
before.
> 
> But a profiled run of a full and incremental dump with 1.6 or trunk
would
> be the best place to start.

What I did was dump with 1.5.5 since that was the version I had
installed. Should I be upgrading first and dumping the old repo with the
most recent version? I was sure about that. 

BTW: The load is still running. Been about 13hours at this point... It
looks like it is on about rev 28k or so.

Thanks for your help. If I knew it would take this long I would have
just done and svnadmin upgrade and lived with the extra 10% of disk
space that wouldn't save me.

BOb

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1808411

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].


RE: svnadmin dump/load patch, please test (was: Re: How long do yoursvn dumps take)

Posted by Bob Archer <bo...@amsi.com>.
If anyone is willing to send me a patched windows binary of 1.6.1 I
would love to try this patch out.

BOb


> -----Original Message-----
> From: Stefan Sperling [mailto:stsp@elego.de]
> Sent: Tuesday, April 21, 2009 1:29 PM
> To: Bob Archer
> Cc: kmradke@rockwellcollins.com; users@subversion.tigris.org
> Subject: svnadmin dump/load patch, please test (was: Re: How long do
> yoursvn dumps take)
> 
> On Mon, Apr 20, 2009 at 02:39:15PM -0400, Bob Archer wrote:
> > > > Once other datapoint for me. Our repository has a lot of binary
> > files in
> > > > it (VB6 dlls). I wonder if that could have something to do with
it
> > also.
> > >
> > > Could be. But we can only make blind guesses unless we gather some
> > > profiler output. It would be greatly appreciated.
> >
> > As soon as someone can give me some direction on how to do this on
> > Windows... I would be happy to run it again to get a profile.
> 
> Kevin sent me output of a profiled run of svnadmin load.
> 
> Greg Stein and I discovered that we don't do any buffering when
> reading from stdin and writing to stdout.
> 
> Attached is a patch against the 1.6.x branch, and should enable
> buffered reads/writes for APR versions >= 1.3.0 during svnadmin
> dump and svnadmin load.
> 
> If you have APR >= 1.3.0 in your environment, please test this
> patch and let us know if you see an increase in performance.
> 
> Once this has been confirmed to increase performance, we can
> implement our own buffering so that people running APR < 1.3.0
> can also benefit.
> 
> Thanks,
> Stefan

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1846403

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].


Re: svnadmin dump/load patch, please test (was: Re: How long do your svn dumps take)

Posted by Stefan Sperling <st...@elego.de>.
On Tue, Apr 21, 2009 at 06:28:42PM +0100, Stefan Sperling wrote:
> On Mon, Apr 20, 2009 at 02:39:15PM -0400, Bob Archer wrote:
> > > > Once other datapoint for me. Our repository has a lot of binary
> > files in
> > > > it (VB6 dlls). I wonder if that could have something to do with it
> > also.
> > > 
> > > Could be. But we can only make blind guesses unless we gather some
> > > profiler output. It would be greatly appreciated.
> > 
> > As soon as someone can give me some direction on how to do this on
> > Windows... I would be happy to run it again to get a profile. 
> 
> Kevin sent me output of a profiled run of svnadmin load.
> 
> Greg Stein and I discovered that we don't do any buffering when
> reading from stdin and writing to stdout.
> 
> Attached is a patch against the 1.6.x branch, and should enable
> buffered reads/writes for APR versions >= 1.3.0 during svnadmin
> dump and svnadmin load.
> 
> If you have APR >= 1.3.0 in your environment, please test this
> patch and let us know if you see an increase in performance.

I've tested my patch now on a copy of Subversion's own repository,
up to r8385. The result is disappointing, the patch does not make
any difference at all :(
Dumping and loading the repository takes around 15 minutes on my
laptop with and without the patch.

So it looks like we're back to square one.

Stefan

svnadmin dump/load patch, please test (was: Re: How long do your svn dumps take)

Posted by Stefan Sperling <st...@elego.de>.
On Mon, Apr 20, 2009 at 02:39:15PM -0400, Bob Archer wrote:
> > > Once other datapoint for me. Our repository has a lot of binary
> files in
> > > it (VB6 dlls). I wonder if that could have something to do with it
> also.
> > 
> > Could be. But we can only make blind guesses unless we gather some
> > profiler output. It would be greatly appreciated.
> 
> As soon as someone can give me some direction on how to do this on
> Windows... I would be happy to run it again to get a profile. 

Kevin sent me output of a profiled run of svnadmin load.

Greg Stein and I discovered that we don't do any buffering when
reading from stdin and writing to stdout.

Attached is a patch against the 1.6.x branch, and should enable
buffered reads/writes for APR versions >= 1.3.0 during svnadmin
dump and svnadmin load.

If you have APR >= 1.3.0 in your environment, please test this
patch and let us know if you see an increase in performance.

Once this has been confirmed to increase performance, we can
implement our own buffering so that people running APR < 1.3.0 
can also benefit.

Thanks,
Stefan

RE: How long do your svn dumps take

Posted by Bob Archer <bo...@amsi.com>.
> > Once other datapoint for me. Our repository has a lot of binary
files in
> > it (VB6 dlls). I wonder if that could have something to do with it
also.
> 
> Could be. But we can only make blind guesses unless we gather some
> profiler output. It would be greatly appreciated.

As soon as someone can give me some direction on how to do this on
Windows... I would be happy to run it again to get a profile. 


> I do also have access to large repositories, but should rather be
> working on college stuff right now, as tempting as it may be :(
> 
> Stefan

Yes, I understand priorities. No worries.

BOb

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1828548

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].


Re: How long do your svn dumps take

Posted by Stefan Sperling <st...@elego.de>.
On Mon, Apr 20, 2009 at 12:11:32PM -0400, Bob Archer wrote:
> > > I have been told by a user of an svnadmin dump that took 9+ hours.
> > > I have been meaning to reproduce the problem but did not have the
> time.
> > > (No pun intended! :)
> 
> 
> > Just a random datapoint, but the number of directories in one
> directory
> > seems to really affect svnadmin verify performance.  (Essentially just
> > a dump followed by a load...)  We have a fairly small repo (3G) that
> has
> > 8000 directories inside a top level directory.  A verify takes over 40
> > hours now.  It seems to get really bad after a couple thousand dirs.
> We
> > have a 160G repo with twice the number of files and revisions that
> > takes <2 hours on the same server.  All FSFS using Subversion 1.5.
> 
> Once other datapoint for me. Our repository has a lot of binary files in
> it (VB6 dlls). I wonder if that could have something to do with it also.

Could be. But we can only make blind guesses unless we gather some
profiler output. It would be greatly appreciated.

I do also have access to large repositories, but should rather be
working on college stuff right now, as tempting as it may be :(

Stefan

RE: How long do your svn dumps take

Posted by Bob Archer <bo...@amsi.com>.
> > I have been told by a user of an svnadmin dump that took 9+ hours.
> > I have been meaning to reproduce the problem but did not have the
time.
> > (No pun intended! :)


> Just a random datapoint, but the number of directories in one
directory
> seems to really affect svnadmin verify performance.  (Essentially just
> a dump followed by a load...)  We have a fairly small repo (3G) that
has
> 8000 directories inside a top level directory.  A verify takes over 40
> hours now.  It seems to get really bad after a couple thousand dirs.
We
> have a 160G repo with twice the number of files and revisions that
> takes <2 hours on the same server.  All FSFS using Subversion 1.5.

Once other datapoint for me. Our repository has a lot of binary files in
it (VB6 dlls). I wonder if that could have something to do with it also.

BOb

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1827068

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].


RE: svnadmin verify performance issue (was: Re: How long do your svn dumps take)

Posted by km...@rockwellcollins.com.
"Bert Huijben" <be...@qqmail.nl> wrote on 04/22/2009 10:51:19 AM:
> > The repository has a directory with almost 8000 subdirectories at one
> > level.  This was an investigation to see why svnadmin verify is
> > taking over 40 hours to verify the 3GB repo...
> 
> The report doesn't show any disk io. Is this only the CPU time spend 
inside
> the process?
> 
> Can you add a column to the report that presents actual time spend in 
the
> methods and the methods it calls?
> 
> 
> It could be the case that we don't do more than reading all the data 
(Which
> I'm sure we do) and a tiny bit of processing.. In that case optimizing 
the
> processing wouldn't help us at all.

I'm by no means a gprof expert, but I'll be happy add any options gprof
parameters that are identified as useful.  I can tell you that 1 of the 4 
CPUs
on the server was at 100% for the 7 minutes of the test.  As far as
disk I/O, the server is connected to a high-end SAN via multiple fiber
channels, and since it is our failover hardware, it wasn't doing
much else at the time.

Kevin R.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=1862424

RE: svnadmin verify performance issue (was: Re: How long do your svn dumps take)

Posted by Bert Huijben <rh...@sharpsvn.net>.
> -----Original Message-----
> From: kmradke@rockwellcollins.com [mailto:kmradke@rockwellcollins.com]
> Sent: woensdag 22 april 2009 17:44
> To: Bert Huijben
> Cc: dev@subversion.tigris.org; 'Stefan Sperling'
> Subject: RE: svnadmin verify performance issue (was: Re: How long do your
svn
> dumps take)
> 
> Bert Huijben <rh...@sharpsvn.net> wrote on 04/22/2009 10:32:00 AM:
> > > > granularity: each sample hit covers 4 byte(s) for 0.00% of 296.19
> > seconds
> > > >
> > > >                                   called/total       parents
> > > > index  %time    self descendents  called+self    name       index
> > > >                                   called/total       children
> > > >
> > > >                                                      <spontaneous>
> > > > [1]     26.2   77.59        0.00                 apr_hash_next [1]
> >
> > Are you sure your debug symbols are ok. I would be very, very surprised
> if
> > this function would take 26% of your time:
> 
> I just rebuilt svn 1.6.1 from scratch with "-pg" and ran gprof on
> the resultant gmon.out file...  Haven't profiled anything on
> Solaris 10 x86 before, but have no reason to believe it isn't working.
> 
> > APR_DECLARE(apr_hash_index_t *) apr_hash_next(apr_hash_index_t *hi)
> > {
> >     hi->this = hi->next;
> >     while (!hi->this) {
> >         if (hi->index > hi->ht->max)
> >             return NULL;
> >
> >         hi->this = hi->ht->array[hi->index++];
> >     }
> >     hi->next = hi->this->next;
> >     return hi;
> > }
> >
> > Unless you have an application containing an insane large hashtable,
> > containing nothing.. and doing nothing with the keys.
> 
> The repository has a directory with almost 8000 subdirectories at one
> level.  This was an investigation to see why svnadmin verify is
> taking over 40 hours to verify the 3GB repo...

The report doesn't show any disk io. Is this only the CPU time spend inside
the process?

Can you add a column to the report that presents actual time spend in the
methods and the methods it calls?


It could be the case that we don't do more than reading all the data (Which
I'm sure we do) and a tiny bit of processing.. In that case optimizing the
processing wouldn't help us at all.

	Bert

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=1862218

RE: svnadmin verify performance issue (was: Re: How long do your svn dumps take)

Posted by km...@rockwellcollins.com.
Bert Huijben <rh...@sharpsvn.net> wrote on 04/22/2009 10:32:00 AM:
> > > granularity: each sample hit covers 4 byte(s) for 0.00% of 296.19
> seconds
> > >
> > >                                   called/total       parents
> > > index  %time    self descendents  called+self    name       index
> > >                                   called/total       children
> > >
> > >                                                      <spontaneous>
> > > [1]     26.2   77.59        0.00                 apr_hash_next [1]
> 
> Are you sure your debug symbols are ok. I would be very, very surprised 
if
> this function would take 26% of your time:

I just rebuilt svn 1.6.1 from scratch with "-pg" and ran gprof on
the resultant gmon.out file...  Haven't profiled anything on
Solaris 10 x86 before, but have no reason to believe it isn't working.

> APR_DECLARE(apr_hash_index_t *) apr_hash_next(apr_hash_index_t *hi)
> {
>     hi->this = hi->next;
>     while (!hi->this) {
>         if (hi->index > hi->ht->max)
>             return NULL;
> 
>         hi->this = hi->ht->array[hi->index++];
>     }
>     hi->next = hi->this->next;
>     return hi;
> }
> 
> Unless you have an application containing an insane large hashtable,
> containing nothing.. and doing nothing with the keys. 

The repository has a directory with almost 8000 subdirectories at one
level.  This was an investigation to see why svnadmin verify is
taking over 40 hours to verify the 3GB repo...

Kevin R.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=1862151

RE: svnadmin verify performance issue (was: Re: How long do your svn dumps take)

Posted by Bert Huijben <rh...@sharpsvn.net>.
> -----Original Message-----
> From: Stefan Sperling [mailto:stsp@elego.de]
> Sent: woensdag 22 april 2009 16:56
> To: kmradke@rockwellcollins.com
> Cc: dev@subversion.tigris.org
> Subject: svnadmin verify performance issue (was: Re: How long do your svn
> dumps take)
> 

> >
> > granularity: each sample hit covers 4 byte(s) for 0.00% of 296.19
seconds
> >
> >                                   called/total       parents
> > index  %time    self descendents  called+self    name    	index
> >                                   called/total       children
> >
> >                                                      <spontaneous>
> > [1]     26.2   77.59        0.00                 apr_hash_next [1]

Are you sure your debug symbols are ok. I would be very, very surprised if
this function would take 26% of your time:

APR_DECLARE(apr_hash_index_t *) apr_hash_next(apr_hash_index_t *hi)
{
    hi->this = hi->next;
    while (!hi->this) {
        if (hi->index > hi->ht->max)
            return NULL;

        hi->this = hi->ht->array[hi->index++];
    }
    hi->next = hi->this->next;
    return hi;
}

Unless you have an application containing an insane large hashtable,
containing nothing.. and doing nothing with the keys. 

	Bert

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=1862070

svnadmin verify performance issue (was: Re: How long do your svn dumps take)

Posted by Stefan Sperling <st...@elego.de>.
On Wed, Apr 22, 2009 at 08:34:13AM -0500, kmradke@rockwellcollins.com wrote:
> Stefan,
>
> Attached is a gprof run from doing an "svnadmin verify -r 11280:11300" of
> my 3GB test repository
> that has ~7500 sub directories inside a top level directory.  Verifying
> those randomly selected
> 21 revisions took around 7 minutes.  (I finally killed the full verify,
> since it was going to take a
> couple more days.)  It seems like the verify really slows down after the
> couple thousand
> subdirectory mark.

Thanks Kevin. I took the liberty to Cc dev@ because this should be
of interest to all developers, and in your last mail you said sharing
profile runs was fine.


It looks like we keep allocating and deallocating a hash table for
each directory we open. For each entry in the directory, we add a
corresponding entry to the freshly allocated hash table.

The culprit is this API:

  /** Set @a *entries_p to a newly allocated APR hash table containing the
   * entries of the directory at @a path in @a root.  The keys of the table
   * are entry names, as byte strings, excluding the final NULL
   * character; the table's values are pointers to @c svn_fs_dirent_t
   * structures.  Allocate the table and its contents in @a pool.
   */
  svn_error_t *
  svn_fs_dir_entries(apr_hash_t **entries_p,
                     svn_fs_root_t *root,
                     const char *path,
                     apr_pool_t *pool);

I'd imagine that doing this for large directories means that we deallocate
large amounts of memory whenever we are done with a directory, or more
precisely whenever the pool the hash table resides in is cleared.

And then we allocate another hash table, and keep filling it with
directory entries from another large directory, so that it grows
until we deallocate it again.

It does not surprise me that this causes performance problems.
It may well be that memory gets fragmented up to point where allocations
end up taking more and more time. I can imagine that certain operating
systems *cough* Windows *cough* don't deal with this kind of application
behaviour very efficiently.

This would also explain why performance drops sharply after a few
thousand directories have been processed.

Now, depending on directory size, the hash table might always need to
ask the OS for more memory while it is being used. But we should
investigate whether there is some way to decrease the number of
allocations and deallocations we are doing.

If I am correct in my assumptions above, this will need some API redesign.

We'd need to change things so that we allocate a hash table once,
and then pass it down for use by implementations of svn_fs_dir_entries(),
so they can store information about directory entries in that one hash,
instead of having to allocate a fresh one. When done, we clear the hash
table instead of deallocating it, and reuse it for the next directory.

I have not looked at the APR hash table implementation, but I'd imagine
that using apr_hash_clear() is much cheaper than allocating a new hash
table and deallocating the old one.

This is not a simple one-line change. It may affect a few corners of
libsvn_fs*, I haven't looked in detail. We'll need to rev public API,
also.

Comments? Any filesystem hackers who wanna take a shot at fixing this?

> I'll now rebuild with apr 1.3 to test your previous patch for buffered
> I/O...
>
> Kevin R.
>

Thanks for your effort Kevin!

Stefan

(Quoting the profile run below so others can see it.)

> /*
>  * Copyright (c) 1993 by Sun Microsystems, Inc.
>  */
>
> #pragma ident	"@(#)gprof.callg.blurb	1.8	93/06/07 SMI"
>
>
> call graph profile:
>           The sum of self and descendents is the major sort
>           for this listing.
>
>           function entries:
>
> index     the index of the function in the call graph
>           listing, as an aid to locating it (see below).
>
> %time     the percentage of the total time of the program
>           accounted for by this function and its
>           descendents.
>
> self      the number of seconds spent in this function
>           itself.
>
> descendents
>           the number of seconds spent in the descendents of
>           this function on behalf of this function.
>
> called    the number of times this function is called (other
>           than recursive calls).
>
> self      the number of times this function calls itself
>           recursively.
>
> name      the name of the function, with an indication of
>           its membership in a cycle, if any.
>
> index     the index of the function in the call graph
>           listing, as an aid to locating it.
>
>
>
>           parent listings:
>
> self*     the number of seconds of this function's self time
>           which is due to calls from this parent.
>
> descendents*
>           the number of seconds of this function's
>           descendent time which is due to calls from this
>           parent.
>
> called**  the number of times this function is called by
>           this parent.  This is the numerator of the
>           fraction which divides up the function's time to
>           its parents.
>
> total*    the number of times this function was called by
>           all of its parents.  This is the denominator of
>           the propagation fraction.
>
> parents   the name of this parent, with an indication of the
>           parent's membership in a cycle, if any.
>
> index     the index of this parent in the call graph
>           listing, as an aid in locating it.
>
>
>
>           children listings:
>
> self*     the number of seconds of this child's self time
>           which is due to being called by this function.
>
> descendent*
>           the number of seconds of this child's descendent's
>           time which is due to being called by this
>           function.
>
> called**  the number of times this child is called by this
>           function.  This is the numerator of the
>           propagation fraction for this child.
>
> total*    the number of times this child is called by all
>           functions.  This is the denominator of the
>           propagation fraction.
>
> children  the name of this child, and an indication of its
>           membership in a cycle, if any.
>
> index     the index of this child in the call graph listing,
>           as an aid to locating it.
>
>
>
>           * these fields are omitted for parents (or
>           children) in the same cycle as the function.  If
>           the function (or child) is a member of a cycle,
>           the propagated times and propagation denominator
>           represent the self time and descendent time of the
>           cycle as a whole.
>
>           ** static-only parents and children are indicated
>           by a call count of 0.
>
>
>
>           cycle listings:
>           the cycle as a whole is listed with the same
>           fields as a function entry.  Below it are listed
>           the members of the cycle, and their contributions
>           to the time and call counts of the cycle.
> 
>
> granularity: each sample hit covers 4 byte(s) for 0.00% of 296.19 seconds
>
>                                   called/total       parents
> index  %time    self descendents  called+self    name    	index
>                                   called/total       children
>
>                                                      <spontaneous>
> [1]     26.2   77.59        0.00                 apr_hash_next [1]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [2]     14.9   44.27        0.00                 apr_hashfunc_default [2]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [3]     11.6   34.31        0.00                 apr_hash_set [3]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [4]     11.3   33.44        0.00                 apr_palloc [4]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [5]     11.1    0.00       32.89                 .L554 [5]
>                 0.00       32.89       1/1           subcommand_verify [6]
>                 0.00        0.00       1/1           parse_local_repos_path [227]
>                 0.00        0.00       1/1           svn_opt_subcommand_takes_option3 [330]
>                 0.00        0.00       1/1           svn_opt_get_canonical_subcommand2 [328]
>                 0.00        0.00       1/1           svn_cmdline_fflush [323]
>
> -----------------------------------------------
>
>                 0.00       32.89       1/1           .L554 [5]
> [6]     11.1    0.00       32.89       1         subcommand_verify [6]
>                 0.00       32.85       1/1           svn_repos_verify_fs [7]
>                 0.00        0.04       2/2           svn_repos_open [94]
>                 0.00        0.00       1/2           svn_fs_youngest_rev [209]
>                 0.00        0.00       1/282268      svn_stream_create [117]
>                 0.00        0.00       3/4           svn_repos_fs [296]
>                 0.00        0.00       2/2           svn_fs_set_warning_func [309]
>                 0.00        0.00       2/2           get_revnum [305]
>                 0.00        0.00       1/150515      svn_pool_create_ex [248]
>                 0.00        0.00       1/277462      svn_stream_set_write [241]
>
> -----------------------------------------------
>
>                 0.00       32.85       1/1           subcommand_verify [6]
> [7]     11.1    0.00       32.85       1         svn_repos_verify_fs [7]
>                 0.00       32.85      21/21          svn_repos_replay2 [8]
>                 0.00        0.00      42/42          svn_fs_revision_root [159]
>                 0.00        0.00      21/21          svn_stream_empty [210]
>                 0.00        0.00       1/2           svn_fs_youngest_rev [209]
>                 0.00        0.00      21/260         svn_stream_printf [188]
>                 0.00        0.00      21/42          svn_delta_default_editor [262]
>                 0.00        0.00      21/21          svn_delta_get_cancellation_editor [280]
>                 0.00        0.00       1/4           svn_repos_fs [296]
>                 0.00        0.00       1/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00       32.85      21/21          svn_repos_verify_fs [7]
> [8]     11.1    0.00       32.85      21         svn_repos_replay2 [8]
>                 0.00       32.85      21/21          svn_delta_path_driver [9]
>                 0.00        0.00      21/21          svn_fs_paths_changed2 [168]
>                 0.00        0.00      21/21          svn_fs_is_revision_root [281]
>                 0.00        0.00      21/21          svn_fs_revision_root_revision [282]
>                 0.00        0.00      21/21          set_target_revision [278]
>
> -----------------------------------------------
>
>                 0.00       32.85      21/21          svn_repos_replay2 [8]
> [9]     11.1    0.00       32.85      21         svn_delta_path_driver [9]
>                 0.00       32.83      84/84          close_directory [10]
>                 0.00        0.02      34/34          path_driver_cb_func [119]
>                 0.00        0.00      21/21          svn_path_is_empty [189]
>                 0.00        0.00      52/52          open_directory [191]
>                 0.00        0.00      34/34          svn_path_split [193]
>                 0.00        0.00      21/21          open_root [204]
>                 0.00        0.00     128/150515      svn_pool_create_ex [248]
>                 0.00        0.00      13/13          svn_path_get_longest_ancestor [283]
>
> -----------------------------------------------
>
>                 0.00       32.83      84/84          svn_delta_path_driver [9]
> [10]    11.1    0.00       32.83      84         close_directory [10]
>                 0.00       32.83      84/84          verify_close_directory [11]
>                 0.00        0.00      84/281         check_cancel [255]
>
> -----------------------------------------------
>
>                 0.00       32.83      84/84          close_directory [10]
> [11]    11.1    0.00       32.83      84         verify_close_directory [11]
>                 0.01       32.81      84/84          svn_iter_apr_hash [12]
>                 0.00        0.01      84/138659      svn_fs_dir_entries [21]
>                 0.00        0.00      84/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.01       32.81      84/84          verify_close_directory [11]
> [12]    11.1    0.01       32.81      84         svn_iter_apr_hash [12]
>                 0.02       32.79  138661/138661      verify_directory_entry [13]
>                 0.00        0.00      84/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.02       32.79  138661/138661      svn_iter_apr_hash [12]
> [13]    11.1    0.02       32.79  138661         verify_directory_entry [13]
>                 0.00       17.16  138575/138659      svn_fs_dir_entries [21]
>                 0.00       15.60  138661/138661      svn_fs_check_path [23]
>                 0.00        0.02  138661/836751      svn_path_join [75]
>                 0.00        0.01      86/109         svn_fs_file_length [129]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/277555      fs_file_contents [160]
>                 0.00        0.00      34/277555      fs_node_proplist [153]
>                 0.00        0.01      69/277555      fs_file_checksum [151]
>                 0.00        0.01     109/277555      fs_file_length [128]
>                 0.00       13.00  138659/277555      fs_dir_entries [20]
>                 0.00       13.00  138661/277555      svn_fs_fs__check_path [24]
> [14]     8.8    0.01       26.03  277555         get_dag [14]
>                 0.13       18.58  138630/138630      open_path [19]
>                 0.01        7.26  277555/970683      svn_cache__get [17]
>                 0.05        0.00  277555/416185      svn_fs__canonicalize_abspath [83]
>                 0.00        0.00  138925/416030      svn_fs_fs__dag_set_fs [238]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [15]     8.7   25.91        0.00                 internal_mcount [15]
>
> -----------------------------------------------
>
>                 0.39        0.23    6674/277320      inprocess_cache_set [44]
>                15.68        9.52  270646/277320      inprocess_cache_get [18]
> [16]     8.7   16.07        9.75  277320         dup_dir_listing [16]
>                 9.75        0.00 914702173/917256572     svn_fs_fs__id_copy [26]
>
> -----------------------------------------------
>
>                 0.00        0.00      42/970683      svn_fs_fs__rev_get_root [164]
>                 0.01        7.26  277320/970683      svn_fs_fs__rep_contents_dir [28]
>                 0.01        7.26  277555/970683      get_dag [14]
>                 0.01       10.88  415766/970683      open_path [19]
> [17]     8.6    0.03       25.40  970683         svn_cache__get [17]
>                 0.06       25.34  970683/970683      inprocess_cache_get [18]
>
> -----------------------------------------------
>
>                 0.06       25.34  970683/970683      svn_cache__get [17]
> [18]     8.6    0.06       25.34  970683         inprocess_cache_get [18]
>                15.68        9.52  270646/277320      dup_dir_listing [16]
>                 0.01        0.13  416030/554691      svn_fs_fs__dag_dup_for_cache [66]
>                 0.00        0.00      21/42          dup_id [222]
>
> -----------------------------------------------
>
>                 0.13       18.58  138630/138630      get_dag [14]
> [19]     6.3    0.13       18.58  138630         open_path [19]
>                 0.01       10.88  415766/970683      svn_cache__get [17]
>                 0.03        6.78  138661/138661      svn_fs_fs__dag_open [29]
>                 0.02        0.71  138661/145356      svn_cache__set [43]
>                 0.00        0.06  415787/836751      svn_path_join [75]
>                 0.01        0.03  138630/693321      svn_fs_fs__dag_dup [61]
>                 0.03        0.00  138630/416185      svn_fs__canonicalize_abspath [83]
>                 0.01        0.00  415787/415787      svn_fs__next_entry_name [147]
>                 0.01        0.00  277157/415818      svn_fs_fs__dag_node_kind [146]
>                 0.00        0.00  277105/416030      svn_fs_fs__dag_set_fs [238]
>                 0.00        0.00  138630/970612      svn_fs_fs__dag_get_id [237]
>
> -----------------------------------------------
>
>                 0.01       17.16  138659/138659      svn_fs_dir_entries [21]
> [20]     5.8    0.01       17.16  138659         fs_dir_entries [20]
>                 0.00       13.00  138659/277555      get_dag [14]
>                 0.00        4.15  138659/277320      svn_fs_fs__dag_dir_entries [27]
>
> -----------------------------------------------
>
>                 0.00        0.01      84/138659      verify_close_directory [11]
>                 0.00       17.16  138575/138659      verify_directory_entry [13]
> [21]     5.8    0.00       17.17  138659         svn_fs_dir_entries [21]
>                 0.01       17.16  138659/138659      fs_dir_entries [20]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [22]     5.6   16.49        0.00                 apr_pstrdup [22]
>
> -----------------------------------------------
>
>                 0.00       15.60  138661/138661      verify_directory_entry [13]
> [23]     5.3    0.00       15.60  138661         svn_fs_check_path [23]
>                 0.00       15.60  138661/138661      svn_fs_fs__check_path [24]
>
> -----------------------------------------------
>
>                 0.00       15.60  138661/138661      svn_fs_check_path [23]
> [24]     5.3    0.00       15.60  138661         svn_fs_fs__check_path [24]
>                 0.00       13.00  138661/277555      get_dag [14]
>                 0.01        2.58  138661/277364      svn_fs_fs__dag_get_node [31]
>                 0.00        0.00  138661/415818      svn_fs_fs__dag_node_kind [146]
>                 0.00        0.00  138661/917256572     svn_fs_fs__id_copy [26]
>                 0.00        0.00  138661/970612      svn_fs_fs__dag_get_id [237]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [25]     4.9   14.38        0.00                 apr_pool_create_ex_debug [25]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/917256572     fetch_all_changes [169]
>                 0.00        0.00      42/917256572     dup_id [222]
>                 0.00        0.00  138661/917256572     svn_fs_fs__dag_open [29]
>                 0.00        0.00  138661/917256572     svn_fs_fs__check_path [24]
>                 0.00        0.00  277364/917256572     svn_fs_fs__dag_get_node [31]
>                 0.01        0.00  612995/917256572     copy_node_revision [73]
>                 0.01        0.00 1386642/917256572     svn_fs_fs__dag_dup [61]
>                 9.75        0.00 914702173/917256572     dup_dir_listing [16]
> [26]     3.3    9.78        0.00 917256572         svn_fs_fs__id_copy [26]
>
> -----------------------------------------------
>
>                 0.00        4.15  138659/277320      fs_dir_entries [20]
>                 0.01        4.15  138661/277320      svn_fs_fs__dag_open [29]
> [27]     2.8    0.01        8.30  277320         svn_fs_fs__dag_dir_entries [27]
>                 0.00        8.30  277320/277320      svn_fs_fs__rep_contents_dir [28]
>
> -----------------------------------------------
>
>                 0.00        8.30  277320/277320      svn_fs_fs__dag_dir_entries [27]
> [28]     2.8    0.00        8.30  277320         svn_fs_fs__rep_contents_dir [28]
>                 0.01        7.26  277320/970683      svn_cache__get [17]
>                 0.02        0.61    6674/6674        parse_dir_entries [45]
>                 0.00        0.36    4760/4783        svn_hash_read2 [53]
>                 0.00        0.03    6674/145356      svn_cache__set [43]
>                 0.00        0.01    4760/4806        read_representation [123]
>                 0.00        0.00  283994/1452221     svn_fs_fs__id_txn_id [148]
>                 0.00        0.00    4760/282199      svn_stream_close	<cycle 3> [126]
>                 0.00        0.00  277320/277320      svn_fs_fs__id_unparse [244]
>
> -----------------------------------------------
>
>                 0.03        6.78  138661/138661      open_path [19]
> [29]     2.3    0.03        6.78  138661         svn_fs_fs__dag_open [29]
>                 0.01        4.15  138661/277320      svn_fs_fs__dag_dir_entries [27]
>                 0.01        2.58  138661/277364      svn_fs_fs__dag_get_node [31]
>                 0.00        0.04  138661/138661      svn_path_is_single_path_component [104]
>                 0.00        0.00  138661/917256572     svn_fs_fs__id_copy [26]
>                 0.00        0.00  138661/150515      svn_pool_create_ex [248]
>                 0.00        0.00  138661/138661      svn_fs_fs__dag_get_fs [249]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [30]     1.8    5.27        0.00                 apr_hash_this [30]
>
> -----------------------------------------------
>
>                 0.00        0.00      42/277364      svn_fs_fs__dag_revision_root [157]
>                 0.01        2.58  138661/277364      svn_fs_fs__dag_open [29]
>                 0.01        2.58  138661/277364      svn_fs_fs__check_path [24]
> [31]     1.7    0.02        5.15  277364         svn_fs_fs__dag_get_node [31]
>                 0.04        5.11  277364/277364      svn_fs_fs__get_node_revision [32]
>                 0.00        0.00  277364/917256572     svn_fs_fs__id_copy [26]
>
> -----------------------------------------------
>
>                 0.04        5.11  277364/277364      svn_fs_fs__dag_get_node [31]
> [32]     1.7    0.04        5.11  277364         svn_fs_fs__get_node_revision [32]
>                 0.09        4.27  277364/277364      svn_fs_fs__read_noderev [33]
>                 0.09        0.42  277364/282212      svn_fs_fs__path_rev_absolute [47]
>                 0.00        0.16  277364/282230      svn_io_file_open [68]
>                 0.03        0.00  277364/287126      svn_io_file_seek [106]
>                 0.01        0.02  277364/277411      svn_stream_from_aprfile2 [110]
>                 0.01        0.00  277364/282233      ensure_revision_exists [130]
>                 0.00        0.00  277364/1452221     svn_fs_fs__id_txn_id [148]
>                 0.00        0.00  277364/277364      svn_fs_fs__id_rev [243]
>                 0.00        0.00  277364/277364      svn_fs_fs__id_offset [242]
>
> -----------------------------------------------
>
>                 0.09        4.27  277364/277364      svn_fs_fs__get_node_revision [32]
> [33]     1.5    0.09        4.27  277364         svn_fs_fs__read_noderev [33]
>                 0.06        2.20  277364/277385      read_header_block [38]
>                 1.92        0.00  474562/626196      svn_fs_fs__id_parse [36]
>                 0.01        0.07  197542/197542      read_rep_offsets [82]
>                 0.00        0.01  277364/282199      svn_stream_close	<cycle 3> [126]
>                 0.00        0.00  197542/1452221     svn_fs_fs__id_txn_id [148]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [34]     1.1    3.38        0.00                 apr_strfsize [34]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [35]     1.1    3.25        0.00                 apr_hash_pool_get [35]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/626196      svn_fs_fs__rev_get_root [164]
>                 0.00        0.00      34/626196      read_change [170]
>                 0.61        0.00  151579/626196      parse_dir_entries [45]
>                 1.92        0.00  474562/626196      svn_fs_fs__read_noderev [33]
> [36]     0.9    2.53        0.00  626196         svn_fs_fs__id_parse [36]
>
> -----------------------------------------------
>
>                 0.07        0.26  307987/2367079     hash_read [54]
>                 0.47        1.73 2059092/2367079     read_header_block [38]
> [37]     0.9    0.54        1.99 2367079         svn_stream_readline [37]
>                 0.47        1.00 48555969/49166264     svn_stream_read	<cycle 1> [40]
>                 0.26        0.24 48555969/48556378     svn_stringbuf_appendbytes [48]
>                 0.02        0.00 2367079/2931697     svn_stringbuf_create_ensure [111]
>                 0.00        0.00 2367079/2367079     svn_stringbuf_chop [236]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/277385      svn_fs_fs__rev_get_root [164]
>                 0.06        2.20  277364/277385      svn_fs_fs__read_noderev [33]
> [38]     0.8    0.06        2.20  277385         read_header_block [38]
>                 0.47        1.73 2059092/2367079     svn_stream_readline [37]
>
> -----------------------------------------------
>
> [39]     0.5    0.48        1.01 49166264+2145302 <cycle 1 as a whole>	[39]
>                 0.43        0.97 49166469             svn_stream_read	<cycle 1> [40]
>                 0.05        0.04 2141183             rep_read_contents	<cycle 1> [81]
>                 0.00        0.00      24             read_window	<cycle 1> [192]
>                 0.00        0.00    3842             translated_stream_read	<cycle 1> [195]
>                 0.00        0.00      24             svn_txdelta_read_svndiff_window	<cycle 1> [216]
>                 0.00        0.00      24             read_window_header	<cycle 1> [266]
>
> -----------------------------------------------
>
>                                        4             translated_stream_read	<cycle 1> [195]
>                                       24             svn_txdelta_read_svndiff_window	<cycle 1> [216]
>                                      177             read_window_header	<cycle 1> [266]
>                 0.00        0.00      45/49166264     svn_stream_copy3 [194]
>                 0.00        0.00    3842/49166264     svn_config__parse_file [173]
>                 0.01        0.01  606408/49166264     hash_read [54]
>                 0.47        1.00 48555969/49166264     svn_stream_readline [37]
> [40]     0.5    0.43        0.97 49166469         svn_stream_read	<cycle 1> [40]
>                 0.37        0.60 47021444/47021444     read_handler_apr [41]
>                                  2141183             rep_read_contents	<cycle 1> [81]
>                                     3842             translated_stream_read	<cycle 1> [195]
>
> -----------------------------------------------
>
>                 0.37        0.60 47021444/47021444     svn_stream_read	<cycle 1> [40]
> [41]     0.3    0.37        0.60 47021444         read_handler_apr [41]
>                 0.46        0.00 47021444/49162605     svn_io_file_read_full [49]
>                 0.14        0.00 47021444/49760247     do_io_file_wrapper_cleanup [71]
>                 0.00        0.00       4/30          svn_error_clear [265]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [42]     0.3    0.82        0.00                 file_read_buffered [42]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/145356      svn_fs_fs__rev_get_root [164]
>                 0.00        0.03    6674/145356      svn_fs_fs__rep_contents_dir [28]
>                 0.02        0.71  138661/145356      open_path [19]
> [43]     0.3    0.02        0.75  145356         svn_cache__set [43]
>                 0.08        0.67  145356/145356      inprocess_cache_set [44]
>
> -----------------------------------------------
>
>                 0.08        0.67  145356/145356      svn_cache__set [43]
> [44]     0.3    0.08        0.67  145356         inprocess_cache_set [44]
>                 0.39        0.23    6674/277320      dup_dir_listing [16]
>                 0.00        0.04  138661/554691      svn_fs_fs__dag_dup_for_cache [66]
>                 0.00        0.00      21/42          dup_id [222]
>                 0.00        0.00    1860/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.02        0.61    6674/6674        svn_fs_fs__rep_contents_dir [28]
> [45]     0.2    0.02        0.61    6674         parse_dir_entries [45]
>                 0.61        0.00  151579/626196      svn_fs_fs__id_parse [36]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [46]     0.2    0.59        0.00                 apr_pool_destroy [46]
>                 0.00        0.00       2/2           xlate_handle_node_cleanup [319]
>                 0.00        0.00       2/2           close_apr [301]
>                 0.00        0.00       1/1           xlate_cleanup [336]
>                 0.00        0.00       1/1           uninit [335]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/282212      svn_fs_fs__rev_get_root [164]
>                 0.00        0.00      21/282212      svn_fs_fs__paths_changed [167]
>                 0.00        0.01    4806/282212      create_rep_state_body [124]
>                 0.09        0.42  277364/282212      svn_fs_fs__get_node_revision [32]
> [47]     0.2    0.09        0.43  282212         svn_fs_fs__path_rev_absolute [47]
>                 0.05        0.19  282212/282212      svn_io_check_path [60]
>                 0.01        0.19  282212/282212      path_rev [62]
>
> -----------------------------------------------
>
>                 0.00        0.00      27/48556378     svn_stringbuf_appendstr [225]
>                 0.00        0.00      46/48556378     svn_stringbuf_appendcstr [221]
>                 0.00        0.00      68/48556378     svn_config__parse_file [173]
>                 0.00        0.00     126/48556378     write_hash_to_stringbuf [206]
>                 0.00        0.00     142/48556378     write_handler_stringbuf [211]
>                 0.26        0.24 48555969/48556378     svn_stream_readline [37]
> [48]     0.2    0.26        0.24 48556378         svn_stringbuf_appendbytes [48]
>                 0.24        0.00 48556378/48556405     svn_stringbuf_ensure [57]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/49162605     create_rep_state_body [124]
>                 0.02        0.00 2141138/49162605     rep_read_contents	<cycle 1> [81]
>                 0.46        0.00 47021444/49162605     read_handler_apr [41]
> [49]     0.2    0.48        0.00 49162605         svn_io_file_read_full [49]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [50]     0.2    0.46        0.00                 apr_file_read [50]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [51]     0.2    0.46        0.00                 apr_file_read_full [51]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [52]     0.1    0.38        0.00                 apr_hash_get [52]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/4783        svn_fs_fs__get_proplist [163]
>                 0.00        0.36    4760/4783        svn_fs_fs__rep_contents_dir [28]
> [53]     0.1    0.00        0.36    4783         svn_hash_read2 [53]
>                 0.01        0.35    4783/4783        hash_read [54]
>
> -----------------------------------------------
>
>                 0.01        0.35    4783/4783        svn_hash_read2 [53]
> [54]     0.1    0.01        0.35    4783         hash_read [54]
>                 0.07        0.26  307987/2367079     svn_stream_readline [37]
>                 0.01        0.01  606408/49166264     svn_stream_read	<cycle 1> [40]
>                 0.00        0.00  151602/151602      svn_string_ncreate [247]
>
> -----------------------------------------------
>
>                 0.01        0.15  282212/564442      io_check_path [64]
>                 0.02        0.15  282230/564442      svn_io_file_open [68]
> [55]     0.1    0.03        0.30  564442         svn_path_cstring_from_utf8 [55]
>                 0.10        0.20  564442/564463      svn_utf_cstring_from_utf8 [56]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/564463      svn_cmdline_cstring_from_utf8 [182]
>                 0.10        0.20  564442/564463      svn_path_cstring_from_utf8 [55]
> [56]     0.1    0.10        0.20  564463         svn_utf_cstring_from_utf8 [56]
>                 0.11        0.00  564463/564463      svn_utf__is_valid [77]
>                 0.05        0.00  564463/564476      get_xlate_handle_node [91]
>                 0.03        0.00  564463/564476      put_xlate_handle_node [109]
>                 0.01        0.00  564463/564476      convert_to_stringbuf [121]
>
> -----------------------------------------------
>
>                 0.00        0.00       6/48556405     svn_stringbuf_set [231]
>                 0.00        0.00      21/48556405     zlib_decode [223]
>                 0.24        0.00 48556378/48556405     svn_stringbuf_appendbytes [48]
> [57]     0.1    0.24        0.00 48556405         svn_stringbuf_ensure [57]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [58]     0.1    0.24        0.00                 moncontrol [58]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [59]     0.1    0.24        0.00                 svn_io_files_contents_same_p [59]
>
> -----------------------------------------------
>
>                 0.05        0.19  282212/282212      svn_fs_fs__path_rev_absolute [47]
> [60]     0.1    0.05        0.19  282212         svn_io_check_path [60]
>                 0.02        0.17  282212/282212      io_check_path [64]
>
> -----------------------------------------------
>
>                 0.01        0.03  138630/693321      open_path [19]
>                 0.03        0.14  554691/693321      svn_fs_fs__dag_dup_for_cache [66]
> [61]     0.1    0.04        0.17  693321         svn_fs_fs__dag_dup [61]
>                 0.07        0.07  693321/693321      copy_node_revision [73]
>                 0.01        0.00 1386642/917256572     svn_fs_fs__id_copy [26]
>                 0.01        0.00  693321/693321      svn_fs_fs__dag_check_mutable [120]
>
> -----------------------------------------------
>
>                 0.01        0.19  282212/282212      svn_fs_fs__path_rev_absolute [47]
> [62]     0.1    0.01        0.19  282212         path_rev [62]
>                 0.09        0.06  282212/282212      svn_path_join_many [72]
>                 0.00        0.04  282212/836751      svn_path_join [75]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [63]     0.1    0.19        0.00                 svn_string_from_stream [63]
>
> -----------------------------------------------
>
>                 0.02        0.17  282212/282212      svn_io_check_path [60]
> [64]     0.1    0.02        0.17  282212         io_check_path [64]
>                 0.01        0.15  282212/564442      svn_path_cstring_from_utf8 [55]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [65]     0.1    0.18        0.00                 .L744 [65]
>
> -----------------------------------------------
>
>                 0.00        0.04  138661/554691      inprocess_cache_set [44]
>                 0.01        0.13  416030/554691      inprocess_cache_get [18]
> [66]     0.1    0.01        0.17  554691         svn_fs_fs__dag_dup_for_cache [66]
>                 0.03        0.14  554691/693321      svn_fs_fs__dag_dup [61]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/2520206     svn_path_basename [201]
>                 0.00        0.00      34/2520206     svn_path_dirname [202]
>                 0.00        0.05  846636/2520206     svn_path_join_many [72]
>                 0.01        0.11 1673502/2520206     svn_path_join [75]
> [67]     0.1    0.01        0.16 2520206         svn_path_is_canonical [67]
>                 0.16        0.00 2520206/2520206     svn_uri_is_canonical [69]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/282230      read_format [213]
>                 0.00        0.00       2/282230      svn_io_read_version_file [214]
>                 0.00        0.00       2/282230      svn_stream_open_readonly [212]
>                 0.00        0.00       4/282230      svn_fs_type [197]
>                 0.00        0.00       4/282230      read_current [200]
>                 0.00        0.00       4/282230      svn_fs_fs__open [171]
>                 0.00        0.00      21/282230      svn_fs_fs__rev_get_root [164]
>                 0.00        0.00      21/282230      svn_fs_fs__paths_changed [167]
>                 0.00        0.00    4806/282230      create_rep_state_body [124]
>                 0.00        0.16  277364/282230      svn_fs_fs__get_node_revision [32]
> [68]     0.1    0.00        0.17  282230         svn_io_file_open [68]
>                 0.02        0.15  282230/564442      svn_path_cstring_from_utf8 [55]
>
> -----------------------------------------------
>
>                 0.16        0.00 2520206/2520206     svn_path_is_canonical [67]
> [69]     0.1    0.16        0.00 2520206         svn_uri_is_canonical [69]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [70]     0.1    0.16        0.00                 svn_cstring_casecmp [70]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/49760247     create_rep_state_body [124]
>                 0.00        0.00      44/49760247     svn_io_file_read [229]
>                 0.00        0.00   33048/49760247     svn_io_file_getc [175]
>                 0.00        0.00  277424/49760247     svn_io_file_close [165]
>                 0.00        0.00  287126/49760247     svn_io_file_seek [106]
>                 0.01        0.00 2141138/49760247     rep_read_contents	<cycle 1> [81]
>                 0.14        0.00 47021444/49760247     read_handler_apr [41]
> [71]     0.1    0.15        0.00 49760247         do_io_file_wrapper_cleanup [71]
>                 0.00        0.00       6/6           svn_error_wrap_apr [217]
>                 0.00        0.00       6/6           svn_path_cstring_to_utf8 [218]
>                 0.00        0.00       6/30          svn_error_clear [265]
>                 0.00        0.00       6/6           svn_path_local_style [292]
>                 0.00        0.00       6/6           svn_error__locate [291]
>
> -----------------------------------------------
>
>                 0.09        0.06  282212/282212      path_rev [62]
> [72]     0.0    0.09        0.06  282212         svn_path_join_many [72]
>                 0.00        0.05  846636/2520206     svn_path_is_canonical [67]
>
> -----------------------------------------------
>
>                 0.07        0.07  693321/693321      svn_fs_fs__dag_dup [61]
> [73]     0.0    0.07        0.07  693321         copy_node_revision [73]
>                 0.02        0.04 1386642/1386642     svn_fs_fs__rep_copy [85]
>                 0.01        0.00  612995/917256572     svn_fs_fs__id_copy [26]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [74]     0.0    0.14        0.00                 .L546 [74]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/836751      svn_fs_fs__youngest_rev [208]
>                 0.00        0.00       2/836751      svn_fs_fs__open_rep_cache [226]
>                 0.00        0.00       4/836751      svn_fs_type [197]
>                 0.00        0.00      10/836751      get_repos [93]
>                 0.00        0.00      10/836751      svn_fs_fs__open [171]
>                 0.00        0.00      63/836751      make_dir_baton [187]
>                 0.00        0.02  138661/836751      verify_directory_entry [13]
>                 0.00        0.04  282212/836751      path_rev [62]
>                 0.00        0.06  415787/836751      open_path [19]
> [75]     0.0    0.00        0.11  836751         svn_path_join [75]
>                 0.01        0.11 1673502/2520206     svn_path_is_canonical [67]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [76]     0.0    0.11        0.00                 apr_file_writev_full [76]
>
> -----------------------------------------------
>
>                 0.11        0.00  564463/564463      svn_utf_cstring_from_utf8 [56]
> [77]     0.0    0.11        0.00  564463         svn_utf__is_valid [77]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [78]     0.0    0.10        0.00                 apr_strtok [78]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [79]     0.0    0.09        0.00                 .L395 [79]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [80]     0.0    0.09        0.00                 apr_file_printf [80]
>
> -----------------------------------------------
>
>                                  2141183             svn_stream_read	<cycle 1> [40]
> [81]     0.0    0.05        0.04 2141183         rep_read_contents	<cycle 1> [81]
>                 0.02        0.00 2141138/49162605     svn_io_file_read_full [49]
>                 0.01        0.00 2141183/2141183     svn_checksum_update [145]
>                 0.01        0.00 2141138/49760247     do_io_file_wrapper_cleanup [71]
>                 0.00        0.00    4783/4783        svn_checksum_final [174]
>                 0.00        0.00    4783/4783        svn_checksum_match [252]
>                 0.00        0.00      24/24          svn_txdelta_apply_instructions [267]
>                                       24             read_window	<cycle 1> [192]
>
> -----------------------------------------------
>
>                 0.01        0.07  197542/197542      svn_fs_fs__read_noderev [33]
> [82]     0.0    0.01        0.07  197542         read_rep_offsets [82]
>                 0.07        0.00  197714/197714      svn_checksum_parse_hex [84]
>
> -----------------------------------------------
>
>                 0.03        0.00  138630/416185      open_path [19]
>                 0.05        0.00  277555/416185      get_dag [14]
> [83]     0.0    0.08        0.00  416185         svn_fs__canonicalize_abspath [83]
>
> -----------------------------------------------
>
>                 0.07        0.00  197714/197714      read_rep_offsets [82]
> [84]     0.0    0.07        0.00  197714         svn_checksum_parse_hex [84]
>                 0.00        0.00  197714/821297      svn_checksum_create [118]
>
> -----------------------------------------------
>
>                 0.02        0.04 1386642/1386642     copy_node_revision [73]
> [85]     0.0    0.02        0.04 1386642         svn_fs_fs__rep_copy [85]
>                 0.01        0.03 1227230/1232105     svn_checksum_dup [92]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [86]     0.0    0.06        0.00                 MD5Transform [86]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [87]     0.0    0.06        0.00                 apr_stat [87]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [88]     0.0    0.05        0.00                 apr_file_flush [88]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [89]     0.0    0.05        0.00                 apr_pvsprintf [89]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [90]     0.0    0.05        0.00                 svn_fs_fs__dag_get_copyfrom_path [90]
>
> -----------------------------------------------
>
>                 0.00        0.00      13/564476      svn_utf_cstring_to_utf8 [203]
>                 0.05        0.00  564463/564476      svn_utf_cstring_from_utf8 [56]
> [91]     0.0    0.05        0.00  564476         get_xlate_handle_node [91]
>
> -----------------------------------------------
>
>                 0.00        0.00      69/1232105     svn_fs_fs__file_checksum [199]
>                 0.00        0.00    4806/1232105     read_representation [123]
>                 0.01        0.03 1227230/1232105     svn_fs_fs__rep_copy [85]
> [92]     0.0    0.01        0.04 1232105         svn_checksum_dup [92]
>                 0.02        0.02  618800/618800      svn_checksum__from_digest [105]
>
> -----------------------------------------------
>
>                 0.00        0.04       2/2           svn_repos_open [94]
> [93]     0.0    0.00        0.04       2         get_repos [93]
>                 0.00        0.04       2/2           svn_fs_open [95]
>                 0.00        0.00       2/4           svn_fs_type [197]
>                 0.00        0.00      10/836751      svn_path_join [75]
>                 0.00        0.00       2/2           svn_io_read_version_file [214]
>
> -----------------------------------------------
>
>                 0.00        0.04       2/2           subcommand_verify [6]
> [94]     0.0    0.00        0.04       2         svn_repos_open [94]
>                 0.00        0.04       2/2           get_repos [93]
>
> -----------------------------------------------
>
>                 0.00        0.04       2/2           get_repos [93]
> [95]     0.0    0.00        0.04       2         svn_fs_open [95]
>                 0.00        0.04       2/2           fs_open [96]
>                 0.00        0.00       2/4           svn_fs_type [197]
>                 0.00        0.00       2/2           fs_serialized_init [302]
>                 0.00        0.00       2/2           get_library_vtable_direct [304]
>
> -----------------------------------------------
>
>                 0.00        0.04       2/2           svn_fs_open [95]
> [96]     0.0    0.00        0.04       2         fs_open [96]
>                 0.03        0.01       2/2           svn_fs_fs__initialize_caches [97]
>                 0.00        0.00       2/2           svn_fs_fs__open [171]
>
> -----------------------------------------------
>
>                 0.03        0.01       2/2           fs_open [96]
> [97]     0.0    0.03        0.01       2         svn_fs_fs__initialize_caches [97]
>                 0.01        0.00       8/8           svn_cache__create_inprocess [131]
>                 0.00        0.00       2/2           svn_cache__make_memcache_from_config [234]
>                 0.00        0.00       2/4           svn_config_get_bool [233]
>                 0.00        0.00       8/8           svn_cache__set_error_handler [287]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [98]     0.0    0.04        0.00                 apr_pool_clear [98]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [99]     0.0    0.04        0.00                 apr_thread_mutex_lock [99]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [100]    0.0    0.04        0.00                 apr_vformatter [100]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [101]    0.0    0.04        0.00                 svn_fs_fs__pack [101]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [102]    0.0    0.04        0.00                 svn_utf_cstring_from_utf8_string [102]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/138714      svn_path_is_empty [189]
>                 0.00        0.00      32/138714      svn_path_compare_paths [184]
>                 0.04        0.00  138661/138714      svn_path_is_single_path_component [104]
> [103]    0.0    0.04        0.00  138714         svn_dirent_is_root [103]
>
> -----------------------------------------------
>
>                 0.00        0.04  138661/138661      svn_fs_fs__dag_open [29]
> [104]    0.0    0.00        0.04  138661         svn_path_is_single_path_component [104]
>                 0.04        0.00  138661/138714      svn_dirent_is_root [103]
>
> -----------------------------------------------
>
>                 0.02        0.02  618800/618800      svn_checksum_dup [92]
> [105]    0.0    0.02        0.02  618800         svn_checksum__from_digest [105]
>                 0.02        0.00  618800/821297      svn_checksum_create [118]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/287126      svn_fs_fs__rev_get_root [164]
>                 0.00        0.00      21/287126      svn_fs_fs__paths_changed [167]
>                 0.00        0.00      24/287126      read_window	<cycle 1> [192]
>                 0.00        0.00      84/287126      get_root_changes_offset [186]
>                 0.00        0.00    9612/287126      create_rep_state_body [124]
>                 0.03        0.00  277364/287126      svn_fs_fs__get_node_revision [32]
> [106]    0.0    0.03        0.00  287126         svn_io_file_seek [106]
>                 0.00        0.00  287126/49760247     do_io_file_wrapper_cleanup [71]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [107]    0.0    0.03        0.00                 apr_thread_mutex_pool_get [107]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [108]    0.0    0.03        0.00                 apr_thread_mutex_unlock [108]
>
> -----------------------------------------------
>
>                 0.00        0.00      13/564476      svn_utf_cstring_to_utf8 [203]
>                 0.03        0.00  564463/564476      svn_utf_cstring_from_utf8 [56]
> [109]    0.0    0.03        0.00  564476         put_xlate_handle_node [109]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/277411      svn_stream_open_readonly [212]
>                 0.00        0.00      21/277411      svn_fs_fs__rev_get_root [164]
>                 0.00        0.00      24/277411      read_window	<cycle 1> [192]
>                 0.01        0.02  277364/277411      svn_fs_fs__get_node_revision [32]
> [110]    0.0    0.01        0.02  277411         svn_stream_from_aprfile2 [110]
>                 0.02        0.00  277411/282268      svn_stream_create [117]
>                 0.00        0.00  277411/282267      svn_stream_set_read [239]
>                 0.00        0.00  277411/277462      svn_stream_set_write [241]
>                 0.00        0.00  277366/282174      svn_stream_set_close [240]
>
> -----------------------------------------------
>
>                 0.00        0.00     142/2931697     svn_stringbuf_ncreate [219]
>                 0.00        0.00  564476/2931697     convert_to_stringbuf [121]
>                 0.02        0.00 2367079/2931697     svn_stream_readline [37]
> [111]    0.0    0.02        0.00 2931697         svn_stringbuf_create_ensure [111]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [112]    0.0    0.02        0.00                 apr_hash_first [112]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [113]    0.0    0.02        0.00                 apr_hash_make [113]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [114]    0.0    0.02        0.00                 apr_pool_cleanup_register [114]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [115]    0.0    0.02        0.00                 apr_vsnprintf [115]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [116]    0.0    0.02        0.00                 svn_path_splitext [116]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/282268      subcommand_verify [6]
>                 0.00        0.00       2/282268      svn_subst_stream_translated [228]
>                 0.00        0.00       4/282268      svn_stream_from_stringbuf [224]
>                 0.00        0.00      21/282268      svn_stream_empty [210]
>                 0.00        0.00      23/282268      svn_stream_disown [207]
>                 0.00        0.00    4806/282268      read_representation [123]
>                 0.02        0.00  277411/282268      svn_stream_from_aprfile2 [110]
> [117]    0.0    0.02        0.00  282268         svn_stream_create [117]
>
> -----------------------------------------------
>
>                 0.00        0.00    4783/821297      svn_checksum_final [174]
>                 0.00        0.00  197714/821297      svn_checksum_parse_hex [84]
>                 0.02        0.00  618800/821297      svn_checksum__from_digest [105]
> [118]    0.0    0.02        0.00  821297         svn_checksum_create [118]
>
> -----------------------------------------------
>
>                 0.00        0.02      34/34          svn_delta_path_driver [9]
> [119]    0.0    0.00        0.02      34         path_driver_cb_func [119]
>                 0.00        0.01      23/23          add_file [150]
>                 0.00        0.00      11/11          add_directory [155]
>                 0.00        0.00      23/69          svn_fs_file_checksum [152]
>                 0.00        0.00      23/23          apply_textdelta [269]
>                 0.00        0.00      23/69          svn_checksum_to_cstring [258]
>                 0.00        0.00      23/23          close_file [273]
>                 0.00        0.00      23/23          change_file_prop [270]
>                 0.00        0.00      23/23          svn_delta_noop_window_handler [274]
>
> -----------------------------------------------
>
>                 0.01        0.00  693321/693321      svn_fs_fs__dag_dup [61]
> [120]    0.0    0.01        0.00  693321         svn_fs_fs__dag_check_mutable [120]
>                 0.00        0.00  693321/1452221     svn_fs_fs__id_txn_id [148]
>                 0.00        0.00  693321/970612      svn_fs_fs__dag_get_id [237]
>
> -----------------------------------------------
>
>                 0.00        0.00      13/564476      svn_utf_cstring_to_utf8 [203]
>                 0.01        0.00  564463/564476      svn_utf_cstring_from_utf8 [56]
> [121]    0.0    0.01        0.00  564476         convert_to_stringbuf [121]
>                 0.00        0.00  564476/2931697     svn_stringbuf_create_ensure [111]
>
> -----------------------------------------------
>
>                 0.00        0.00      11/34          add_directory [156]
>                 0.00        0.01      23/34          add_file [149]
> [122]    0.0    0.00        0.01      34         dump_node [122]
>                 0.00        0.00      34/34          svn_fs_node_proplist [154]
>                 0.00        0.00      46/69          svn_fs_file_checksum [152]
>                 0.00        0.00      23/23          svn_fs_file_contents [161]
>                 0.00        0.00      23/109         svn_fs_file_length [129]
>                 0.00        0.00     239/260         svn_stream_printf [188]
>                 0.00        0.00      23/23          svn_stream_copy3 [194]
>                 0.00        0.00      34/34          write_hash_to_stringbuf [206]
>                 0.00        0.00      68/515         svn_stream_write	<cycle 2> [180]
>                 0.00        0.00      23/23          svn_stream_disown [207]
>                 0.00        0.00      46/69          svn_checksum_to_cstring [258]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/4806        svn_fs_fs__get_proplist [163]
>                 0.00        0.00      23/4806        svn_fs_fs__dag_get_contents [178]
>                 0.00        0.01    4760/4806        svn_fs_fs__rep_contents_dir [28]
> [123]    0.0    0.00        0.01    4806         read_representation [123]
>                 0.00        0.01    4806/4806        create_rep_state_body [124]
>                 0.00        0.00    4806/282268      svn_stream_create [117]
>                 0.00        0.00    4806/1232105     svn_checksum_dup [92]
>                 0.00        0.00    9612/150515      svn_pool_create_ex [248]
>                 0.00        0.00    4806/4806        svn_checksum_ctx_create [251]
>                 0.00        0.00    4806/282267      svn_stream_set_read [239]
>                 0.00        0.00    4806/282174      svn_stream_set_close [240]
>
> -----------------------------------------------
>
>                 0.00        0.01    4806/4806        read_representation [123]
> [124]    0.0    0.00        0.01    4806         create_rep_state_body [124]
>                 0.00        0.01    4806/282212      svn_fs_fs__path_rev_absolute [47]
>                 0.00        0.00    4806/282230      svn_io_file_open [68]
>                 0.00        0.00    9612/287126      svn_io_file_seek [106]
>                 0.00        0.00    4806/282233      ensure_revision_exists [130]
>                 0.00        0.00    4806/4806        read_rep_line [177]
>                 0.00        0.00      23/49162605     svn_io_file_read_full [49]
>                 0.00        0.00      23/49760247     do_io_file_wrapper_cleanup [71]
>
> -----------------------------------------------
>
> [125]    0.0    0.00        0.01  282199+4       <cycle 3 as a whole>	[125]
>                 0.00        0.01  282201             svn_stream_close	<cycle 3> [126]
>                 0.00        0.00       2             translated_stream_close	<cycle 3> [318]
>
> -----------------------------------------------
>
>                                        2             translated_stream_close	<cycle 3> [318]
>                 0.00        0.00       2/282199      svn_config__parse_file [173]
>                 0.00        0.00       4/282199      translated_stream_read	<cycle 1> [195]
>                 0.00        0.00      23/282199      svn_fs_fs__get_proplist [163]
>                 0.00        0.00      46/282199      svn_stream_copy3 [194]
>                 0.00        0.00    4760/282199      svn_fs_fs__rep_contents_dir [28]
>                 0.00        0.01  277364/282199      svn_fs_fs__read_noderev [33]
> [126]    0.0    0.00        0.01  282201         svn_stream_close	<cycle 3> [126]
>                 0.01        0.00  277366/277366      close_handler_apr [127]
>                 0.00        0.00    4806/4806        rep_read_contents_close [250]
>                                        2             translated_stream_close	<cycle 3> [318]
>
> -----------------------------------------------
>
>                 0.01        0.00  277366/277366      svn_stream_close	<cycle 3> [126]
> [127]    0.0    0.01        0.00  277366         close_handler_apr [127]
>                 0.00        0.00  277366/277424      svn_io_file_close [165]
>
> -----------------------------------------------
>
>                 0.00        0.01     109/109         svn_fs_file_length [129]
> [128]    0.0    0.00        0.01     109         fs_file_length [128]
>                 0.00        0.01     109/277555      get_dag [14]
>                 0.00        0.00     109/109         svn_fs_fs__dag_file_length [256]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/109         dump_node [122]
>                 0.00        0.01      86/109         verify_directory_entry [13]
> [129]    0.0    0.00        0.01     109         svn_fs_file_length [129]
>                 0.00        0.01     109/109         fs_file_length [128]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/282233      svn_fs_fs__paths_changed [167]
>                 0.00        0.00      42/282233      svn_fs_fs__rev_get_root [164]
>                 0.00        0.00    4806/282233      create_rep_state_body [124]
>                 0.01        0.00  277364/282233      svn_fs_fs__get_node_revision [32]
> [130]    0.0    0.01        0.00  282233         ensure_revision_exists [130]
>
> -----------------------------------------------
>
>                 0.01        0.00       8/8           svn_fs_fs__initialize_caches [97]
> [131]    0.0    0.01        0.00       8         svn_cache__create_inprocess [131]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [132]    0.0    0.01        0.00                 .L173 [132]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [133]    0.0    0.01        0.00                 apr_allocator_mutex_get [133]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [134]    0.0    0.01        0.00                 apr_atoi64 [134]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [135]    0.0    0.01        0.00                 apr_file_open [135]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [136]    0.0    0.01        0.00                 apr_file_pool_get [136]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [137]    0.0    0.01        0.00                 apr_pool_create_ex [137]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [138]    0.0    0.01        0.00                 apr_unix_file_cleanup [138]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [139]    0.0    0.01        0.00                 apr_unix_mode2perms [139]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [140]    0.0    0.01        0.00                 apr_xlate_conv_buffer [140]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [141]    0.0    0.01        0.00                 free_proc_chain [141]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [142]    0.0    0.01        0.00                 svn_cache__iter [142]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [143]    0.0    0.01        0.00                 svn_checksum_size [143]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [144]    0.0    0.01        0.00                 svn_dirent_join [144]
>
> -----------------------------------------------
>
>                 0.01        0.00 2141183/2141183     rep_read_contents	<cycle 1> [81]
> [145]    0.0    0.01        0.00 2141183         svn_checksum_update [145]
>
> -----------------------------------------------
>
>                 0.00        0.00  138661/415818      svn_fs_fs__check_path [24]
>                 0.01        0.00  277157/415818      open_path [19]
> [146]    0.0    0.01        0.00  415818         svn_fs_fs__dag_node_kind [146]
>
> -----------------------------------------------
>
>                 0.01        0.00  415787/415787      open_path [19]
> [147]    0.0    0.01        0.00  415787         svn_fs__next_entry_name [147]
>
> -----------------------------------------------
>
>                 0.00        0.00  197542/1452221     svn_fs_fs__read_noderev [33]
>                 0.00        0.00  277364/1452221     svn_fs_fs__get_node_revision [32]
>                 0.00        0.00  283994/1452221     svn_fs_fs__rep_contents_dir [28]
>                 0.00        0.00  693321/1452221     svn_fs_fs__dag_check_mutable [120]
> [148]    0.0    0.01        0.00 1452221         svn_fs_fs__id_txn_id [148]
>
> -----------------------------------------------
>
>                 0.00        0.01      23/23          add_file [150]
> [149]    0.0    0.00        0.01      23         add_file [149]
>                 0.00        0.01      23/34          dump_node [122]
>
> -----------------------------------------------
>
>                 0.00        0.01      23/23          path_driver_cb_func [119]
> [150]    0.0    0.00        0.01      23         add_file [150]
>                 0.00        0.01      23/23          add_file [149]
>                 0.00        0.00      23/281         check_cancel [255]
>
> -----------------------------------------------
>
>                 0.00        0.01      69/69          svn_fs_file_checksum [152]
> [151]    0.0    0.00        0.01      69         fs_file_checksum [151]
>                 0.00        0.01      69/277555      get_dag [14]
>                 0.00        0.00      69/69          svn_fs_fs__dag_file_checksum [198]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/69          path_driver_cb_func [119]
>                 0.00        0.00      46/69          dump_node [122]
> [152]    0.0    0.00        0.01      69         svn_fs_file_checksum [152]
>                 0.00        0.01      69/69          fs_file_checksum [151]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/34          svn_fs_node_proplist [154]
> [153]    0.0    0.00        0.00      34         fs_node_proplist [153]
>                 0.00        0.00      34/277555      get_dag [14]
>                 0.00        0.00      34/34          svn_fs_fs__dag_get_proplist [162]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/34          dump_node [122]
> [154]    0.0    0.00        0.00      34         svn_fs_node_proplist [154]
>                 0.00        0.00      34/34          fs_node_proplist [153]
>
> -----------------------------------------------
>
>                 0.00        0.00      11/11          path_driver_cb_func [119]
> [155]    0.0    0.00        0.00      11         add_directory [155]
>                 0.00        0.00      11/11          add_directory [156]
>                 0.00        0.00      11/281         check_cancel [255]
>
> -----------------------------------------------
>
>                 0.00        0.00      11/11          add_directory [155]
> [156]    0.0    0.00        0.00      11         add_directory [156]
>                 0.00        0.00      11/34          dump_node [122]
>                 0.00        0.00      11/84          make_dir_baton [187]
>
> -----------------------------------------------
>
>                 0.00        0.00      42/42          svn_fs_fs__revision_root [158]
> [157]    0.0    0.00        0.00      42         svn_fs_fs__dag_revision_root [157]
>                 0.00        0.00      42/42          svn_fs_fs__rev_get_root [164]
>                 0.00        0.00      42/277364      svn_fs_fs__dag_get_node [31]
>
> -----------------------------------------------
>
>                 0.00        0.00      42/42          svn_fs_revision_root [159]
> [158]    0.0    0.00        0.00      42         svn_fs_fs__revision_root [158]
>                 0.00        0.00      42/42          svn_fs_fs__dag_revision_root [157]
>                 0.00        0.00      42/42          svn_fs__check_fs [263]
>                 0.00        0.00      42/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00        0.00      42/42          svn_repos_verify_fs [7]
> [159]    0.0    0.00        0.00      42         svn_fs_revision_root [159]
>                 0.00        0.00      42/42          svn_fs_fs__revision_root [158]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          svn_fs_file_contents [161]
> [160]    0.0    0.00        0.00      23         fs_file_contents [160]
>                 0.00        0.00      23/277555      get_dag [14]
>                 0.00        0.00      23/23          svn_fs_fs__dag_get_contents [178]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          dump_node [122]
> [161]    0.0    0.00        0.00      23         svn_fs_file_contents [161]
>                 0.00        0.00      23/23          fs_file_contents [160]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/34          fs_node_proplist [153]
> [162]    0.0    0.00        0.00      34         svn_fs_fs__dag_get_proplist [162]
>                 0.00        0.00      34/34          svn_fs_fs__get_proplist [163]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/34          svn_fs_fs__dag_get_proplist [162]
> [163]    0.0    0.00        0.00      34         svn_fs_fs__get_proplist [163]
>                 0.00        0.00      23/4783        svn_hash_read2 [53]
>                 0.00        0.00      23/4806        read_representation [123]
>                 0.00        0.00      23/282199      svn_stream_close	<cycle 3> [126]
>
> -----------------------------------------------
>
>                 0.00        0.00      42/42          svn_fs_fs__dag_revision_root [157]
> [164]    0.0    0.00        0.00      42         svn_fs_fs__rev_get_root [164]
>                 0.00        0.00      42/970683      svn_cache__get [17]
>                 0.00        0.00      21/277385      read_header_block [38]
>                 0.00        0.00      21/145356      svn_cache__set [43]
>                 0.00        0.00      21/626196      svn_fs_fs__id_parse [36]
>                 0.00        0.00      21/282212      svn_fs_fs__path_rev_absolute [47]
>                 0.00        0.00      21/282230      svn_io_file_open [68]
>                 0.00        0.00      21/42          get_root_changes_offset [186]
>                 0.00        0.00      21/287126      svn_io_file_seek [106]
>                 0.00        0.00      21/277411      svn_stream_from_aprfile2 [110]
>                 0.00        0.00      42/282233      ensure_revision_exists [130]
>                 0.00        0.00      21/277424      svn_io_file_close [165]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/277424      read_format [213]
>                 0.00        0.00       2/277424      svn_io_read_version_file [214]
>                 0.00        0.00       4/277424      svn_fs_type [197]
>                 0.00        0.00       4/277424      read_current [200]
>                 0.00        0.00       4/277424      svn_fs_fs__open [171]
>                 0.00        0.00      21/277424      svn_fs_fs__rev_get_root [164]
>                 0.00        0.00      21/277424      svn_fs_fs__paths_changed [167]
>                 0.00        0.00  277366/277424      close_handler_apr [127]
> [165]    0.0    0.00        0.00  277424         svn_io_file_close [165]
>                 0.00        0.00  277424/49760247     do_io_file_wrapper_cleanup [71]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_fs_paths_changed2 [168]
> [166]    0.0    0.00        0.00      21         fs_paths_changed [166]
>                 0.00        0.00      21/21          svn_fs_fs__paths_changed [167]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          fs_paths_changed [166]
> [167]    0.0    0.00        0.00      21         svn_fs_fs__paths_changed [167]
>                 0.00        0.00      21/21          fetch_all_changes [169]
>                 0.00        0.00      21/282212      svn_fs_fs__path_rev_absolute [47]
>                 0.00        0.00      21/282230      svn_io_file_open [68]
>                 0.00        0.00      21/42          get_root_changes_offset [186]
>                 0.00        0.00      21/287126      svn_io_file_seek [106]
>                 0.00        0.00      21/282233      ensure_revision_exists [130]
>                 0.00        0.00      21/277424      svn_io_file_close [165]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_repos_replay2 [8]
> [168]    0.0    0.00        0.00      21         svn_fs_paths_changed2 [168]
>                 0.00        0.00      21/21          fs_paths_changed [166]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_fs_fs__paths_changed [167]
> [169]    0.0    0.00        0.00      21         fetch_all_changes [169]
>                 0.00        0.00      55/55          read_change [170]
>                 0.00        0.00      34/917256572     svn_fs_fs__id_copy [26]
>                 0.00        0.00      21/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00        0.00      55/55          fetch_all_changes [169]
> [170]    0.0    0.00        0.00      55         read_change [170]
>                 0.00        0.00      34/626196      svn_fs_fs__id_parse [36]
>                 0.00        0.00      89/4913        svn_io_read_length_line [176]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           fs_open [96]
> [171]    0.0    0.00        0.00       2         svn_fs_fs__open [171]
>                 0.00        0.00       2/2           svn_config_read [172]
>                 0.00        0.00       4/282230      svn_io_file_open [68]
>                 0.00        0.00      10/836751      svn_path_join [75]
>                 0.00        0.00       2/2           read_format [213]
>                 0.00        0.00       2/4           read_current [200]
>                 0.00        0.00       2/2           svn_fs_fs__open_rep_cache [226]
>                 0.00        0.00       4/4913        svn_io_read_length_line [176]
>                 0.00        0.00       4/277424      svn_io_file_close [165]
>                 0.00        0.00       2/4           svn_config_get_bool [233]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_fs_fs__open [171]
> [172]    0.0    0.00        0.00       2         svn_config_read [172]
>                 0.00        0.00       2/2           svn_config__parse_file [173]
>                 0.00        0.00       4/94          svn_stringbuf_create [220]
>                 0.00        0.00       2/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_config_read [172]
> [173]    0.0    0.00        0.00       2         svn_config__parse_file [173]
>                 0.00        0.00    3842/49166264     svn_stream_read	<cycle 1> [40]
>                 0.00        0.00       2/2           svn_stream_open_readonly [212]
>                 0.00        0.00      68/48556378     svn_stringbuf_appendbytes [48]
>                 0.00        0.00       2/2           svn_subst_stream_translated [228]
>                 0.00        0.00       2/282199      svn_stream_close	<cycle 3> [126]
>                 0.00        0.00       6/94          svn_stringbuf_create [220]
>                 0.00        0.00       6/10          svn_stringbuf_setempty [286]
>
> -----------------------------------------------
>
>                 0.00        0.00    4783/4783        rep_read_contents	<cycle 1> [81]
> [174]    0.0    0.00        0.00    4783         svn_checksum_final [174]
>                 0.00        0.00    4783/821297      svn_checksum_create [118]
>
> -----------------------------------------------
>
>                 0.00        0.00   33048/33048       svn_io_read_length_line [176]
> [175]    0.0    0.00        0.00   33048         svn_io_file_getc [175]
>                 0.00        0.00   33048/49760247     do_io_file_wrapper_cleanup [71]
>
> -----------------------------------------------
>
>                 0.00        0.00       4/4913        svn_fs_type [197]
>                 0.00        0.00       4/4913        read_current [200]
>                 0.00        0.00       4/4913        svn_fs_fs__open [171]
>                 0.00        0.00       6/4913        read_format [213]
>                 0.00        0.00      89/4913        read_change [170]
>                 0.00        0.00    4806/4913        read_rep_line [177]
> [176]    0.0    0.00        0.00    4913         svn_io_read_length_line [176]
>                 0.00        0.00   33048/33048       svn_io_file_getc [175]
>
> -----------------------------------------------
>
>                 0.00        0.00    4806/4806        create_rep_state_body [124]
> [177]    0.0    0.00        0.00    4806         read_rep_line [177]
>                 0.00        0.00    4806/4913        svn_io_read_length_line [176]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          fs_file_contents [160]
> [178]    0.0    0.00        0.00      23         svn_fs_fs__dag_get_contents [178]
>                 0.00        0.00      23/4806        read_representation [123]
>                 0.00        0.00      23/23          svn_fs_fs__get_contents [275]
>
> -----------------------------------------------
>
> [179]    0.0    0.00        0.00     515+90      <cycle 2 as a whole>	[179]
>                 0.00        0.00     560             svn_stream_write	<cycle 2> [180]
>                 0.00        0.00      45             write_handler_disown	<cycle 2> [261]
>
> -----------------------------------------------
>
>                                       45             write_handler_disown	<cycle 2> [261]
>                 0.00        0.00      45/515         svn_stream_copy3 [194]
>                 0.00        0.00      68/515         dump_node [122]
>                 0.00        0.00     142/515         translate_chunk [196]
>                 0.00        0.00     260/515         svn_stream_printf [188]
> [180]    0.0    0.00        0.00     560         svn_stream_write	<cycle 2> [180]
>                 0.00        0.00      21/21          recode_write [181]
>                 0.00        0.00     142/142         write_handler_stringbuf [211]
>                 0.00        0.00     352/352         write_handler_empty [254]
>                                       45             write_handler_disown	<cycle 2> [261]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_stream_write	<cycle 2> [180]
> [181]    0.0    0.00        0.00      21         recode_write [181]
>                 0.00        0.00      21/21          svn_cmdline_fputs [183]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_cmdline_fputs [183]
> [182]    0.0    0.00        0.00      21         svn_cmdline_cstring_from_utf8 [182]
>                 0.00        0.00      21/564463      svn_utf_cstring_from_utf8 [56]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          recode_write [181]
> [183]    0.0    0.00        0.00      21         svn_cmdline_fputs [183]
>                 0.00        0.00      21/21          svn_cmdline_cstring_from_utf8 [182]
>
> -----------------------------------------------
>
>                 0.00        0.00      16/16          svn_sort_compare_paths [185]
> [184]    0.0    0.00        0.00      16         svn_path_compare_paths [184]
>                 0.00        0.00      32/138714      svn_dirent_is_root [103]
>
> -----------------------------------------------
>
>                                                      <spontaneous>
> [185]    0.0    0.00        0.00                 svn_sort_compare_paths [185]
>                 0.00        0.00      16/16          svn_path_compare_paths [184]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/42          svn_fs_fs__rev_get_root [164]
>                 0.00        0.00      21/42          svn_fs_fs__paths_changed [167]
> [186]    0.0    0.00        0.00      42         get_root_changes_offset [186]
>                 0.00        0.00      84/287126      svn_io_file_seek [106]
>                 0.00        0.00      42/44          svn_io_file_read [229]
>
> -----------------------------------------------
>
>                 0.00        0.00      11/84          add_directory [156]
>                 0.00        0.00      21/84          open_root [205]
>                 0.00        0.00      52/84          open_directory [190]
> [187]    0.0    0.00        0.00      84         make_dir_baton [187]
>                 0.00        0.00      63/836751      svn_path_join [75]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/260         svn_repos_verify_fs [7]
>                 0.00        0.00     239/260         dump_node [122]
> [188]    0.0    0.00        0.00     260         svn_stream_printf [188]
>                 0.00        0.00     260/515         svn_stream_write	<cycle 2> [180]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_delta_path_driver [9]
> [189]    0.0    0.00        0.00      21         svn_path_is_empty [189]
>                 0.00        0.00      21/138714      svn_dirent_is_root [103]
>
> -----------------------------------------------
>
>                 0.00        0.00      52/52          open_directory [191]
> [190]    0.0    0.00        0.00      52         open_directory [190]
>                 0.00        0.00      52/84          make_dir_baton [187]
>
> -----------------------------------------------
>
>                 0.00        0.00      52/52          svn_delta_path_driver [9]
> [191]    0.0    0.00        0.00      52         open_directory [191]
>                 0.00        0.00      52/52          open_directory [190]
>                 0.00        0.00      52/281         check_cancel [255]
>
> -----------------------------------------------
>
>                                       24             rep_read_contents	<cycle 1> [81]
> [192]    0.0    0.00        0.00      24         read_window	<cycle 1> [192]
>                 0.00        0.00      24/287126      svn_io_file_seek [106]
>                 0.00        0.00      24/277411      svn_stream_from_aprfile2 [110]
>                                       24             svn_txdelta_read_svndiff_window	<cycle 1> [216]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/34          svn_delta_path_driver [9]
> [193]    0.0    0.00        0.00      34         svn_path_split [193]
>                 0.00        0.00      34/34          svn_path_dirname [202]
>                 0.00        0.00      34/34          svn_path_basename [201]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          dump_node [122]
> [194]    0.0    0.00        0.00      23         svn_stream_copy3 [194]
>                 0.00        0.00      46/282199      svn_stream_close	<cycle 3> [126]
>                 0.00        0.00      45/49166264     svn_stream_read	<cycle 1> [40]
>                 0.00        0.00      45/515         svn_stream_write	<cycle 2> [180]
>
> -----------------------------------------------
>
>                                     3842             svn_stream_read	<cycle 1> [40]
> [195]    0.0    0.00        0.00    3842         translated_stream_read	<cycle 1> [195]
>                 0.00        0.00       8/8           translate_chunk [196]
>                 0.00        0.00       4/4           svn_stream_from_stringbuf [224]
>                 0.00        0.00       4/282199      svn_stream_close	<cycle 3> [126]
>                 0.00        0.00       4/10          svn_stringbuf_setempty [286]
>                                        4             svn_stream_read	<cycle 1> [40]
>
> -----------------------------------------------
>
>                 0.00        0.00       8/8           translated_stream_read	<cycle 1> [195]
> [196]    0.0    0.00        0.00       8         translate_chunk [196]
>                 0.00        0.00     142/515         svn_stream_write	<cycle 2> [180]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/4           get_repos [93]
>                 0.00        0.00       2/4           svn_fs_open [95]
> [197]    0.0    0.00        0.00       4         svn_fs_type [197]
>                 0.00        0.00       4/282230      svn_io_file_open [68]
>                 0.00        0.00       4/836751      svn_path_join [75]
>                 0.00        0.00       4/4913        svn_io_read_length_line [176]
>                 0.00        0.00       4/277424      svn_io_file_close [165]
>
> -----------------------------------------------
>
>                 0.00        0.00      69/69          fs_file_checksum [151]
> [198]    0.0    0.00        0.00      69         svn_fs_fs__dag_file_checksum [198]
>                 0.00        0.00      69/69          svn_fs_fs__file_checksum [199]
>
> -----------------------------------------------
>
>                 0.00        0.00      69/69          svn_fs_fs__dag_file_checksum [198]
> [199]    0.0    0.00        0.00      69         svn_fs_fs__file_checksum [199]
>                 0.00        0.00      69/1232105     svn_checksum_dup [92]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/4           svn_fs_fs__open [171]
>                 0.00        0.00       2/4           svn_fs_fs__youngest_rev [208]
> [200]    0.0    0.00        0.00       4         read_current [200]
>                 0.00        0.00       4/282230      svn_io_file_open [68]
>                 0.00        0.00       4/4913        svn_io_read_length_line [176]
>                 0.00        0.00       4/277424      svn_io_file_close [165]
>                 0.00        0.00      12/30          svn_error_clear [265]
>                 0.00        0.00       4/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/34          svn_path_split [193]
> [201]    0.0    0.00        0.00      34         svn_path_basename [201]
>                 0.00        0.00      34/2520206     svn_path_is_canonical [67]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/34          svn_path_split [193]
> [202]    0.0    0.00        0.00      34         svn_path_dirname [202]
>                 0.00        0.00      34/2520206     svn_path_is_canonical [67]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/13          parse_local_repos_path [227]
>                 0.00        0.00       6/13          svn_error_wrap_apr [217]
>                 0.00        0.00       6/13          svn_path_cstring_to_utf8 [218]
> [203]    0.0    0.00        0.00      13         svn_utf_cstring_to_utf8 [203]
>                 0.00        0.00      13/564476      get_xlate_handle_node [91]
>                 0.00        0.00      13/564476      put_xlate_handle_node [109]
>                 0.00        0.00      13/564476      convert_to_stringbuf [121]
>                 0.00        0.00      13/13          svn_utf__cstring_is_valid [285]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_delta_path_driver [9]
> [204]    0.0    0.00        0.00      21         open_root [204]
>                 0.00        0.00      21/21          open_root [205]
>                 0.00        0.00      21/281         check_cancel [255]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          open_root [204]
> [205]    0.0    0.00        0.00      21         open_root [205]
>                 0.00        0.00      21/84          make_dir_baton [187]
>
> -----------------------------------------------
>
>                 0.00        0.00      34/34          dump_node [122]
> [206]    0.0    0.00        0.00      34         write_hash_to_stringbuf [206]
>                 0.00        0.00     126/48556378     svn_stringbuf_appendbytes [48]
>                 0.00        0.00      46/46          svn_stringbuf_appendcstr [221]
>                 0.00        0.00      34/94          svn_stringbuf_create [220]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          dump_node [122]
> [207]    0.0    0.00        0.00      23         svn_stream_disown [207]
>                 0.00        0.00      23/282268      svn_stream_create [117]
>                 0.00        0.00      23/282267      svn_stream_set_read [239]
>                 0.00        0.00      23/277462      svn_stream_set_write [241]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_fs_youngest_rev [209]
> [208]    0.0    0.00        0.00       2         svn_fs_fs__youngest_rev [208]
>                 0.00        0.00       2/4           read_current [200]
>                 0.00        0.00       2/836751      svn_path_join [75]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/2           subcommand_verify [6]
>                 0.00        0.00       1/2           svn_repos_verify_fs [7]
> [209]    0.0    0.00        0.00       2         svn_fs_youngest_rev [209]
>                 0.00        0.00       2/2           svn_fs_fs__youngest_rev [208]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_repos_verify_fs [7]
> [210]    0.0    0.00        0.00      21         svn_stream_empty [210]
>                 0.00        0.00      21/282268      svn_stream_create [117]
>                 0.00        0.00      21/282267      svn_stream_set_read [239]
>                 0.00        0.00      21/277462      svn_stream_set_write [241]
>
> -----------------------------------------------
>
>                 0.00        0.00     142/142         svn_stream_write	<cycle 2> [180]
> [211]    0.0    0.00        0.00     142         write_handler_stringbuf [211]
>                 0.00        0.00     142/48556378     svn_stringbuf_appendbytes [48]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_config__parse_file [173]
> [212]    0.0    0.00        0.00       2         svn_stream_open_readonly [212]
>                 0.00        0.00       2/282230      svn_io_file_open [68]
>                 0.00        0.00       2/277411      svn_stream_from_aprfile2 [110]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_fs_fs__open [171]
> [213]    0.0    0.00        0.00       2         read_format [213]
>                 0.00        0.00       2/282230      svn_io_file_open [68]
>                 0.00        0.00       6/4913        svn_io_read_length_line [176]
>                 0.00        0.00       2/277424      svn_io_file_close [165]
>                 0.00        0.00       2/30          svn_error_clear [265]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           get_repos [93]
> [214]    0.0    0.00        0.00       2         svn_io_read_version_file [214]
>                 0.00        0.00       2/282230      svn_io_file_open [68]
>                 0.00        0.00       2/277424      svn_io_file_close [165]
>                 0.00        0.00       2/44          svn_io_file_read [229]
>
> -----------------------------------------------
>
>                 0.00        0.00      24/24          svn_txdelta_read_svndiff_window	<cycle 1> [216]
> [215]    0.0    0.00        0.00      24         decode_window [215]
>                 0.00        0.00      48/48          zlib_decode [223]
>                 0.00        0.00      48/142         svn_stringbuf_ncreate [219]
>                 0.00        0.00      48/94          svn_stringbuf_create [220]
>
> -----------------------------------------------
>
>                                       24             read_window	<cycle 1> [192]
> [216]    0.0    0.00        0.00      24         svn_txdelta_read_svndiff_window	<cycle 1> [216]
>                 0.00        0.00      24/24          decode_window [215]
>                                       24             read_window_header	<cycle 1> [266]
>                                       24             svn_stream_read	<cycle 1> [40]
>
> -----------------------------------------------
>
>                 0.00        0.00       6/6           do_io_file_wrapper_cleanup [71]
> [217]    0.0    0.00        0.00       6         svn_error_wrap_apr [217]
>                 0.00        0.00       6/13          svn_utf_cstring_to_utf8 [203]
>                 0.00        0.00       6/30          svn_error_clear [265]
>
> -----------------------------------------------
>
>                 0.00        0.00       6/6           do_io_file_wrapper_cleanup [71]
> [218]    0.0    0.00        0.00       6         svn_path_cstring_to_utf8 [218]
>                 0.00        0.00       6/13          svn_utf_cstring_to_utf8 [203]
>
> -----------------------------------------------
>
>                 0.00        0.00      48/142         decode_window [215]
>                 0.00        0.00      94/142         svn_stringbuf_create [220]
> [219]    0.0    0.00        0.00     142         svn_stringbuf_ncreate [219]
>                 0.00        0.00     142/2931697     svn_stringbuf_create_ensure [111]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/94          svn_subst_stream_translated [228]
>                 0.00        0.00       4/94          svn_config_read [172]
>                 0.00        0.00       6/94          svn_config__parse_file [173]
>                 0.00        0.00      34/94          write_hash_to_stringbuf [206]
>                 0.00        0.00      48/94          decode_window [215]
> [220]    0.0    0.00        0.00      94         svn_stringbuf_create [220]
>                 0.00        0.00      94/142         svn_stringbuf_ncreate [219]
>
> -----------------------------------------------
>
>                 0.00        0.00      46/46          write_hash_to_stringbuf [206]
> [221]    0.0    0.00        0.00      46         svn_stringbuf_appendcstr [221]
>                 0.00        0.00      46/48556378     svn_stringbuf_appendbytes [48]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/42          inprocess_cache_get [18]
>                 0.00        0.00      21/42          inprocess_cache_set [44]
> [222]    0.0    0.00        0.00      42         dup_id [222]
>                 0.00        0.00      42/917256572     svn_fs_fs__id_copy [26]
>
> -----------------------------------------------
>
>                 0.00        0.00      48/48          decode_window [215]
> [223]    0.0    0.00        0.00      48         zlib_decode [223]
>                 0.00        0.00      27/27          svn_stringbuf_appendstr [225]
>                 0.00        0.00      21/48556405     svn_stringbuf_ensure [57]
>
> -----------------------------------------------
>
>                 0.00        0.00       4/4           translated_stream_read	<cycle 1> [195]
> [224]    0.0    0.00        0.00       4         svn_stream_from_stringbuf [224]
>                 0.00        0.00       4/282268      svn_stream_create [117]
>                 0.00        0.00       4/282267      svn_stream_set_read [239]
>                 0.00        0.00       4/277462      svn_stream_set_write [241]
>
> -----------------------------------------------
>
>                 0.00        0.00      27/27          zlib_decode [223]
> [225]    0.0    0.00        0.00      27         svn_stringbuf_appendstr [225]
>                 0.00        0.00      27/48556378     svn_stringbuf_appendbytes [48]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_fs_fs__open [171]
> [226]    0.0    0.00        0.00       2         svn_fs_fs__open_rep_cache [226]
>                 0.00        0.00       2/836751      svn_path_join [75]
>                 0.00        0.00       2/2           svn_sqlite__open [313]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           .L554 [5]
> [227]    0.0    0.00        0.00       1         parse_local_repos_path [227]
>                 0.00        0.00       1/13          svn_utf_cstring_to_utf8 [203]
>                 0.00        0.00       1/33          svn_path_is_url [264]
>                 0.00        0.00       1/1           svn_path_internal_style [331]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_config__parse_file [173]
> [228]    0.0    0.00        0.00       2         svn_subst_stream_translated [228]
>                 0.00        0.00       2/282268      svn_stream_create [117]
>                 0.00        0.00       2/94          svn_stringbuf_create [220]
>                 0.00        0.00       4/150515      svn_pool_create_ex [248]
>                 0.00        0.00       2/282267      svn_stream_set_read [239]
>                 0.00        0.00       2/277462      svn_stream_set_write [241]
>                 0.00        0.00       2/282174      svn_stream_set_close [240]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/44          svn_io_read_version_file [214]
>                 0.00        0.00      42/44          get_root_changes_offset [186]
> [229]    0.0    0.00        0.00      44         svn_io_file_read [229]
>                 0.00        0.00      44/49760247     do_io_file_wrapper_cleanup [71]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/6           svn_config_enumerate2 [235]
>                 0.00        0.00       4/6           svn_config_get [232]
> [230]    0.0    0.00        0.00       6         find_option [230]
>                 0.00        0.00       6/6           svn_stringbuf_set [231]
>
> -----------------------------------------------
>
>                 0.00        0.00       6/6           find_option [230]
> [231]    0.0    0.00        0.00       6         svn_stringbuf_set [231]
>                 0.00        0.00       6/48556405     svn_stringbuf_ensure [57]
>
> -----------------------------------------------
>
>                 0.00        0.00       4/4           svn_config_get_bool [233]
> [232]    0.0    0.00        0.00       4         svn_config_get [232]
>                 0.00        0.00       4/6           find_option [230]
>                 0.00        0.00       4/150515      svn_pool_create_ex [248]
>                 0.00        0.00       4/4           expand_option_value [294]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/4           svn_fs_fs__open [171]
>                 0.00        0.00       2/4           svn_fs_fs__initialize_caches [97]
> [233]    0.0    0.00        0.00       4         svn_config_get_bool [233]
>                 0.00        0.00       4/4           svn_config_get [232]
>                 0.00        0.00       4/4           get_bool [295]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_fs_fs__initialize_caches [97]
> [234]    0.0    0.00        0.00       2         svn_cache__make_memcache_from_config [234]
>                 0.00        0.00       2/2           svn_config_enumerate2 [235]
>                 0.00        0.00       2/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_cache__make_memcache_from_config [234]
> [235]    0.0    0.00        0.00       2         svn_config_enumerate2 [235]
>                 0.00        0.00       2/6           find_option [230]
>
> -----------------------------------------------
>
>                 0.00        0.00 2367079/2367079     svn_stream_readline [37]
> [236]    0.0    0.00        0.00 2367079         svn_stringbuf_chop [236]
>
> -----------------------------------------------
>
>                 0.00        0.00  138630/970612      open_path [19]
>                 0.00        0.00  138661/970612      svn_fs_fs__check_path [24]
>                 0.00        0.00  693321/970612      svn_fs_fs__dag_check_mutable [120]
> [237]    0.0    0.00        0.00  970612         svn_fs_fs__dag_get_id [237]
>
> -----------------------------------------------
>
>                 0.00        0.00  138925/416030      get_dag [14]
>                 0.00        0.00  277105/416030      open_path [19]
> [238]    0.0    0.00        0.00  416030         svn_fs_fs__dag_set_fs [238]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/282267      svn_subst_stream_translated [228]
>                 0.00        0.00       4/282267      svn_stream_from_stringbuf [224]
>                 0.00        0.00      21/282267      svn_stream_empty [210]
>                 0.00        0.00      23/282267      svn_stream_disown [207]
>                 0.00        0.00    4806/282267      read_representation [123]
>                 0.00        0.00  277411/282267      svn_stream_from_aprfile2 [110]
> [239]    0.0    0.00        0.00  282267         svn_stream_set_read [239]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/282174      svn_subst_stream_translated [228]
>                 0.00        0.00    4806/282174      read_representation [123]
>                 0.00        0.00  277366/282174      svn_stream_from_aprfile2 [110]
> [240]    0.0    0.00        0.00  282174         svn_stream_set_close [240]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/277462      subcommand_verify [6]
>                 0.00        0.00       2/277462      svn_subst_stream_translated [228]
>                 0.00        0.00       4/277462      svn_stream_from_stringbuf [224]
>                 0.00        0.00      21/277462      svn_stream_empty [210]
>                 0.00        0.00      23/277462      svn_stream_disown [207]
>                 0.00        0.00  277411/277462      svn_stream_from_aprfile2 [110]
> [241]    0.0    0.00        0.00  277462         svn_stream_set_write [241]
>
> -----------------------------------------------
>
>                 0.00        0.00  277364/277364      svn_fs_fs__get_node_revision [32]
> [242]    0.0    0.00        0.00  277364         svn_fs_fs__id_offset [242]
>
> -----------------------------------------------
>
>                 0.00        0.00  277364/277364      svn_fs_fs__get_node_revision [32]
> [243]    0.0    0.00        0.00  277364         svn_fs_fs__id_rev [243]
>
> -----------------------------------------------
>
>                 0.00        0.00  277320/277320      svn_fs_fs__rep_contents_dir [28]
> [244]    0.0    0.00        0.00  277320         svn_fs_fs__id_unparse [244]
>                 0.00        0.00  277320/277320      svn_string_createf [245]
>
> -----------------------------------------------
>
>                 0.00        0.00  277320/277320      svn_fs_fs__id_unparse [244]
> [245]    0.0    0.00        0.00  277320         svn_string_createf [245]
>                 0.00        0.00  277320/277320      svn_string_createv [246]
>
> -----------------------------------------------
>
>                 0.00        0.00  277320/277320      svn_string_createf [245]
> [246]    0.0    0.00        0.00  277320         svn_string_createv [246]
>
> -----------------------------------------------
>
>                 0.00        0.00  151602/151602      hash_read [54]
> [247]    0.0    0.00        0.00  151602         svn_string_ncreate [247]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/150515      subcommand_verify [6]
>                 0.00        0.00       1/150515      main [321]
>                 0.00        0.00       1/150515      svn_repos_verify_fs [7]
>                 0.00        0.00       1/150515      svn_fs_initialize [326]
>                 0.00        0.00       1/150515      svn_cmdline_init [324]
>                 0.00        0.00       1/150515      svn_dso_initialize2 [325]
>                 0.00        0.00       1/150515      svn_utf_initialize [334]
>                 0.00        0.00       2/150515      svn_cache__make_memcache_from_config [234]
>                 0.00        0.00       2/150515      svn_config_read [172]
>                 0.00        0.00       4/150515      read_current [200]
>                 0.00        0.00       4/150515      svn_config_get [232]
>                 0.00        0.00       4/150515      svn_subst_stream_translated [228]
>                 0.00        0.00      21/150515      fetch_all_changes [169]
>                 0.00        0.00      42/150515      svn_fs_fs__revision_root [158]
>                 0.00        0.00      84/150515      verify_close_directory [11]
>                 0.00        0.00      84/150515      svn_iter_apr_hash [12]
>                 0.00        0.00     128/150515      svn_delta_path_driver [9]
>                 0.00        0.00    1860/150515      inprocess_cache_set [44]
>                 0.00        0.00    9612/150515      read_representation [123]
>                 0.00        0.00  138661/150515      svn_fs_fs__dag_open [29]
> [248]    0.0    0.00        0.00  150515         svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00        0.00  138661/138661      svn_fs_fs__dag_open [29]
> [249]    0.0    0.00        0.00  138661         svn_fs_fs__dag_get_fs [249]
>
> -----------------------------------------------
>
>                 0.00        0.00    4806/4806        svn_stream_close	<cycle 3> [126]
> [250]    0.0    0.00        0.00    4806         rep_read_contents_close [250]
>
> -----------------------------------------------
>
>                 0.00        0.00    4806/4806        read_representation [123]
> [251]    0.0    0.00        0.00    4806         svn_checksum_ctx_create [251]
>
> -----------------------------------------------
>
>                 0.00        0.00    4783/4783        rep_read_contents	<cycle 1> [81]
> [252]    0.0    0.00        0.00    4783         svn_checksum_match [252]
>                 0.00        0.00    4783/4783        svn_md5__digests_match [253]
>
> -----------------------------------------------
>
>                 0.00        0.00    4783/4783        svn_checksum_match [252]
> [253]    0.0    0.00        0.00    4783         svn_md5__digests_match [253]
>
> -----------------------------------------------
>
>                 0.00        0.00     352/352         svn_stream_write	<cycle 2> [180]
> [254]    0.0    0.00        0.00     352         write_handler_empty [254]
>
> -----------------------------------------------
>
>                 0.00        0.00      11/281         add_directory [155]
>                 0.00        0.00      21/281         set_target_revision [278]
>                 0.00        0.00      21/281         open_root [204]
>                 0.00        0.00      23/281         add_file [150]
>                 0.00        0.00      23/281         apply_textdelta [269]
>                 0.00        0.00      23/281         close_file [273]
>                 0.00        0.00      23/281         change_file_prop [270]
>                 0.00        0.00      52/281         open_directory [191]
>                 0.00        0.00      84/281         close_directory [10]
> [255]    0.0    0.00        0.00     281         check_cancel [255]
>
> -----------------------------------------------
>
>                 0.00        0.00     109/109         fs_file_length [128]
> [256]    0.0    0.00        0.00     109         svn_fs_fs__dag_file_length [256]
>                 0.00        0.00     109/109         svn_fs_fs__file_length [257]
>
> -----------------------------------------------
>
>                 0.00        0.00     109/109         svn_fs_fs__dag_file_length [256]
> [257]    0.0    0.00        0.00     109         svn_fs_fs__file_length [257]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/69          path_driver_cb_func [119]
>                 0.00        0.00      46/69          dump_node [122]
> [258]    0.0    0.00        0.00      69         svn_checksum_to_cstring [258]
>                 0.00        0.00      46/46          svn_md5__digest_to_cstring [259]
>                 0.00        0.00      23/23          svn_sha1__digest_to_cstring [276]
>
> -----------------------------------------------
>
>                 0.00        0.00      46/46          svn_checksum_to_cstring [258]
> [259]    0.0    0.00        0.00      46         svn_md5__digest_to_cstring [259]
>                 0.00        0.00      46/46          svn_md5__digest_to_cstring_display [260]
>
> -----------------------------------------------
>
>                 0.00        0.00      46/46          svn_md5__digest_to_cstring [259]
> [260]    0.0    0.00        0.00      46         svn_md5__digest_to_cstring_display [260]
>
> -----------------------------------------------
>
>                                       45             svn_stream_write	<cycle 2> [180]
> [261]    0.0    0.00        0.00      45         write_handler_disown	<cycle 2> [261]
>                                       45             svn_stream_write	<cycle 2> [180]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/42          svn_repos_verify_fs [7]
>                 0.00        0.00      21/42          svn_delta_get_cancellation_editor [280]
> [262]    0.0    0.00        0.00      42         svn_delta_default_editor [262]
>
> -----------------------------------------------
>
>                 0.00        0.00      42/42          svn_fs_fs__revision_root [158]
> [263]    0.0    0.00        0.00      42         svn_fs__check_fs [263]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/33          parse_local_repos_path [227]
>                 0.00        0.00       6/33          svn_uri_local_style [293]
>                 0.00        0.00      26/33          svn_uri_get_longest_ancestor [284]
> [264]    0.0    0.00        0.00      33         svn_path_is_url [264]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/30          read_format [213]
>                 0.00        0.00       4/30          read_handler_apr [41]
>                 0.00        0.00       6/30          svn_error_wrap_apr [217]
>                 0.00        0.00       6/30          do_io_file_wrapper_cleanup [71]
>                 0.00        0.00      12/30          read_current [200]
> [265]    0.0    0.00        0.00      30         svn_error_clear [265]
>
> -----------------------------------------------
>
>                                       24             svn_txdelta_read_svndiff_window	<cycle 1> [216]
> [266]    0.0    0.00        0.00      24         read_window_header	<cycle 1> [266]
>                                      177             svn_stream_read	<cycle 1> [40]
>
> -----------------------------------------------
>
>                 0.00        0.00      24/24          rep_read_contents	<cycle 1> [81]
> [267]    0.0    0.00        0.00      24         svn_txdelta_apply_instructions [267]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          apply_textdelta [269]
> [268]    0.0    0.00        0.00      23         apply_textdelta [268]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          path_driver_cb_func [119]
> [269]    0.0    0.00        0.00      23         apply_textdelta [269]
>                 0.00        0.00      23/281         check_cancel [255]
>                 0.00        0.00      23/23          apply_textdelta [268]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          path_driver_cb_func [119]
> [270]    0.0    0.00        0.00      23         change_file_prop [270]
>                 0.00        0.00      23/281         check_cancel [255]
>                 0.00        0.00      23/23          change_prop [271]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          change_file_prop [270]
> [271]    0.0    0.00        0.00      23         change_prop [271]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          close_file [273]
> [272]    0.0    0.00        0.00      23         close_file [272]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          path_driver_cb_func [119]
> [273]    0.0    0.00        0.00      23         close_file [273]
>                 0.00        0.00      23/281         check_cancel [255]
>                 0.00        0.00      23/23          close_file [272]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          path_driver_cb_func [119]
> [274]    0.0    0.00        0.00      23         svn_delta_noop_window_handler [274]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          svn_fs_fs__dag_get_contents [178]
> [275]    0.0    0.00        0.00      23         svn_fs_fs__get_contents [275]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          svn_checksum_to_cstring [258]
> [276]    0.0    0.00        0.00      23         svn_sha1__digest_to_cstring [276]
>                 0.00        0.00      23/23          svn_sha1__digest_to_cstring_display [277]
>
> -----------------------------------------------
>
>                 0.00        0.00      23/23          svn_sha1__digest_to_cstring [276]
> [277]    0.0    0.00        0.00      23         svn_sha1__digest_to_cstring_display [277]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_repos_replay2 [8]
> [278]    0.0    0.00        0.00      21         set_target_revision [278]
>                 0.00        0.00      21/281         check_cancel [255]
>                 0.00        0.00      21/21          set_target_revision [279]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          set_target_revision [278]
> [279]    0.0    0.00        0.00      21         set_target_revision [279]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_repos_verify_fs [7]
> [280]    0.0    0.00        0.00      21         svn_delta_get_cancellation_editor [280]
>                 0.00        0.00      21/42          svn_delta_default_editor [262]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_repos_replay2 [8]
> [281]    0.0    0.00        0.00      21         svn_fs_is_revision_root [281]
>
> -----------------------------------------------
>
>                 0.00        0.00      21/21          svn_repos_replay2 [8]
> [282]    0.0    0.00        0.00      21         svn_fs_revision_root_revision [282]
>
> -----------------------------------------------
>
>                 0.00        0.00      13/13          svn_delta_path_driver [9]
> [283]    0.0    0.00        0.00      13         svn_path_get_longest_ancestor [283]
>                 0.00        0.00      13/13          svn_uri_get_longest_ancestor [284]
>
> -----------------------------------------------
>
>                 0.00        0.00      13/13          svn_path_get_longest_ancestor [283]
> [284]    0.0    0.00        0.00      13         svn_uri_get_longest_ancestor [284]
>                 0.00        0.00      26/33          svn_path_is_url [264]
>
> -----------------------------------------------
>
>                 0.00        0.00      13/13          svn_utf_cstring_to_utf8 [203]
> [285]    0.0    0.00        0.00      13         svn_utf__cstring_is_valid [285]
>
> -----------------------------------------------
>
>                 0.00        0.00       4/10          translated_stream_read	<cycle 1> [195]
>                 0.00        0.00       6/10          svn_config__parse_file [173]
> [286]    0.0    0.00        0.00      10         svn_stringbuf_setempty [286]
>
> -----------------------------------------------
>
>                 0.00        0.00       8/8           svn_fs_fs__initialize_caches [97]
> [287]    0.0    0.00        0.00       8         svn_cache__set_error_handler [287]
>
> -----------------------------------------------
>
>                 0.00        0.00       8/8           svn_ver_check_list [300]
> [288]    0.0    0.00        0.00       8         svn_ver_compatible [288]
>
> -----------------------------------------------
>
>                 0.00        0.00       7/7           svn_uri_canonicalize [290]
> [289]    0.0    0.00        0.00       7         canonicalize [289]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/7           svn_uri_internal_style [333]
>                 0.00        0.00       6/7           svn_uri_local_style [293]
> [290]    0.0    0.00        0.00       7         svn_uri_canonicalize [290]
>                 0.00        0.00       7/7           canonicalize [289]
>
> -----------------------------------------------
>
>                 0.00        0.00       6/6           do_io_file_wrapper_cleanup [71]
> [291]    0.0    0.00        0.00       6         svn_error__locate [291]
>
> -----------------------------------------------
>
>                 0.00        0.00       6/6           do_io_file_wrapper_cleanup [71]
> [292]    0.0    0.00        0.00       6         svn_path_local_style [292]
>                 0.00        0.00       6/6           svn_uri_local_style [293]
>
> -----------------------------------------------
>
>                 0.00        0.00       6/6           svn_path_local_style [292]
> [293]    0.0    0.00        0.00       6         svn_uri_local_style [293]
>                 0.00        0.00       6/7           svn_uri_canonicalize [290]
>                 0.00        0.00       6/33          svn_path_is_url [264]
>
> -----------------------------------------------
>
>                 0.00        0.00       4/4           svn_config_get [232]
> [294]    0.0    0.00        0.00       4         expand_option_value [294]
>
> -----------------------------------------------
>
>                 0.00        0.00       4/4           svn_config_get_bool [233]
> [295]    0.0    0.00        0.00       4         get_bool [295]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/4           svn_repos_verify_fs [7]
>                 0.00        0.00       3/4           subcommand_verify [6]
> [296]    0.0    0.00        0.00       4         svn_repos_fs [296]
>
> -----------------------------------------------
>
>                 0.00        0.00       3/3           svn_ver_check_list [300]
> [297]    0.0    0.00        0.00       3         svn_delta_version [297]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/3           svn_ver_check_list [300]
>                 0.00        0.00       2/3           get_library_vtable_direct [304]
> [298]    0.0    0.00        0.00       3         svn_fs_version [298]
>
> -----------------------------------------------
>
>                 0.00        0.00       3/3           svn_ver_check_list [300]
> [299]    0.0    0.00        0.00       3         svn_subr_version [299]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/3           main [321]
>                 0.00        0.00       2/3           svn_fs_fs__init [308]
> [300]    0.0    0.00        0.00       3         svn_ver_check_list [300]
>                 0.00        0.00       8/8           svn_ver_compatible [288]
>                 0.00        0.00       3/3           svn_delta_version [297]
>                 0.00        0.00       3/3           svn_subr_version [299]
>                 0.00        0.00       1/3           svn_fs_version [298]
>                 0.00        0.00       1/1           svn_repos_version [332]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           apr_pool_destroy [46]
> [301]    0.0    0.00        0.00       2         close_apr [301]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_fs_open [95]
> [302]    0.0    0.00        0.00       2         fs_serialized_init [302]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           get_library_vtable_direct [304]
> [303]    0.0    0.00        0.00       2         fs_version [303]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_fs_open [95]
> [304]    0.0    0.00        0.00       2         get_library_vtable_direct [304]
>                 0.00        0.00       2/3           svn_fs_version [298]
>                 0.00        0.00       2/2           svn_fs_fs__init [308]
>                 0.00        0.00       2/2           fs_version [303]
>                 0.00        0.00       2/2           svn_ver_equal [317]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           subcommand_verify [6]
> [305]    0.0    0.00        0.00       2         get_revnum [305]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_opt_parse_revision [329]
> [306]    0.0    0.00        0.00       2         parse_one_rev [306]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_sqlite__open [313]
> [307]    0.0    0.00        0.00       2         svn_atomic__init_once [307]
>                 0.00        0.00       1/1           init_sqlite [320]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           get_library_vtable_direct [304]
> [308]    0.0    0.00        0.00       2         svn_fs_fs__init [308]
>                 0.00        0.00       2/3           svn_ver_check_list [300]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           subcommand_verify [6]
> [309]    0.0    0.00        0.00       2         svn_fs_set_warning_func [309]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_sqlite__open [313]
> [310]    0.0    0.00        0.00       2         svn_sqlite__column_int [310]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_sqlite__open [313]
> [311]    0.0    0.00        0.00       2         svn_sqlite__exec [311]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_sqlite__open [313]
> [312]    0.0    0.00        0.00       2         svn_sqlite__finalize [312]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_fs_fs__open_rep_cache [226]
> [313]    0.0    0.00        0.00       2         svn_sqlite__open [313]
>                 0.00        0.00       2/2           svn_atomic__init_once [307]
>                 0.00        0.00       2/2           svn_sqlite__exec [311]
>                 0.00        0.00       2/2           svn_sqlite__prepare [314]
>                 0.00        0.00       2/2           svn_sqlite__step_row [316]
>                 0.00        0.00       2/2           svn_sqlite__column_int [310]
>                 0.00        0.00       2/2           svn_sqlite__finalize [312]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_sqlite__open [313]
> [314]    0.0    0.00        0.00       2         svn_sqlite__prepare [314]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_sqlite__step_row [316]
> [315]    0.0    0.00        0.00       2         svn_sqlite__step [315]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           svn_sqlite__open [313]
> [316]    0.0    0.00        0.00       2         svn_sqlite__step_row [316]
>                 0.00        0.00       2/2           svn_sqlite__step [315]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           get_library_vtable_direct [304]
> [317]    0.0    0.00        0.00       2         svn_ver_equal [317]
>
> -----------------------------------------------
>
>                                        2             svn_stream_close	<cycle 3> [126]
> [318]    0.0    0.00        0.00       2         translated_stream_close	<cycle 3> [318]
>                                        2             svn_stream_close	<cycle 3> [126]
>
> -----------------------------------------------
>
>                 0.00        0.00       2/2           apr_pool_destroy [46]
> [319]    0.0    0.00        0.00       2         xlate_handle_node_cleanup [319]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           svn_atomic__init_once [307]
> [320]    0.0    0.00        0.00       1         init_sqlite [320]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           _start [3195]
> [321]    0.0    0.00        0.00       1         main [321]
>                 0.00        0.00       1/1           svn_cmdline_init [324]
>                 0.00        0.00       1/150515      svn_pool_create_ex [248]
>                 0.00        0.00       1/3           svn_ver_check_list [300]
>                 0.00        0.00       1/1           svn_fs_initialize [326]
>                 0.00        0.00       1/1           svn_cmdline__getopt_init [322]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           main [321]
> [322]    0.0    0.00        0.00       1         svn_cmdline__getopt_init [322]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           .L554 [5]
> [323]    0.0    0.00        0.00       1         svn_cmdline_fflush [323]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           main [321]
> [324]    0.0    0.00        0.00       1         svn_cmdline_init [324]
>                 0.00        0.00       1/1           svn_dso_initialize2 [325]
>                 0.00        0.00       1/150515      svn_pool_create_ex [248]
>                 0.00        0.00       1/1           svn_utf_initialize [334]
>                 0.00        0.00       1/1           svn_nls_init [327]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           svn_cmdline_init [324]
> [325]    0.0    0.00        0.00       1         svn_dso_initialize2 [325]
>                 0.00        0.00       1/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           main [321]
> [326]    0.0    0.00        0.00       1         svn_fs_initialize [326]
>                 0.00        0.00       1/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           svn_cmdline_init [324]
> [327]    0.0    0.00        0.00       1         svn_nls_init [327]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           .L554 [5]
> [328]    0.0    0.00        0.00       1         svn_opt_get_canonical_subcommand2 [328]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           .L548 [1142]
> [329]    0.0    0.00        0.00       1         svn_opt_parse_revision [329]
>                 0.00        0.00       2/2           parse_one_rev [306]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           .L554 [5]
> [330]    0.0    0.00        0.00       1         svn_opt_subcommand_takes_option3 [330]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           parse_local_repos_path [227]
> [331]    0.0    0.00        0.00       1         svn_path_internal_style [331]
>                 0.00        0.00       1/1           svn_uri_internal_style [333]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           svn_ver_check_list [300]
> [332]    0.0    0.00        0.00       1         svn_repos_version [332]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           svn_path_internal_style [331]
> [333]    0.0    0.00        0.00       1         svn_uri_internal_style [333]
>                 0.00        0.00       1/7           svn_uri_canonicalize [290]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           svn_cmdline_init [324]
> [334]    0.0    0.00        0.00       1         svn_utf_initialize [334]
>                 0.00        0.00       1/150515      svn_pool_create_ex [248]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           apr_pool_destroy [46]
> [335]    0.0    0.00        0.00       1         uninit [335]
>
> -----------------------------------------------
>
>                 0.00        0.00       1/1           apr_pool_destroy [46]
> [336]    0.0    0.00        0.00       1         xlate_cleanup [336]
>
> -----------------------------------------------
>
> 
> /*
>  * Copyright (c) 1998 by Sun Microsystems, Inc.
>  * All rights reserved.
>  */
>
> #pragma ident	"@(#)gprof.flat.blurb	1.9	98/04/09 SMI"
>
>
> flat profile:
>
>  %         the percentage of the total running time of the
> time       program used by this function.
>
> cumulative a running sum of the number of seconds accounted
>  seconds   for by this function and those listed above it.
>
>  self      the number of seconds accounted for by this
> seconds    function alone.  This is the major sort for this
>            listing.
>
> calls      the number of times this function was invoked, if
>            this function is profiled, else blank.
>
>  self      the average number of milliseconds spent in this
> ms/call    function per call, if this function is profiled,
> 	   else blank.
>
>  total     the average number of milliseconds spent in this
> ms/call    function and its descendents per call, if this
> 	   function is profiled, else blank.
>
> name       the name of the function.  This is the minor sort
>            for this listing. The index shows the location of
> 	   the function in the gprof listing. If the index is
> 	   in parenthesis it shows where it would appear in
> 	   the gprof listing if it were to be printed.
>
> Index by function names and Object modules listing:
>
>            The index entries are mapped to the function names.
>            If the same function name appears in multiple object
>            modules, each of these names is prefixed with a
>            module identifier followed by a colon. The shared
>            object modules listing that follows maps these
>            identifiers to appropriate objects.
>
> 
>
>
>
> granularity: each sample hit covers 4 byte(s) for 0.00% of 300.21 seconds
>
>    %  cumulative    self              self    total
>  time   seconds   seconds    calls  ms/call  ms/call name
>  25.8      77.59    77.59                            apr_hash_next [1]
>  14.7     121.86    44.27                            apr_hashfunc_default [2]
>  11.4     156.17    34.31                            apr_hash_set [3]
>  11.1     189.61    33.44                            apr_palloc [4]
>   8.6     215.53    25.91                            internal_mcount [15]
>   5.5     232.01    16.49                            apr_pstrdup [22]
>   5.4     248.09    16.07   277320     0.06     0.09  dup_dir_listing [16]
>   4.8     262.46    14.38                            apr_pool_create_ex_debug [25]
>   3.3     272.25     9.78 917256572     0.00     0.00  svn_fs_fs__id_copy [26]
>   1.8     277.51     5.27                            apr_hash_this [30]
>   1.1     280.89     3.38                            apr_strfsize [34]
>   1.1     284.14     3.25                            apr_hash_pool_get [35]
>   0.8     286.68     2.53   626196     0.00     0.00  svn_fs_fs__id_parse [36]
>   0.5     288.10     1.42                            _mcount (3194)
>   0.3     288.92     0.82                            file_read_buffered [42]
>   0.2     289.50     0.59                            apr_pool_destroy [46]
>   0.2     290.05     0.54  2367079     0.00     0.00  svn_stream_readline [37]
>   0.2     290.54     0.49                            mcount (1846)
>   0.2     291.02     0.48 49162605     0.00     0.00  svn_io_file_read_full [49]
>   0.2     291.48     0.46                            apr_file_read [50]
>   0.2     291.94     0.46                            apr_file_read_full [51]
>   0.1     292.37     0.43 49166469     0.00     0.00  svn_stream_read	<cycle 1> [40]
>   0.1     292.75     0.38                            apr_hash_get [52]
>   0.1     293.12     0.37 47021444     0.00     0.00  read_handler_apr [41]
>   0.1     293.38     0.26 48556378     0.00     0.00  svn_stringbuf_appendbytes [48]
>   0.1     293.62     0.24 48556405     0.00     0.00  svn_stringbuf_ensure [57]
>   0.1     293.86     0.24                            moncontrol [58]
>   0.1     294.10     0.24                            svn_io_files_contents_same_p [59]
>   0.1     294.29     0.19                            svn_string_from_stream [63]
>   0.1     294.47     0.18                            .L744 [65]
>   0.1     294.63     0.16  2520206     0.00     0.00  svn_uri_is_canonical [69]
>   0.1     294.79     0.16                            svn_cstring_casecmp [70]
>   0.0     294.94     0.15 49760247     0.00     0.00  do_io_file_wrapper_cleanup [71]
>   0.0     295.08     0.14                            .L546 [74]
>   0.0     295.21     0.13   138630     0.00     0.13  open_path [19]
>   0.0     295.32     0.11   564463     0.00     0.00  svn_utf__is_valid [77]
>   0.0     295.43     0.11                            apr_file_writev_full [76]
>   0.0     295.53     0.10   564463     0.00     0.00  svn_utf_cstring_from_utf8 [56]
>   0.0     295.63     0.10                            apr_strtok [78]
>   0.0     295.72     0.09   282212     0.00     0.00  svn_fs_fs__path_rev_absolute [47]
>   0.0     295.81     0.09   282212     0.00     0.00  svn_path_join_many [72]
>   0.0     295.90     0.09   277364     0.00     0.02  svn_fs_fs__read_noderev [33]
>   0.0     295.99     0.09                            .L395 [79]
>   0.0     296.08     0.09                            apr_file_printf [80]
>   0.0     296.16     0.08   416185     0.00     0.00  svn_fs__canonicalize_abspath [83]
>   0.0     296.24     0.08   145356     0.00     0.01  inprocess_cache_set [44]
>   0.0     296.31     0.07   693321     0.00     0.00  copy_node_revision [73]
>   0.0     296.38     0.07   197714     0.00     0.00  svn_checksum_parse_hex [84]
>   0.0     296.44     0.06   970683     0.00     0.03  inprocess_cache_get [18]
>   0.0     296.50     0.06   277385     0.00     0.01  read_header_block [38]
>   0.0     296.56     0.06                            MD5Transform [86]
>   0.0     296.62     0.06                            apr_stat [87]
>   0.0     296.67     0.05  2141183     0.00     0.00  rep_read_contents	<cycle 1> [81]
>   0.0     296.72     0.05   564476     0.00     0.00  get_xlate_handle_node [91]
>   0.0     296.77     0.05   282212     0.00     0.00  svn_io_check_path [60]
>   0.0     296.82     0.05                            apr_file_flush [88]
>   0.0     296.87     0.05                            apr_pvsprintf [89]
>   0.0     296.92     0.05                            svn_fs_fs__dag_get_copyfrom_path [90]
>   0.0     296.96     0.04   693321     0.00     0.00  svn_fs_fs__dag_dup [61]
>   0.0     297.00     0.04   277364     0.00     0.02  svn_fs_fs__get_node_revision [32]
>   0.0     297.04     0.04   138714     0.00     0.00  svn_dirent_is_root [103]
>   0.0     297.08     0.04                            apr_pool_clear [98]
>   0.0     297.12     0.04                            apr_thread_mutex_lock [99]
>   0.0     297.16     0.04                            apr_vformatter [100]
>   0.0     297.20     0.04                            svn_fs_fs__pack [101]
>   0.0     297.24     0.04                            svn_utf_cstring_from_utf8_string [102]
>   0.0     297.27     0.03   970683     0.00     0.03  svn_cache__get [17]
>   0.0     297.30     0.03   564476     0.00     0.00  put_xlate_handle_node [109]
>   0.0     297.33     0.03   564442     0.00     0.00  svn_path_cstring_from_utf8 [55]
>   0.0     297.36     0.03   287126     0.00     0.00  svn_io_file_seek [106]
>   0.0     297.39     0.03   138661     0.00     0.05  svn_fs_fs__dag_open [29]
>   0.0     297.42     0.03        2    15.00    20.00  svn_fs_fs__initialize_caches [97]
>   0.0     297.45     0.03                            apr_thread_mutex_pool_get [107]
>   0.0     297.48     0.03                            apr_thread_mutex_unlock [108]
>   0.0     297.50     0.02  2931697     0.00     0.00  svn_stringbuf_create_ensure [111]
>   0.0     297.52     0.02  1386642     0.00     0.00  svn_fs_fs__rep_copy [85]
>   0.0     297.54     0.02   821297     0.00     0.00  svn_checksum_create [118]
>   0.0     297.56     0.02   618800     0.00     0.00  svn_checksum__from_digest [105]
>   0.0     297.58     0.02   282268     0.00     0.00  svn_stream_create [117]
>   0.0     297.60     0.02   282212     0.00     0.00  io_check_path [64]
>   0.0     297.62     0.02   277364     0.00     0.02  svn_fs_fs__dag_get_node [31]
>   0.0     297.64     0.02   145356     0.00     0.01  svn_cache__set [43]
>   0.0     297.66     0.02   138661     0.00     0.24  verify_directory_entry [13]
>   0.0     297.68     0.02     6674     0.00     0.09  parse_dir_entries [45]
>   0.0     297.70     0.02                            apr_hash_first [112]
>   0.0     297.72     0.02                            apr_hash_make [113]
>   0.0     297.74     0.02                            apr_pool_cleanup_register [114]
>   0.0     297.76     0.02                            apr_vsnprintf [115]
>   0.0     297.78     0.02                            svn_path_splitext [116]
>   0.0     297.79     0.01  2520206     0.00     0.00  svn_path_is_canonical [67]
>   0.0     297.80     0.01  2141183     0.00     0.00  svn_checksum_update [145]
>   0.0     297.81     0.01  1452221     0.00     0.00  svn_fs_fs__id_txn_id [148]
>   0.0     297.82     0.01  1232105     0.00     0.00  svn_checksum_dup [92]
>   0.0     297.83     0.01   693321     0.00     0.00  svn_fs_fs__dag_check_mutable [120]
>   0.0     297.84     0.01   564476     0.00     0.00  convert_to_stringbuf [121]
>   0.0     297.85     0.01   554691     0.00     0.00  svn_fs_fs__dag_dup_for_cache [66]
>   0.0     297.86     0.01   415818     0.00     0.00  svn_fs_fs__dag_node_kind [146]
>   0.0     297.87     0.01   415787     0.00     0.00  svn_fs__next_entry_name [147]
>   0.0     297.88     0.01   282233     0.00     0.00  ensure_revision_exists [130]
>   0.0     297.89     0.01   282212     0.00     0.00  path_rev [62]
>   0.0     297.90     0.01   277555     0.00     0.09  get_dag [14]
>   0.0     297.91     0.01   277411     0.00     0.00  svn_stream_from_aprfile2 [110]
>   0.0     297.92     0.01   277366     0.00     0.00  close_handler_apr [127]
>   0.0     297.93     0.01   277320     0.00     0.03  svn_fs_fs__dag_dir_entries [27]
>   0.0     297.94     0.01   197542     0.00     0.00  read_rep_offsets [82]
>   0.0     297.95     0.01   138659     0.00     0.12  fs_dir_entries [20]
>   0.0     297.96     0.01     4783     0.00     0.07  hash_read [54]
>   0.0     297.97     0.01       84     0.12   390.73  svn_iter_apr_hash [12]
>   0.0     297.98     0.01        8     1.25     1.25  svn_cache__create_inprocess [131]
>   0.0     297.99     0.01                            .L173 [132]
>   0.0     298.00     0.01                            apr_allocator_mutex_get [133]
>   0.0     298.01     0.01                            apr_atoi64 [134]
>   0.0     298.02     0.01                            apr_file_open [135]
>   0.0     298.03     0.01                            apr_file_pool_get [136]
>   0.0     298.04     0.01                            apr_pool_create_ex [137]
>   0.0     298.05     0.01                            apr_unix_file_cleanup [138]
>   0.0     298.06     0.01                            apr_unix_mode2perms [139]
>   0.0     298.07     0.01                            apr_xlate_conv_buffer [140]
>   0.0     298.08     0.01                            free_proc_chain [141]
>   0.0     298.09     0.01                            svn_cache__iter [142]
>   0.0     298.10     0.01                            svn_checksum_size [143]
>   0.0     298.11     0.01                            svn_dirent_join [144]
>   0.0     298.11     0.00  2367079     0.00     0.00  svn_stringbuf_chop [236]
>   0.0     298.11     0.00   970612     0.00     0.00  svn_fs_fs__dag_get_id [237]
>   0.0     298.11     0.00   836751     0.00     0.00  svn_path_join [75]
>   0.0     298.11     0.00   416030     0.00     0.00  svn_fs_fs__dag_set_fs [238]
>   0.0     298.11     0.00   282267     0.00     0.00  svn_stream_set_read [239]
>   0.0     298.11     0.00   282230     0.00     0.00  svn_io_file_open [68]
>   0.0     298.11     0.00   282201     0.00     0.00  svn_stream_close	<cycle 3> [126]
>   0.0     298.11     0.00   282174     0.00     0.00  svn_stream_set_close [240]
>   0.0     298.11     0.00   277462     0.00     0.00  svn_stream_set_write [241]
>   0.0     298.11     0.00   277424     0.00     0.00  svn_io_file_close [165]
>   0.0     298.11     0.00   277364     0.00     0.00  svn_fs_fs__id_offset [242]
>   0.0     298.11     0.00   277364     0.00     0.00  svn_fs_fs__id_rev [243]
>   0.0     298.11     0.00   277320     0.00     0.00  svn_fs_fs__id_unparse [244]
>   0.0     298.11     0.00   277320     0.00     0.03  svn_fs_fs__rep_contents_dir [28]
>   0.0     298.11     0.00   277320     0.00     0.00  svn_string_createf [245]
>   0.0     298.11     0.00   277320     0.00     0.00  svn_string_createv [246]
>   0.0     298.11     0.00   151602     0.00     0.00  svn_string_ncreate [247]
>   0.0     298.11     0.00   150515     0.00     0.00  svn_pool_create_ex [248]
>   0.0     298.11     0.00   138661     0.00     0.11  svn_fs_check_path [23]
>   0.0     298.11     0.00   138661     0.00     0.11  svn_fs_fs__check_path [24]
>   0.0     298.11     0.00   138661     0.00     0.00  svn_fs_fs__dag_get_fs [249]
>   0.0     298.11     0.00   138661     0.00     0.00  svn_path_is_single_path_component [104]
>   0.0     298.11     0.00   138659     0.00     0.12  svn_fs_dir_entries [21]
>   0.0     298.11     0.00    33048     0.00     0.00  svn_io_file_getc [175]
>   0.0     298.11     0.00     4913     0.00     0.00  svn_io_read_length_line [176]
>   0.0     298.11     0.00     4806     0.00     0.00  create_rep_state_body [124]
>   0.0     298.11     0.00     4806     0.00     0.00  read_rep_line [177]
>   0.0     298.11     0.00     4806     0.00     0.00  read_representation [123]
>   0.0     298.11     0.00     4806     0.00     0.00  rep_read_contents_close [250]
>   0.0     298.11     0.00     4806     0.00     0.00  svn_checksum_ctx_create [251]
>   0.0     298.11     0.00     4783     0.00     0.00  svn_checksum_final [174]
>   0.0     298.11     0.00     4783     0.00     0.00  svn_checksum_match [252]
>   0.0     298.11     0.00     4783     0.00     0.07  svn_hash_read2 [53]
>   0.0     298.11     0.00     4783     0.00     0.00  svn_md5__digests_match [253]
>   0.0     298.11     0.00     3842     0.00     0.00  translated_stream_read	<cycle 1> [195]
>   0.0     298.11     0.00      560     0.00     0.00  svn_stream_write	<cycle 2> [180]
>   0.0     298.11     0.00      352     0.00     0.00  write_handler_empty [254]
>   0.0     298.11     0.00      281     0.00     0.00  check_cancel [255]
>   0.0     298.11     0.00      260     0.00     0.00  svn_stream_printf [188]
>   0.0     298.11     0.00      142     0.00     0.00  svn_stringbuf_ncreate [219]
>   0.0     298.11     0.00      142     0.00     0.00  write_handler_stringbuf [211]
>   0.0     298.11     0.00      109     0.00     0.09  fs_file_length [128]
>   0.0     298.11     0.00      109     0.00     0.09  svn_fs_file_length [129]
>   0.0     298.11     0.00      109     0.00     0.00  svn_fs_fs__dag_file_length [256]
>   0.0     298.11     0.00      109     0.00     0.00  svn_fs_fs__file_length [257]
>   0.0     298.11     0.00       94     0.00     0.00  svn_stringbuf_create [220]
>   0.0     298.11     0.00       84     0.00   390.85  close_directory [10]
>   0.0     298.11     0.00       84     0.00     0.00  make_dir_baton [187]
>   0.0     298.11     0.00       84     0.00   390.85  verify_close_directory [11]
>   0.0     298.11     0.00       69     0.00     0.09  fs_file_checksum [151]
>   0.0     298.11     0.00       69     0.00     0.00  svn_checksum_to_cstring [258]
>   0.0     298.11     0.00       69     0.00     0.09  svn_fs_file_checksum [152]
>   0.0     298.11     0.00       69     0.00     0.00  svn_fs_fs__dag_file_checksum [198]
>   0.0     298.11     0.00       69     0.00     0.00  svn_fs_fs__file_checksum [199]
>   0.0     298.11     0.00       55     0.00     0.00  read_change [170]
>   0.0     298.11     0.00       52     0.00     0.00  open_directory [191]
>   0.0     298.11     0.00       52     0.00     0.00  open_directory [190]
>   0.0     298.11     0.00       48     0.00     0.00  zlib_decode [223]
>   0.0     298.11     0.00       46     0.00     0.00  svn_md5__digest_to_cstring [259]
>   0.0     298.11     0.00       46     0.00     0.00  svn_md5__digest_to_cstring_display [260]
>   0.0     298.11     0.00       46     0.00     0.00  svn_stringbuf_appendcstr [221]
>   0.0     298.11     0.00       45     0.00     0.00  write_handler_disown	<cycle 2> [261]
>   0.0     298.11     0.00       44     0.00     0.00  svn_io_file_read [229]
>   0.0     298.11     0.00       42     0.00     0.00  dup_id [222]
>   0.0     298.11     0.00       42     0.00     0.00  get_root_changes_offset [186]
>   0.0     298.11     0.00       42     0.00     0.00  svn_delta_default_editor [262]
>   0.0     298.11     0.00       42     0.00     0.00  svn_fs__check_fs [263]
>   0.0     298.11     0.00       42     0.00     0.06  svn_fs_fs__dag_revision_root [157]
>   0.0     298.11     0.00       42     0.00     0.04  svn_fs_fs__rev_get_root [164]
>   0.0     298.11     0.00       42     0.00     0.06  svn_fs_fs__revision_root [158]
>   0.0     298.11     0.00       42     0.00     0.06  svn_fs_revision_root [159]
>   0.0     298.11     0.00       34     0.00     0.40  dump_node [122]
>   0.0     298.11     0.00       34     0.00     0.15  fs_node_proplist [153]
>   0.0     298.11     0.00       34     0.00     0.47  path_driver_cb_func [119]
>   0.0     298.11     0.00       34     0.00     0.05  svn_fs_fs__dag_get_proplist [162]
>   0.0     298.11     0.00       34     0.00     0.05  svn_fs_fs__get_proplist [163]
>   0.0     298.11     0.00       34     0.00     0.15  svn_fs_node_proplist [154]
>   0.0     298.11     0.00       34     0.00     0.00  svn_path_basename [201]
>   0.0     298.11     0.00       34     0.00     0.00  svn_path_dirname [202]
>   0.0     298.11     0.00       34     0.00     0.00  svn_path_split [193]
>   0.0     298.11     0.00       34     0.00     0.00  write_hash_to_stringbuf [206]
>   0.0     298.11     0.00       33     0.00     0.00  svn_path_is_url [264]
>   0.0     298.11     0.00       30     0.00     0.00  svn_error_clear [265]
>   0.0     298.11     0.00       27     0.00     0.00  svn_stringbuf_appendstr [225]
>   0.0     298.11     0.00       24     0.00     0.00  decode_window [215]
>   0.0     298.11     0.00       24     0.00     0.00  read_window	<cycle 1> [192]
>   0.0     298.11     0.00       24     0.00     0.00  read_window_header	<cycle 1> [266]
>   0.0     298.11     0.00       24     0.00     0.00  svn_txdelta_apply_instructions [267]
>   0.0     298.11     0.00       24     0.00     0.00  svn_txdelta_read_svndiff_window	<cycle 1> [216]
>   0.0     298.11     0.00       23     0.00     0.40  add_file [149]
>   0.0     298.11     0.00       23     0.00     0.40  add_file [150]
>   0.0     298.11     0.00       23     0.00     0.00  apply_textdelta [268]
>   0.0     298.11     0.00       23     0.00     0.00  apply_textdelta [269]
>   0.0     298.11     0.00       23     0.00     0.00  change_file_prop [270]
>   0.0     298.11     0.00       23     0.00     0.00  change_prop [271]
>   0.0     298.11     0.00       23     0.00     0.00  close_file [273]
>   0.0     298.11     0.00       23     0.00     0.00  close_file [272]
>   0.0     298.11     0.00       23     0.00     0.10  fs_file_contents [160]
>   0.0     298.11     0.00       23     0.00     0.00  svn_delta_noop_window_handler [274]
>   0.0     298.11     0.00       23     0.00     0.10  svn_fs_file_contents [161]
>   0.0     298.11     0.00       23     0.00     0.00  svn_fs_fs__dag_get_contents [178]
>   0.0     298.11     0.00       23     0.00     0.00  svn_fs_fs__get_contents [275]
>   0.0     298.11     0.00       23     0.00     0.00  svn_sha1__digest_to_cstring [276]
>   0.0     298.11     0.00       23     0.00     0.00  svn_sha1__digest_to_cstring_display [277]
>   0.0     298.11     0.00       23     0.00     0.00  svn_stream_copy3 [194]
>   0.0     298.11     0.00       23     0.00     0.00  svn_stream_disown [207]
>   0.0     298.11     0.00       21     0.00     0.01  fetch_all_changes [169]
>   0.0     298.11     0.00       21     0.00     0.01  fs_paths_changed [166]
>   0.0     298.11     0.00       21     0.00     0.00  open_root [205]
>   0.0     298.11     0.00       21     0.00     0.00  open_root [204]
>   0.0     298.11     0.00       21     0.00     0.00  recode_write [181]
>   0.0     298.11     0.00       21     0.00     0.00  set_target_revision [278]
>   0.0     298.11     0.00       21     0.00     0.00  set_target_revision [279]
>   0.0     298.11     0.00       21     0.00     0.00  svn_cmdline_cstring_from_utf8 [182]
>   0.0     298.11     0.00       21     0.00     0.00  svn_cmdline_fputs [183]
>   0.0     298.11     0.00       21     0.00     0.00  svn_delta_get_cancellation_editor [280]
>   0.0     298.11     0.00       21     0.00  1564.16  svn_delta_path_driver [9]
>   0.0     298.11     0.00       21     0.00     0.01  svn_fs_fs__paths_changed [167]
>   0.0     298.11     0.00       21     0.00     0.00  svn_fs_is_revision_root [281]
>   0.0     298.11     0.00       21     0.00     0.01  svn_fs_paths_changed2 [168]
>   0.0     298.11     0.00       21     0.00     0.00  svn_fs_revision_root_revision [282]
>   0.0     298.11     0.00       21     0.00     0.00  svn_path_is_empty [189]
>   0.0     298.11     0.00       21     0.00  1564.17  svn_repos_replay2 [8]
>   0.0     298.11     0.00       21     0.00     0.00  svn_stream_empty [210]
>   0.0     298.11     0.00       16     0.00     0.00  svn_path_compare_paths [184]
>   0.0     298.11     0.00       13     0.00     0.00  svn_path_get_longest_ancestor [283]
>   0.0     298.11     0.00       13     0.00     0.00  svn_uri_get_longest_ancestor [284]
>   0.0     298.11     0.00       13     0.00     0.00  svn_utf__cstring_is_valid [285]
>   0.0     298.11     0.00       13     0.00     0.00  svn_utf_cstring_to_utf8 [203]
>   0.0     298.11     0.00       11     0.00     0.40  add_directory [156]
>   0.0     298.11     0.00       11     0.00     0.40  add_directory [155]
>   0.0     298.11     0.00       10     0.00     0.00  svn_stringbuf_setempty [286]
>   0.0     298.11     0.00        8     0.00     0.00  svn_cache__set_error_handler [287]
>   0.0     298.11     0.00        8     0.00     0.00  svn_ver_compatible [288]
>   0.0     298.11     0.00        8     0.00     0.00  translate_chunk [196]
>   0.0     298.11     0.00        7     0.00     0.00  canonicalize [289]
>   0.0     298.11     0.00        7     0.00     0.00  svn_uri_canonicalize [290]
>   0.0     298.11     0.00        6     0.00     0.00  find_option [230]
>   0.0     298.11     0.00        6     0.00     0.00  svn_error__locate [291]
>   0.0     298.11     0.00        6     0.00     0.00  svn_error_wrap_apr [217]
>   0.0     298.11     0.00        6     0.00     0.00  svn_path_cstring_to_utf8 [218]
>   0.0     298.11     0.00        6     0.00     0.00  svn_path_local_style [292]
>   0.0     298.11     0.00        6     0.00     0.00  svn_stringbuf_set [231]
>   0.0     298.11     0.00        6     0.00     0.00  svn_uri_local_style [293]
>   0.0     298.11     0.00        4     0.00     0.00  expand_option_value [294]
>   0.0     298.11     0.00        4     0.00     0.00  get_bool [295]
>   0.0     298.11     0.00        4     0.00     0.00  read_current [200]
>   0.0     298.11     0.00        4     0.00     0.00  svn_config_get [232]
>   0.0     298.11     0.00        4     0.00     0.00  svn_config_get_bool [233]
>   0.0     298.11     0.00        4     0.00     0.00  svn_fs_type [197]
>   0.0     298.11     0.00        4     0.00     0.00  svn_repos_fs [296]
>   0.0     298.11     0.00        4     0.00     0.00  svn_stream_from_stringbuf [224]
>   0.0     298.11     0.00        3     0.00     0.00  svn_delta_version [297]
>   0.0     298.11     0.00        3     0.00     0.00  svn_fs_version [298]
>   0.0     298.11     0.00        3     0.00     0.00  svn_subr_version [299]
>   0.0     298.11     0.00        3     0.00     0.00  svn_ver_check_list [300]
>   0.0     298.11     0.00        2     0.00     0.00  close_apr [301]
>   0.0     298.11     0.00        2     0.00    20.06  fs_open [96]
>   0.0     298.11     0.00        2     0.00     0.00  fs_serialized_init [302]
>   0.0     298.11     0.00        2     0.00     0.00  fs_version [303]
>   0.0     298.11     0.00        2     0.00     0.00  get_library_vtable_direct [304]
>   0.0     298.11     0.00        2     0.00    20.07  get_repos [93]
>   0.0     298.11     0.00        2     0.00     0.00  get_revnum [305]
>   0.0     298.11     0.00        2     0.00     0.00  parse_one_rev [306]
>   0.0     298.11     0.00        2     0.00     0.00  read_format [213]
>   0.0     298.11     0.00        2     0.00     0.00  svn_atomic__init_once [307]
>   0.0     298.11     0.00        2     0.00     0.00  svn_cache__make_memcache_from_config [234]
>   0.0     298.11     0.00        2     0.00     0.06  svn_config__parse_file [173]
>   0.0     298.11     0.00        2     0.00     0.00  svn_config_enumerate2 [235]
>   0.0     298.11     0.00        2     0.00     0.06  svn_config_read [172]
>   0.0     298.11     0.00        2     0.00     0.00  svn_fs_fs__init [308]
>   0.0     298.11     0.00        2     0.00     0.06  svn_fs_fs__open [171]
>   0.0     298.11     0.00        2     0.00     0.00  svn_fs_fs__open_rep_cache [226]
>   0.0     298.11     0.00        2     0.00     0.00  svn_fs_fs__youngest_rev [208]
>   0.0     298.11     0.00        2     0.00    20.06  svn_fs_open [95]
>   0.0     298.11     0.00        2     0.00     0.00  svn_fs_set_warning_func [309]
>   0.0     298.11     0.00        2     0.00     0.00  svn_fs_youngest_rev [209]
>   0.0     298.11     0.00        2     0.00     0.00  svn_io_read_version_file [214]
>   0.0     298.11     0.00        2     0.00    20.07  svn_repos_open [94]
>   0.0     298.11     0.00        2     0.00     0.00  svn_sqlite__column_int [310]
>   0.0     298.11     0.00        2     0.00     0.00  svn_sqlite__exec [311]
>   0.0     298.11     0.00        2     0.00     0.00  svn_sqlite__finalize [312]
>   0.0     298.11     0.00        2     0.00     0.00  svn_sqlite__open [313]
>   0.0     298.11     0.00        2     0.00     0.00  svn_sqlite__prepare [314]
>   0.0     298.11     0.00        2     0.00     0.00  svn_sqlite__step [315]
>   0.0     298.11     0.00        2     0.00     0.00  svn_sqlite__step_row [316]
>   0.0     298.11     0.00        2     0.00     0.00  svn_stream_open_readonly [212]
>   0.0     298.11     0.00        2     0.00     0.00  svn_subst_stream_translated [228]
>   0.0     298.11     0.00        2     0.00     0.00  svn_ver_equal [317]
>   0.0     298.11     0.00        2     0.00     0.00  translated_stream_close	<cycle 3> [318]
>   0.0     298.11     0.00        2     0.00     0.00  xlate_handle_node_cleanup [319]
>   0.0     298.11     0.00        1     0.00     0.00  init_sqlite [320]
>   0.0     298.11     0.00        1     0.00     0.00  main [321]
>   0.0     298.11     0.00        1     0.00     0.00  parse_local_repos_path [227]
>   0.0     298.11     0.00        1     0.00 32889.99  subcommand_verify [6]
>   0.0     298.11     0.00        1     0.00     0.00  svn_cmdline__getopt_init [322]
>   0.0     298.11     0.00        1     0.00     0.00  svn_cmdline_fflush [323]
>   0.0     298.11     0.00        1     0.00     0.00  svn_cmdline_init [324]
>   0.0     298.11     0.00        1     0.00     0.00  svn_dso_initialize2 [325]
>   0.0     298.11     0.00        1     0.00     0.00  svn_fs_initialize [326]
>   0.0     298.11     0.00        1     0.00     0.00  svn_nls_init [327]
>   0.0     298.11     0.00        1     0.00     0.00  svn_opt_get_canonical_subcommand2 [328]
>   0.0     298.11     0.00        1     0.00     0.00  svn_opt_parse_revision [329]
>   0.0     298.11     0.00        1     0.00     0.00  svn_opt_subcommand_takes_option3 [330]
>   0.0     298.11     0.00        1     0.00     0.00  svn_path_internal_style [331]
>   0.0     298.11     0.00        1     0.00 32849.86  svn_repos_verify_fs [7]
>   0.0     298.11     0.00        1     0.00     0.00  svn_repos_version [332]
>   0.0     298.11     0.00        1     0.00     0.00  svn_uri_internal_style [333]
>   0.0     298.11     0.00        1     0.00     0.00  svn_utf_initialize [334]
>   0.0     298.11     0.00        1     0.00     0.00  uninit [335]
>   0.0     298.11     0.00        1     0.00     0.00  xlate_cleanup [336]
> 
> Index by function name
>
>  [132] .L173                [38] read_header_block    [60] svn_io_check_path
>   [79] .L395               [177] read_rep_line       [165] svn_io_file_close
>   [74] .L546                [82] read_rep_offsets    [175] svn_io_file_getc
>   [65] .L744               [123] read_representation  [68] svn_io_file_open
>   [86] MD5Transform        [192] read_window         [229] svn_io_file_read
> (3194) _mcount             [266] read_window_header   [49] svn_io_file_read_fu
>  [155] 1:add_directory     [181] recode_write        [106] svn_io_file_seek
>  [156] 1:add_directory      [81] rep_read_contents    [59] svn_io_files_conten
>  [149] 1:add_file          [250] rep_read_contents_c [176] svn_io_read_length_
>  [150] 1:add_file          [279] 1:set_target_revisi [214] svn_io_read_version
>  [268] 1:apply_textdelta   [278] 1:set_target_revisi  [12] svn_iter_apr_hash
>  [269] 1:apply_textdelta     [6] subcommand_verify   [259] svn_md5__digest_to_
>  [133] apr_allocator_mutex [307] svn_atomic__init_on [260] svn_md5__digest_to_
>  [134] apr_atoi64          [131] svn_cache__create_i [253] svn_md5__digests_ma
>   [88] apr_file_flush       [17] svn_cache__get      [327] svn_nls_init
>  [135] apr_file_open       [142] svn_cache__iter     [328] svn_opt_get_canonic
>  [136] apr_file_pool_get   [234] svn_cache__make_mem [329] svn_opt_parse_revis
>   [80] apr_file_printf      [43] svn_cache__set      [330] svn_opt_subcommand_
>   [50] apr_file_read       [287] svn_cache__set_erro [201] svn_path_basename
>   [51] apr_file_read_full  [105] svn_checksum__from_ [184] svn_path_compare_pa
>   [76] apr_file_writev_ful [118] svn_checksum_create  [55] svn_path_cstring_fr
>  [112] apr_hash_first      [251] svn_checksum_ctx_cr [218] svn_path_cstring_to
>   [52] apr_hash_get         [92] svn_checksum_dup    [202] svn_path_dirname
>  [113] apr_hash_make       [174] svn_checksum_final  [283] svn_path_get_longes
>    [1] apr_hash_next       [252] svn_checksum_match  [331] svn_path_internal_s
>   [35] apr_hash_pool_get    [84] svn_checksum_parse_  [67] svn_path_is_canonic
>    [3] apr_hash_set        [143] svn_checksum_size   [189] svn_path_is_empty
>   [30] apr_hash_this       [258] svn_checksum_to_cst [104] svn_path_is_single_
>    [2] apr_hashfunc_defaul [145] svn_checksum_update [264] svn_path_is_url
>    [4] apr_palloc          [322] svn_cmdline__getopt  [75] svn_path_join
>  [114] apr_pool_cleanup_re [182] svn_cmdline_cstring  [72] svn_path_join_many
>   [98] apr_pool_clear      [323] svn_cmdline_fflush  [292] svn_path_local_styl
>  [137] apr_pool_create_ex  [183] svn_cmdline_fputs   [193] svn_path_split
>   [25] apr_pool_create_ex_ [324] svn_cmdline_init    [116] svn_path_splitext
>   [46] apr_pool_destroy    [173] svn_config__parse_f [248] svn_pool_create_ex
>   [22] apr_pstrdup         [235] svn_config_enumerat [296] svn_repos_fs
>   [89] apr_pvsprintf       [232] svn_config_get       [94] svn_repos_open
>   [87] apr_stat            [233] svn_config_get_bool   [8] svn_repos_replay2
>   [34] apr_strfsize        [172] svn_config_read       [7] svn_repos_verify_fs
>   [78] apr_strtok           [70] svn_cstring_casecmp [332] svn_repos_version
>   [99] apr_thread_mutex_lo [262] svn_delta_default_e [276] svn_sha1__digest_to
>  [107] apr_thread_mutex_po [280] svn_delta_get_cance [277] svn_sha1__digest_to
>  [108] apr_thread_mutex_un [274] svn_delta_noop_wind [310] svn_sqlite__column_
>  [138] apr_unix_file_clean   [9] svn_delta_path_driv [311] svn_sqlite__exec
>  [139] apr_unix_mode2perms [297] svn_delta_version   [312] svn_sqlite__finaliz
>  [100] apr_vformatter      [103] svn_dirent_is_root  [313] svn_sqlite__open
>  [115] apr_vsnprintf       [144] svn_dirent_join     [314] svn_sqlite__prepare
>  [140] apr_xlate_conv_buff [325] svn_dso_initialize2 [315] svn_sqlite__step
>  [289] canonicalize        [291] svn_error__locate   [316] svn_sqlite__step_ro
>  [270] change_file_prop    [265] svn_error_clear     [126] svn_stream_close
>  [271] change_prop         [217] svn_error_wrap_apr  [194] svn_stream_copy3
>  [255] check_cancel         [83] svn_fs__canonicaliz [117] svn_stream_create
>  [301] close_apr           [263] svn_fs__check_fs    [207] svn_stream_disown
>   [10] close_directory     [147] svn_fs__next_entry_ [210] svn_stream_empty
>  [273] 1:close_file         [23] svn_fs_check_path   [110] svn_stream_from_apr
>  [272] 1:close_file         [21] svn_fs_dir_entries  [224] svn_stream_from_str
>  [127] close_handler_apr   [152] svn_fs_file_checksu [212] svn_stream_open_rea
>  [121] convert_to_stringbu [161] svn_fs_file_content [188] svn_stream_printf
>   [73] copy_node_revision  [129] svn_fs_file_length   [40] svn_stream_read
>  [124] create_rep_state_bo  [24] svn_fs_fs__check_pa  [37] svn_stream_readline
>  [215] decode_window       [120] svn_fs_fs__dag_chec [240] svn_stream_set_clos
>   [71] do_io_file_wrapper_  [27] svn_fs_fs__dag_dir_ [239] svn_stream_set_read
>  [122] dump_node            [61] svn_fs_fs__dag_dup  [241] svn_stream_set_writ
>   [16] dup_dir_listing      [66] svn_fs_fs__dag_dup_ [180] svn_stream_write
>  [222] dup_id              [198] svn_fs_fs__dag_file [245] svn_string_createf
>  [130] ensure_revision_exi [256] svn_fs_fs__dag_file [246] svn_string_createv
>  [294] expand_option_value [178] svn_fs_fs__dag_get_  [63] svn_string_from_str
>  [169] fetch_all_changes    [90] svn_fs_fs__dag_get_ [247] svn_string_ncreate
>   [42] file_read_buffered  [249] svn_fs_fs__dag_get_  [48] svn_stringbuf_appen
>  [230] find_option         [237] svn_fs_fs__dag_get_ [221] svn_stringbuf_appen
>  [141] free_proc_chain      [31] svn_fs_fs__dag_get_ [225] svn_stringbuf_appen
>   [20] fs_dir_entries      [162] svn_fs_fs__dag_get_ [236] svn_stringbuf_chop
>  [151] fs_file_checksum    [146] svn_fs_fs__dag_node [220] svn_stringbuf_creat
>  [160] fs_file_contents     [29] svn_fs_fs__dag_open [111] svn_stringbuf_creat
>  [128] fs_file_length      [157] svn_fs_fs__dag_revi  [57] svn_stringbuf_ensur
>  [153] fs_node_proplist    [238] svn_fs_fs__dag_set_ [219] svn_stringbuf_ncrea
>   [96] fs_open             [199] svn_fs_fs__file_che [231] svn_stringbuf_set
>  [166] fs_paths_changed    [257] svn_fs_fs__file_len [286] svn_stringbuf_setem
>  [302] fs_serialized_init  [275] svn_fs_fs__get_cont [299] svn_subr_version
>  [303] fs_version           [32] svn_fs_fs__get_node [228] svn_subst_stream_tr
>  [295] get_bool            [163] svn_fs_fs__get_prop [267] svn_txdelta_apply_i
>   [14] get_dag              [26] svn_fs_fs__id_copy  [216] svn_txdelta_read_sv
>  [304] get_library_vtable_ [242] svn_fs_fs__id_offse [290] svn_uri_canonicaliz
>   [93] get_repos            [36] svn_fs_fs__id_parse [284] svn_uri_get_longest
>  [305] get_revnum          [243] svn_fs_fs__id_rev   [333] svn_uri_internal_st
>  [186] get_root_changes_of [148] svn_fs_fs__id_txn_i  [69] svn_uri_is_canonica
>   [91] get_xlate_handle_no [244] svn_fs_fs__id_unpar [293] svn_uri_local_style
>   [54] hash_read           [308] svn_fs_fs__init     [285] svn_utf__cstring_is
>  [320] init_sqlite          [97] svn_fs_fs__initiali  [77] svn_utf__is_valid
>   [18] inprocess_cache_get [171] svn_fs_fs__open      [56] svn_utf_cstring_fro
>   [44] inprocess_cache_set [226] svn_fs_fs__open_rep [102] svn_utf_cstring_fro
>   [15] internal_mcount     [101] svn_fs_fs__pack     [203] svn_utf_cstring_to_
>   [64] io_check_path        [47] svn_fs_fs__path_rev [334] svn_utf_initialize
>  [321] main                [167] svn_fs_fs__paths_ch [300] svn_ver_check_list
>  [187] make_dir_baton       [33] svn_fs_fs__read_nod [288] svn_ver_compatible
> (1846) mcount               [28] svn_fs_fs__rep_cont [317] svn_ver_equal
>   [58] moncontrol           [85] svn_fs_fs__rep_copy [196] translate_chunk
>  [190] 1:open_directory    [164] svn_fs_fs__rev_get_ [318] translated_stream_c
>  [191] 1:open_directory    [158] svn_fs_fs__revision [195] translated_stream_r
>   [19] open_path           [208] svn_fs_fs__youngest [335] uninit
>  [204] 1:open_root         [326] svn_fs_initialize    [11] verify_close_direct
>  [205] 1:open_root         [281] svn_fs_is_revision_  [13] verify_directory_en
>   [45] parse_dir_entries   [154] svn_fs_node_proplis [261] write_handler_disow
>  [227] parse_local_repos_p  [95] svn_fs_open         [254] write_handler_empty
>  [306] parse_one_rev       [168] svn_fs_paths_change [211] write_handler_strin
>  [119] path_driver_cb_func [159] svn_fs_revision_roo [206] write_hash_to_strin
>   [62] path_rev            [282] svn_fs_revision_roo [336] xlate_cleanup
>  [109] put_xlate_handle_no [309] svn_fs_set_warning_ [319] xlate_handle_node_c
>  [170] read_change         [197] svn_fs_type         [223] zlib_decode
>  [200] read_current        [298] svn_fs_version       [39] <cycle 1>
>  [213] read_format         [209] svn_fs_youngest_rev [179] <cycle 2>
>   [41] read_handler_apr     [53] svn_hash_read2      [125] <cycle 3>
> 
> Object modules
>
>  1: /crsvntest/apps/build/subversion-1.6.1/libs/subversion/1.6.1/SunOS/i86pc/bin/svnadmin



Re: How long do your svn dumps take

Posted by km...@rockwellcollins.com.
Stefan Sperling <st...@elego.de> wrote on 04/19/2009 07:56:26 AM:
> On Sat, Apr 18, 2009 at 09:51:38PM -0400, Bob Archer wrote:
> > 
> >    Hi All...
> > 
> > 
> >    I am upgrading from 1.5.5 to 1.6.1 today. Up to this point I have 
only
> >    been using svnadmin update. But, I decided it was time to do a
> >    dump/load as many have recommended.
> > 
> > 
> >    But, dumping one of our repo took about 5 hours. This is a 20GB 
repo.
> >    Is this normal. I see in the book it talks about doing a nightly 
dump
> >    so you can back up. Do people really run dumps that take 4+ hours?
> 
> This rings a bell.
> 
> I have been told by a user of an svnadmin dump that took 9+ hours.
> I have been meaning to reproduce the problem but did not have the time.
> (No pun intended! :)
> 
> In that particular case it was reported that the dump took _longer_
> when started incrementally from a revision somewhere in the middle of
> revision history than when taking it from revision 0 on onwards.
> 
> I believe there may be problem, but we need some more data.

Just a random datapoint, but the number of directories in one directory
seems to really affect svnadmin verify performance.  (Essentially just
a dump followed by a load...)  We have a fairly small repo (3G) that has
8000 directories inside a top level directory.  A verify takes over 40
hours now.  It seems to get really bad after a couple thousand dirs.  We
have a 160G repo with twice the number of files and revisions that
takes <2 hours on the same server.  All FSFS using Subversion 1.5.

I seem to remember it being mentioned that Subversion wasn't
optimized for large numbers of files/dirs inside one directory.

I'll see if I can get this moved to a server where I can enable
profiling...

Kevin R.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1826723

To unsubscribe from this discussion, e-mail: [users-unsubscribe@subversion.tigris.org].

Re: How long do your svn dumps take

Posted by Stefan Sperling <st...@elego.de>.
On Sat, Apr 18, 2009 at 09:51:38PM -0400, Bob Archer wrote:
> 
>    Hi All...
> 
> 
>    I am upgrading from 1.5.5 to 1.6.1 today. Up to this point I have only
>    been using svnadmin update. But, I decided it was time to do a
>    dump/load as many have recommended.
> 
> 
>    But, dumping one of our repo took about 5 hours. This is a 20GB repo.
>    Is this normal. I see in the book it talks about doing a nightly dump
>    so you can back up. Do people really run dumps that take 4+ hours?

This rings a bell.

I have been told by a user of an svnadmin dump that took 9+ hours.
I have been meaning to reproduce the problem but did not have the time.
(No pun intended! :)

In that particular case it was reported that the dump took _longer_
when started incrementally from a revision somewhere in the middle of
revision history than when taking it from revision 0 on onwards.

I believe there may be problem, but we need some more data.

What would really help is a run of svnadmin dump in a profiler so we can
see where it spends so much time. If you compile your own builds
you can do that fairly easily. On *nix, just add -pg to CFLAGS:

	env CFLAGS="-pg" ./configure; make; make install

Then run svnadmin. It will create a file called "gmon.out" that you can
run through gprof to obtain statistics:

	gprof /path/to/svnadmin gmon.out

Please send the generated statistics to the developer list.
They should not contain any sensitive data (but if they do, you can
also mail them to me privately if you wish).

I don't know what the equivalent on Windows is but maybe someone else can
comment on that if necessary.

If you can even provide profiles for full / incremental dumps for several
versions (e.g. 1.4, 1.5, and 1.6), we have a good chance to see when the
problem was introduced, if it has not been there all along -- which would
surprise me because people would probably have complained about it before.

But a profiled run of a full and incremental dump with 1.6 or trunk would
be the best place to start.

Thanks,
Stefan