You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Andreas Hasenack <an...@conectiva.com.br> on 2007/04/18 17:57:55 UTC

Biggest number of revisions under FSFS?

As I'm aproaching 200k revisions in a repository, I was wondering. In
FSFS, each commit is one file. What's the biggest number of revisions
people have with FSFS out there?

I'm currently using 1.4.3, with ext3 FS + dir_index option.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Biggest number of revisions under FSFS?

Posted by Larry Martell <la...@gmail.com>.
On 4/18/07, Blair Zajac <bl...@orcaware.com> wrote:
> Subversion 1.5 will have repository sharding in it,

I sure hope not!

http://www.urbandictionary.com/define.php?term=sharding

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Biggest number of revisions under FSFS?

Posted by Andreas Hasenack <an...@conectiva.com.br>.
On Wed, Apr 18, 2007 at 06:47:26PM -0500, Troy Curtis Jr wrote:
> On 4/18/07, Les Mikesell <le...@gmail.com> wrote:
> >Blair Zajac wrote:
> >>>
> >>> I seem to recall hearing that the limit (for FSFS) was dictated by the
> >>> host filesystem's number of files per directory.
> >>
> >> KDE is up to 655k:
> >
> >Does anyone know how long a dump/load would take with something like that?
> >
> >--
> >   Les Mikesell
> >    lesmikesell@gmail.com
> >
> >
> >---------------------------------------------------------------------
> >To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> >For additional commands, e-mail: users-help@subversion.tigris.org
> >
> >
> 
> I don't remember the dump time, but the load time for a BDB repository
> with ~60k revs and a ~3GB dump file took something like 10-12 hours.
> It was significantly shorter for a FSFS repo, only about 5 or 6 hours.

You probably didn't have a properly configured DB_CONFIG file when doing
the load with the BDB backend.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Biggest number of revisions under FSFS?

Posted by Troy Curtis Jr <tr...@gmail.com>.
On 4/18/07, Les Mikesell <le...@gmail.com> wrote:
> Blair Zajac wrote:
> >>
> >> I seem to recall hearing that the limit (for FSFS) was dictated by the
> >> host filesystem's number of files per directory.
> >
> > KDE is up to 655k:
>
> Does anyone know how long a dump/load would take with something like that?
>
> --
>    Les Mikesell
>     lesmikesell@gmail.com
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
>

I don't remember the dump time, but the load time for a BDB repository
with ~60k revs and a ~3GB dump file took something like 10-12 hours.
It was significantly shorter for a FSFS repo, only about 5 or 6 hours.

Troy

-- 
"Beware of spyware. If you can, use the Firefox browser." - USA Today
Download now at http://getfirefox.com
Registered Linux User #354814 ( http://counter.li.org/)

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Biggest number of revisions under FSFS?

Posted by Andreas Hasenack <an...@conectiva.com.br>.
On Wed, Apr 18, 2007 at 05:06:33PM -0500, Les Mikesell wrote:
> Blair Zajac wrote:
> >>
> >>I seem to recall hearing that the limit (for FSFS) was dictated by the
> >>host filesystem's number of files per directory.
> >
> >KDE is up to 655k:
> 
> Does anyone know how long a dump/load would take with something like that?

In my case, dumping 150k revisions (repo is 50Gb large) takes about 3h
and something on a core2duo E6300, 2Gb RAM, with a common sata disk.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Biggest number of revisions under FSFS?

Posted by Les Mikesell <le...@gmail.com>.
Blair Zajac wrote:
>>
>> I seem to recall hearing that the limit (for FSFS) was dictated by the
>> host filesystem's number of files per directory.
> 
> KDE is up to 655k:

Does anyone know how long a dump/load would take with something like that?

-- 
   Les Mikesell
    lesmikesell@gmail.com


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Biggest number of revisions under FSFS?

Posted by Blair Zajac <bl...@orcaware.com>.
Andy Levy wrote:
> On 4/18/07, Ryan Schmidt <su...@ryandesign.com> wrote:
>> On Apr 18, 2007, at 12:57, Andreas Hasenack wrote:
>>
>> > As I'm aproaching 200k revisions in a repository, I was wondering. In
>> > FSFS, each commit is one file. What's the biggest number of revisions
>> > people have with FSFS out there?
>> >
>> > I'm currently using 1.4.3, with ext3 FS + dir_index option.
>>
>> The repository at apache.org is currently over 530k revisions...
>>
>> http://svn.apache.org/viewvc/
>>
>> You could ask them if they're experiencing any problems with that.
> 
> Assuming they're using FSFS - the repository is over 4 years old, at
> which point the default was BDB (they could have converted at some
> point, of course).
> 
> I seem to recall hearing that the limit (for FSFS) was dictated by the
> host filesystem's number of files per directory.

KDE is up to 655k:

http://websvn.kde.org/

Subversion 1.5 will have repository sharding in it, so not all revisions 
will be placed into the same directory.

Regards,
Blair

-- 
Blair Zajac, Ph.D.
<bl...@orcaware.com>
Subversion training, consulting and support
http://www.orcaware.com/svn/

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Biggest number of revisions under FSFS?

Posted by Andy Levy <an...@gmail.com>.
On 4/18/07, Ryan Schmidt <su...@ryandesign.com> wrote:
> On Apr 18, 2007, at 12:57, Andreas Hasenack wrote:
>
> > As I'm aproaching 200k revisions in a repository, I was wondering. In
> > FSFS, each commit is one file. What's the biggest number of revisions
> > people have with FSFS out there?
> >
> > I'm currently using 1.4.3, with ext3 FS + dir_index option.
>
> The repository at apache.org is currently over 530k revisions...
>
> http://svn.apache.org/viewvc/
>
> You could ask them if they're experiencing any problems with that.

Assuming they're using FSFS - the repository is over 4 years old, at
which point the default was BDB (they could have converted at some
point, of course).

I seem to recall hearing that the limit (for FSFS) was dictated by the
host filesystem's number of files per directory.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Biggest number of revisions under FSFS?

Posted by Ryan Schmidt <su...@ryandesign.com>.
On Apr 18, 2007, at 12:57, Andreas Hasenack wrote:

> As I'm aproaching 200k revisions in a repository, I was wondering. In
> FSFS, each commit is one file. What's the biggest number of revisions
> people have with FSFS out there?
>
> I'm currently using 1.4.3, with ext3 FS + dir_index option.

The repository at apache.org is currently over 530k revisions...

http://svn.apache.org/viewvc/

You could ask them if they're experiencing any problems with that.


--  

To reply to the mailing list, please use your mailer's Reply To All  
function


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org