You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@subversion.apache.org by Alexander Kitaev <al...@tmate.org> on 2006/03/09 16:23:47 UTC

Huge repository for testing needed.

Hello All,

JavaSVN development version now includes support for "file" protocol (for
'fsfs' repositories). This support is still under development and not ready
for production use yet. 

However, we already testing it, and among other tests we're running a
replicator (also part of JavaSVN) that could create exact copy of a
repository. Running such test followed by source and target repositories
comparision, emulates real-life testing as it replays all commits done in
the source repository into the target  one (and also tests update).

What I would like to ask you about is if someone has a relatively large
repository with a lot of transactions in it, could that person allow me to
download that repository? In particular, I'm thinking of Subversion
repository, but may be there are larger ones. The replicator mentioned above
could do a replication over "http" protocol ("http"->"file") as well, but
this could put some undesirable load on the server, that I would like to
avoid.

Thanks a lot in advance!

Alexander Kitaev,
TMate Software,
http://tmate.org/
http://jetbrains.com/tmate/


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org

Re: Huge repository for testing needed.

Posted by Justin Erenkrantz <ju...@erenkrantz.com>.
On 09 Mar 2006 12:46:02 -0600, kfogel@collab.net <kf...@collab.net> wrote:
> Alexander, just FYI: Subversion's own repository is not even nearly
> one of the largest out there.  If you need a big test case, we're
> probably not your best choice...

Apache's is several orders of magnitude too large (which is why replay
needs to be turned off or allow for access control).  svn.apache.org
also has some private paths in our public repository that we'd have to
trim out to make it userful.  -- justin

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org


Re: Huge repository for testing needed.

Posted by Daniel Berlin <db...@dberlin.org>.
On Thu, 2006-03-09 at 22:46 +0000, Philip Martin wrote:
> kfogel@collab.net writes:
> 
> > Alexander, just FYI: Subversion's own repository is not even nearly
> > one of the largest out there.  If you need a big test case, we're
> > probably not your best choice...
> 
> http://gcc.gnu.org/rsync.html
> 
>   "The whole repository takes over 7.8G of disk space"
> 

Our repository is a bit weird.  Some of the copy detection logic in
cvs2svn didn't work out, so there are branches that start with adds of
exact duplicates of files on mainline, instead of copies.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org

Re: Huge repository for testing needed.

Posted by Philip Martin <ph...@codematters.co.uk>.
kfogel@collab.net writes:

> Alexander, just FYI: Subversion's own repository is not even nearly
> one of the largest out there.  If you need a big test case, we're
> probably not your best choice...

http://gcc.gnu.org/rsync.html

  "The whole repository takes over 7.8G of disk space"

-- 
Philip Martin

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org

Re: Huge repository for testing needed.

Posted by kf...@collab.net.
"C. Michael Pilato" <cm...@collab.net> writes:
> > What I would like to ask you about is if someone has a relatively large
> > repository with a lot of transactions in it, could that person allow me to
> > download that repository? In particular, I'm thinking of Subversion
> > repository, but may be there are larger ones. The replicator mentioned above
> > could do a replication over "http" protocol ("http"->"file") as well, but
> > this could put some undesirable load on the server, that I would like to
> > avoid.
> > 
> > Thanks a lot in advance!
> 
> The Subversion source code repository is BDB-backed (BDB 4.2).  If
> that's cool with you, I can make it available for download.  I can go
> with db_dump or "svnadmin dump" formats too, if you prefer, though it'll
> take some time to generate.  Hit me at the contact address listed on
> http://svn.collab.net/ to take me up on this.

Alexander, just FYI: Subversion's own repository is not even nearly
one of the largest out there.  If you need a big test case, we're
probably not your best choice...

-K

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org

Re: Huge repository for testing needed.

Posted by "C. Michael Pilato" <cm...@collab.net>.
Alexander Kitaev wrote:
> Hello All,
> 
> JavaSVN development version now includes support for "file" protocol (for
> 'fsfs' repositories). This support is still under development and not ready
> for production use yet. 
> 
> However, we already testing it, and among other tests we're running a
> replicator (also part of JavaSVN) that could create exact copy of a
> repository. Running such test followed by source and target repositories
> comparision, emulates real-life testing as it replays all commits done in
> the source repository into the target  one (and also tests update).
> 
> What I would like to ask you about is if someone has a relatively large
> repository with a lot of transactions in it, could that person allow me to
> download that repository? In particular, I'm thinking of Subversion
> repository, but may be there are larger ones. The replicator mentioned above
> could do a replication over "http" protocol ("http"->"file") as well, but
> this could put some undesirable load on the server, that I would like to
> avoid.
> 
> Thanks a lot in advance!

The Subversion source code repository is BDB-backed (BDB 4.2).  If
that's cool with you, I can make it available for download.  I can go
with db_dump or "svnadmin dump" formats too, if you prefer, though it'll
take some time to generate.  Hit me at the contact address listed on
http://svn.collab.net/ to take me up on this.

-- 
C. Michael Pilato <cm...@collab.net>
CollabNet   <>   www.collab.net   <>   Distributed Development On Demand

Re: Huge repository for testing needed.

Posted by Aron Gombas <ar...@midori.hu>.
 Alexander,

  The JBLAB anonymous SVN repo seems quite
large to me:
  http://anonsvn.labs.jboss.com/trunk/

  HTH.

  Aron Gombas
  Founder, http://www.midori.hu
  Founder, http://labs.jboss.com/projects/kosmos


Alexander Kitaev wrote:
> Hello All,
> 
> JavaSVN development version now includes support for "file" protocol (for
> 'fsfs' repositories). This support is still under development and not ready
> for production use yet. 
> 
> However, we already testing it, and among other tests we're running a
> replicator (also part of JavaSVN) that could create exact copy of a
> repository. Running such test followed by source and target repositories
> comparision, emulates real-life testing as it replays all commits done in
> the source repository into the target  one (and also tests update).
> 
> What I would like to ask you about is if someone has a relatively large
> repository with a lot of transactions in it, could that person allow me to
> download that repository? In particular, I'm thinking of Subversion
> repository, but may be there are larger ones. The replicator mentioned above
> could do a replication over "http" protocol ("http"->"file") as well, but
> this could put some undesirable load on the server, that I would like to
> avoid.
> 
> Thanks a lot in advance!
> 
> Alexander Kitaev,
> TMate Software,
> http://tmate.org/
> http://jetbrains.com/tmate/
> 
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org