You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@subversion.apache.org by Jacob Gorm Hansen <jg...@ioi.dk> on 2002/11/02 12:00:07 UTC

Scalability for large files

hi,

does anyone know how svn scales if used for lots of very large (10-20
megs) binary files? Are there any current limits one should be aware of?

best,
Jacob

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org

Re: Scalability for large files

Posted by Greg Stein <gs...@lyra.org>.
On Sun, Nov 03, 2002 at 03:00:15PM +0200, Nuutti Kotivuori wrote:
> Jacob Gorm Hansen wrote:
> > does anyone know how svn scales if used for lots of very large
> > (10-20 megs) binary files? Are there any current limits one should
> > be aware of?
> 
> There should be no limitations - but there can be bugs. These bugs are
> almost invariably memory-management related - either on the client or
> on the server.
> 
> Several bugs on memory management have been fixed recently and I've
> unfortunately lost count which still exist.
> 
> But, be sure to run the latest client from the Subversion repository -
> and I think you should not run into any bigger problems. If you do,
> try to work out a reproduction recipe - any bugs found are quite
> important and will probably be fixed as soon as possible.

Agreed.

Also, note that Conectiva has a repository that is well over 5 gigabytes in
size. I don't think they have "huge" files, but certainly the repository can
handle a large amount of data. I've also heard about somebody storing their
.mp3 collection into an SVN repository, and I also know people have tried
shoving some files in the hundred+ megabytes range into SVN.

It should *already* be entirely possible. If it *isn't*, then we've
introduced a regression.

Cheers,
-g

-- 
Greg Stein, http://www.lyra.org/

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org

Re: Scalability for large files

Posted by Nuutti Kotivuori <na...@iki.fi>.
Jacob Gorm Hansen wrote:
> does anyone know how svn scales if used for lots of very large
> (10-20 megs) binary files? Are there any current limits one should
> be aware of?

There should be no limitations - but there can be bugs. These bugs are
almost invariably memory-management related - either on the client or
on the server.

Several bugs on memory management have been fixed recently and I've
unfortunately lost count which still exist.

But, be sure to run the latest client from the Subversion repository -
and I think you should not run into any bigger problems. If you do,
try to work out a reproduction recipe - any bugs found are quite
important and will probably be fixed as soon as possible.

-- Naked

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org