Very Huge Repository

[Philibert Pérusse <pp...@gsmproducts.ca>]

Hi again,
 
We are developping under Windows CE. We are actually building our platforms
and everything. When installing Windows CE, it installs a lot of usefull
files in a single WINCE500 folder (DLL LIB EXE C CPP H ...).
 
Then, to build your platform, you change some of those files and ask to
build your platform.
 
Now, I decided to put that "original" installation into subversion before I
begin my changes. So I perform a single 'svn import' of that WINCE500
folder. The thing is:
- it contains about 4Gb of data
- which includes 42,000 files
- and approximatively 3,500 folders
- please note that we are using SVN 1.3.0 with SVNSERVE on a central server.
 
Surprisingly enough (or not for you guys) the operation succeeded. Though it
took about 2 hours to complete.
 
Issues I have are about the "usability" of that repository:
- Performing an "Update" or "Commit" on the root directory can be extremely
long....
- Performing a 'svn log' takes up to 30 seconds just to print the 18
revisions of my repository.
- Luckilly enough the "svn copy" is very quick for tagging & branching.
- However, performing a Checkout of that whole Tags folder is just out of
the question... Suppose I have 10 Tags there, this is 40Gb of data!
- What about the overall stability of the repository on the long run?
- I also have backup issues
- and so on...
 
So, I guess I now doubt about this move I made. Any comments other than "are
you crazy!"? Any experience with similar repositories?
 
Thanks for your comments...
 
philibert
 

Re: Very Huge Repository

[Ryan Schmidt <su...@ryandesign.com>]

I'll just answer a few of your points....

On Mar 3, 2006, at 00:06, Philibert Pérusse wrote:

> - it contains about 4Gb of data
> - which includes 42,000 files
> - and approximatively 3,500 folders
> - please note that we are using SVN 1.3.0 with SVNSERVE on a  
> central server.
>
> Surprisingly enough (or not for you guys) the operation succeeded.  
> Though it took about 2 hours to complete.
>
> Issues I have are about the "usability" of that repository:
> - Performing an "Update" or "Commit" on the root directory can be  
> extremely long....

With that many directories, I'd expect that. Instead, commit or  
update only the directory or directories where there are actually  
changes.

> - Performing a 'svn log' takes up to 30 seconds just to print the  
> 18 revisions of my repository.

You can limit the number of revisions returned in the log with for  
example --limit 5; this should speed it up.

> - Luckilly enough the "svn copy" is very quick for tagging &  
> branching.
> - However, performing a Checkout of that whole Tags folder is just  
> out of the question... Suppose I have 10 Tags there, this is 40Gb  
> of data!

which is why you would never check out the root of your repository.  
Only check out the trunk and/or branches you actually use. There's no  
reason you should need to have a local copy of every tag you've ever  
made, especially with that amount of data.



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org