You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by CHAZAL Julien <JU...@atos.net> on 2012/09/28 11:39:31 UTC
Subversion limits?
Hi all,
I manage a Subversion server that has the following configuration :
- SVN 1.6.9
- FSFS storage mode
- Apache + mod_dav + subversion modules
- Linux Suse Enterprise Edition 32-bit
On this SVN server, there are around 1100 SVN repositories for around 2000 users. I have small repositories and also very heavy repositories (the heaviest weighs around 33 GB on my linux filesystem). The sum of my repositories weighs around 1TB.
Do you know if there is a size limitation for a SVN repository in Subversion?
Do you know if there is a number limitation for SVN repositories on a Subversion server? Does-it really decrease performances on the subversion server?
Regards,
Julien<http://www.atos.net>
________________________________
Ce message et les pièces jointes sont confidentiels et réservés à l'usage exclusif de ses destinataires. Il peut également être protégé par le secret professionnel. Si vous recevez ce message par erreur, merci d'en avertir immédiatement l'expéditeur et de le détruire. L'intégrité du message ne pouvant être assurée sur Internet, la responsabilité du groupe Atos ne pourra être engagée quant au contenu de ce message. Bien que les meilleurs efforts soient faits pour maintenir cette transmission exempte de tout virus, l'expéditeur ne donne aucune garantie à cet égard et sa responsabilité ne saurait être engagée pour tout dommage résultant d'un virus transmis.
This e-mail and the documents attached are confidential and intended solely for the addressee; it may also be privileged. If you receive this e-mail in error, please notify the sender immediately and destroy it. As its integrity cannot be secured on the Internet, the Atos group liability cannot be triggered for the message content. Although the sender endeavors to maintain a computer virus-free network, the sender does not warrant that this transmission is virus-free and will not be liable for any damages resulting from any virus transmitted.
Re: Subversion limits?
Posted by Thorsten Schöning <ts...@am-soft.de>.
Guten Tag Thomas Loy,
am Freitag, 28. September 2012 um 21:46 schrieben Sie:
> This brings up a question for me. I have a couple of repos that
> are over 5 years old and reaching close to 400GB of storage. I'd
> like to "trim" the first couple of years of versions and store them
> to some sort of "archive" repo and keep the most recent versions in
> an "active" repo. I've been toying with export commands but haven't
> had any success. I would like to back us away from any possible limits.
You really should start a new thread and give some more details,
especially about the version of your repos, maybe its contents,
binaries vs. source code vs. some other text format, how many working
copies you have and how expensive it is to create new ones etc.
The short answer is that it's easy not possible to do what you want as
revision will change in the newly created repos, you need fresh
checkouts everywhere etc. Besides that, as Subversion only works on
diffs after the first full commit of a file, depending on your data
you may or may not save space. Think of 1 GB files changed over 5
years in only some MB of diffs, you new repo would still need to
provide GBs of data as the revision base in the first commit etc.
Mit freundlichen Grüßen,
Thorsten Schöning
--
Thorsten Schöning E-Mail:Thorsten.Schoening@AM-SoFT.de
AM-SoFT IT-Systeme http://www.AM-SoFT.de/
Telefon.............030-2 1001-310
Fax...............05151- 9468- 88
Mobil..............0178-8 9468- 04
AM-SoFT GmbH IT-Systeme, Brandenburger Str. 7c, 31789 Hameln
AG Hannover HRB 207 694 - Geschäftsführer: Andreas Muchow
RE: Subversion limits?
Posted by Thomas Loy <Th...@cbeyond.net>.
This brings up a question for me. I have a couple of repos that are over 5 years old and reaching close to 400GB of storage. I'd like to "trim" the first couple of years of versions and store them to some sort of "archive" repo and keep the most recent versions in an "active" repo. I've been toying with export commands but haven't had any success. I would like to back us away from any possible limits.
Cheers,
Thomas
From: kmradke@rockwellcollins.com [mailto:kmradke@rockwellcollins.com]
Sent: Friday, September 28, 2012 10:52 AM
To: CHAZAL Julien
Cc: users@subversion.apache.org
Subject: Re: Subversion limits?
> I manage a Subversion server that has the following configuration :
> - SVN 1.6.9
> - FSFS storage mode
> - Apache + mod_dav + subversion modules
> - Linux Suse Enterprise Edition 32-bit
>
> On this SVN server, there are around 1100 SVN repositories for
> around 2000 users. I have small repositories and also very heavy
> repositories (the heaviest weighs around 33 GB on my linux
> filesystem). The sum of my repositories weighs around 1TB.
>
> Do you know if there is a size limitation for a SVN repository in Subversion?
> Do you know if there is a number limitation for SVN repositories on
> a Subversion server? Does-it really decrease performances on the
> subversion server?
This really depends upon the hardware and how the users are using
the server. That said, the largest server I have has 1800
repositories serving around 6500 users. The largest repository
is around 400GB with around 7TB of total storage. The largest
single commit I have seen is around 53GB.
The larger repositories get, the longer it may take to do
maintenance activities such as verifying, filtering, dumping,
and loading a repository. This is why I'd recommend staying
away from large repositories and large commits, but they do work.
Subversion seems to be I/O bound, even on a high-end SAN. 1.7
seems to definitely chew more CPU and memory though. But, I've
also seen multiple 1GB NICs near saturation on the server too...
Things that can kill performance:
- Slow filesystem I/O
- Poorly written hook scripts
- Commits with large numbers of files (1M+)
- Lots of files locked (hundred of thousands+)
- Slow authentication servers
You could easily run into issues depending upon the filesystem
type and how you have organized the repositories. For example,
one large partition *might* be less efficient.
Kevin R.
Re: Subversion limits?
Posted by km...@rockwellcollins.com.
> I manage a Subversion server that has the following configuration :
> - SVN 1.6.9
> - FSFS storage mode
> - Apache + mod_dav + subversion modules
> - Linux Suse Enterprise Edition 32-bit
>
> On this SVN server, there are around 1100 SVN repositories for
> around 2000 users. I have small repositories and also very heavy
> repositories (the heaviest weighs around 33 GB on my linux
> filesystem). The sum of my repositories weighs around 1TB.
>
> Do you know if there is a size limitation for a SVN repository in
Subversion?
> Do you know if there is a number limitation for SVN repositories on
> a Subversion server? Does-it really decrease performances on the
> subversion server?
This really depends upon the hardware and how the users are using
the server. That said, the largest server I have has 1800
repositories serving around 6500 users. The largest repository
is around 400GB with around 7TB of total storage. The largest
single commit I have seen is around 53GB.
The larger repositories get, the longer it may take to do
maintenance activities such as verifying, filtering, dumping,
and loading a repository. This is why I'd recommend staying
away from large repositories and large commits, but they do work.
Subversion seems to be I/O bound, even on a high-end SAN. 1.7
seems to definitely chew more CPU and memory though. But, I've
also seen multiple 1GB NICs near saturation on the server too...
Things that can kill performance:
- Slow filesystem I/O
- Poorly written hook scripts
- Commits with large numbers of files (1M+)
- Lots of files locked (hundred of thousands+)
- Slow authentication servers
You could easily run into issues depending upon the filesystem
type and how you have organized the repositories. For example,
one large partition *might* be less efficient.
Kevin R.
RE: Subversion limits?
Posted by Ajay Pawar <Aj...@kpitcummins.com>.
Hi Julien,
Thanks for the post, I also need to know the same thing.
From: CHAZAL Julien [mailto:JULIEN.CHAZAL@atos.net]
Sent: Friday, September 28, 2012 3:10 PM
To: users@subversion.apache.org
Subject: Subversion limits?
Hi all,
I manage a Subversion server that has the following configuration :
- SVN 1.6.9
- FSFS storage mode
- Apache + mod_dav + subversion modules
- Linux Suse Enterprise Edition 32-bit
On this SVN server, there are around 1100 SVN repositories for around 2000 users. I have small repositories and also very heavy repositories (the heaviest weighs around 33 GB on my linux filesystem). The sum of my repositories weighs around 1TB.
Do you know if there is a size limitation for a SVN repository in Subversion?
Do you know if there is a number limitation for SVN repositories on a Subversion server? Does-it really decrease performances on the subversion server?
Regards,
Julien
________________________________
Ce message et les pièces jointes sont confidentiels et réservés à l'usage exclusif de ses destinataires. Il peut également être protégé par le secret professionnel. Si vous recevez ce message par erreur, merci d'en avertir immédiatement l'expéditeur et de le détruire. L'intégrité du message ne pouvant être assurée sur Internet, la responsabilité du groupe Atos ne pourra être engagée quant au contenu de ce message. Bien que les meilleurs efforts soient faits pour maintenir cette transmission exempte de tout virus, l'expéditeur ne donne aucune garantie à cet égard et sa responsabilité ne saurait être engagée pour tout dommage résultant d'un virus transmis.
This e-mail and the documents attached are confidential and intended solely for the addressee; it may also be privileged. If you receive this e-mail in error, please notify the sender immediately and destroy it. As its integrity cannot be secured on the Internet, the Atos group liability cannot be triggered for the message content. Although the sender endeavors to maintain a computer virus-free network, the sender does not warrant that this transmission is virus-free and will not be liable for any damages resulting from any virus transmitted.