You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Nouha Terzi <te...@gmail.com> on 2015/05/26 18:05:41 UTC
Performance issue with svn export [svn 1.8.11]
Hello all,
we are deploying svn 1.8.11 on our server Rhel 6.6.
We are facing some issue within svn export.
it seems that it has some perf limitation when dealing with a huge number
of files.
we have this delay when doing an svn export url and the target has:
less than 20k files export = ~ 1 minute
more than 30k files export > 1 hour
Is it a known issue? Has someone encouter thsi behavior?
thnak you for your valuable support.
regards,
Nouha
Re: Performance issue with svn export [svn 1.8.11]
Posted by Eric Johnson <er...@tibco.com>.
Hi Nouha,
Based on the relative size of the repositories, one might expect that the
larger repository would take about twice as long to export. So clearly
something is weird here.
You'll still need to provide more details:
- Are the types of files in the two repositories different?
- Are you running a virus scanner on the client?
- Have you timed the command, to find out how much system, user, and
real time is being spent?
- What command are you using to export? (Are you exporting from a
working copy, or directly from the server?)
- What OS & version thereof are you using on the client?
- Have you observed the problem with other clients / OSes?
- Does an export take the same time as a checkout?
- Have you tried doing a export of the repository on the server? Does it
show the same time discrepancy?
Somehow, you need to establish enough information to identify whether the
source of the problem is the server, the client, the network, or the
protocol.
For example, the client could be running a virus scanner that goes nuts for
your 30K files repository. Or it could be that something is unreliable
about your network, but only manifests itself with a few files from your
30K repository.
Eric.
On Fri, May 29, 2015 at 7:37 AM, Nouha Terzi <te...@gmail.com> wrote:
> Hello Eric,
>
> Many thanks for your answer.
>
> What's the client on which you're running the svn export command?
> > I tested with 2 svn clients: 1.6.11 and 1.8.8 from an RH 5 server and
> got the same response time for both export
>
> Are you doing the export across the network, or on the same machine
> hosting the repository?
> > It is thru Network. And the 2 repositories are hosted on the same
> remote svn server.
> My server and my client are hosted on the same WAN-intranet.
>
> When the export is done, how much disk space is taken by the export (in
> both cases)?
> > 121M for the repo having 30k files and 68M for teh second one.
>
> Please note that we are using http protocol not svn thru ssh.
>
> Thank you for valuable support in advancE.
>
> regards,
> Nouha
>
>
> 2015-05-28 21:08 GMT+01:00 Eric Johnson <er...@tibco.com>:
>
>> Looks like nobody has responded yet. I've certainly not encountered that
>> behavior.
>>
>> I think you'll need to provide more information. The problem could stem
>> from so many places. Could be, for example, that you've got a virus
>> scanner, and when you export the 30K files, you're exporting files that
>> draw more attention from a virus scanner.
>>
>> What's the client on which you're running the svn export command? Are you
>> doing the export across the network, or on the same machine hosting the
>> repository? When the export is done, how much disk space is taken by the
>> export (in both cases)?
>>
>> Eric.
>>
>> On Tue, May 26, 2015 at 9:05 AM, Nouha Terzi <te...@gmail.com>
>> wrote:
>>
>>> Hello all,
>>>
>>> we are deploying svn 1.8.11 on our server Rhel 6.6.
>>> We are facing some issue within svn export.
>>> it seems that it has some perf limitation when dealing with a huge
>>> number of files.
>>>
>>> we have this delay when doing an svn export url and the target has:
>>>
>>> less than 20k files export = ~ 1 minute
>>>
>>> more than 30k files export > 1 hour
>>>
>>>
>>>
>>> Is it a known issue? Has someone encouter thsi behavior?
>>>
>>>
>>> thnak you for your valuable support.
>>>
>>>
>>> regards,
>>>
>>> Nouha
>>>
>>
>>
>
Re: Performance issue with svn export [svn 1.8.11]
Posted by Nouha Terzi <te...@gmail.com>.
Hello Eric,
Many thanks for your answer.
What's the client on which you're running the svn export command?
> I tested with 2 svn clients: 1.6.11 and 1.8.8 from an RH 5 server and got
the same response time for both export
Are you doing the export across the network, or on the same machine hosting
the repository?
> It is thru Network. And the 2 repositories are hosted on the same remote
svn server.
My server and my client are hosted on the same WAN-intranet.
When the export is done, how much disk space is taken by the export (in
both cases)?
> 121M for the repo having 30k files and 68M for teh second one.
Please note that we are using http protocol not svn thru ssh.
Thank you for valuable support in advancE.
regards,
Nouha
2015-05-28 21:08 GMT+01:00 Eric Johnson <er...@tibco.com>:
> Looks like nobody has responded yet. I've certainly not encountered that
> behavior.
>
> I think you'll need to provide more information. The problem could stem
> from so many places. Could be, for example, that you've got a virus
> scanner, and when you export the 30K files, you're exporting files that
> draw more attention from a virus scanner.
>
> What's the client on which you're running the svn export command? Are you
> doing the export across the network, or on the same machine hosting the
> repository? When the export is done, how much disk space is taken by the
> export (in both cases)?
>
> Eric.
>
> On Tue, May 26, 2015 at 9:05 AM, Nouha Terzi <te...@gmail.com>
> wrote:
>
>> Hello all,
>>
>> we are deploying svn 1.8.11 on our server Rhel 6.6.
>> We are facing some issue within svn export.
>> it seems that it has some perf limitation when dealing with a huge number
>> of files.
>>
>> we have this delay when doing an svn export url and the target has:
>>
>> less than 20k files export = ~ 1 minute
>>
>> more than 30k files export > 1 hour
>>
>>
>>
>> Is it a known issue? Has someone encouter thsi behavior?
>>
>>
>> thnak you for your valuable support.
>>
>>
>> regards,
>>
>> Nouha
>>
>
>
Re: Performance issue with svn export [svn 1.8.11]
Posted by Eric Johnson <er...@tibco.com>.
Looks like nobody has responded yet. I've certainly not encountered that
behavior.
I think you'll need to provide more information. The problem could stem
from so many places. Could be, for example, that you've got a virus
scanner, and when you export the 30K files, you're exporting files that
draw more attention from a virus scanner.
What's the client on which you're running the svn export command? Are you
doing the export across the network, or on the same machine hosting the
repository? When the export is done, how much disk space is taken by the
export (in both cases)?
Eric.
On Tue, May 26, 2015 at 9:05 AM, Nouha Terzi <te...@gmail.com> wrote:
> Hello all,
>
> we are deploying svn 1.8.11 on our server Rhel 6.6.
> We are facing some issue within svn export.
> it seems that it has some perf limitation when dealing with a huge number
> of files.
>
> we have this delay when doing an svn export url and the target has:
>
> less than 20k files export = ~ 1 minute
>
> more than 30k files export > 1 hour
>
>
>
> Is it a known issue? Has someone encouter thsi behavior?
>
>
> thnak you for your valuable support.
>
>
> regards,
>
> Nouha
>