You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Ryan Hunt <rh...@hp.com> on 2003/11/12 00:35:59 UTC
multiple access bog down on HP-UX 11i
I am running my repository on an HP-UX 11i system using the svn+ssh
access method.
When 2 separate users start 4 simultaneous checkouts each for a total
of 8 checkouts, and a 3rd user initiates an import, the import grinds
to a halt, and the checkouts proceed at a rate of .5MB per hour.
Each transaction ranges in total size from 200MB to 2.5GB with the
largest file size being 600MB.
After all the transactions are canceled and another transaction is
initiated the same slow pace is achieved.
To revive the speed a reboot is required.
Load never goes above 1.5, and no resources seem over taxed: disk I/O,
memory, CPU all seem fine.
Does anyone have any ideas or suggestions to allow multiple
simultaneous large transactions??
Ryan
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Michael Wood <mw...@its.uct.ac.za>.
On Tue, Nov 11, 2003 at 05:35:59PM -0700, Ryan Hunt wrote:
> I am running my repository on an HP-UX 11i system using the svn+ssh
> access method.
>
> When 2 separate users start 4 simultaneous checkouts each for a total
> of 8 checkouts, and a 3rd user initiates an import, the import grinds
> to a halt, and the checkouts proceed at a rate of .5MB per hour.
Hi. Going through old e-mails and noticed this one.
I know there have been problems running Subversion on HPUX in the past
and I am not aware of these problems being fixed. I don't have time to
dig up the information, but try having a look at some of these messages:
http://www.google.com/search?q=hpux+Subversion+%2Bsite%3A.contactor.se
--
Michael Wood <mw...@its.uct.ac.za>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Justin Erenkrantz <ju...@erenkrantz.com>.
--On Wednesday, November 12, 2003 6:00 PM -0700 Ryan Hunt <rh...@hp.com> wrote:
> As soon as I start an import for a 10th simultaneous svnserve process all
> process assume the sleep state and drop down to 1% CPU or less. Load drops
> to 1-2.
...
> Any ideas on why this might occur and how to prevent it?
I'd start looking at BDB first.
Can you get a stack trace of where the processes are sleeping (pstack if you
have something like that)? I wouldn't be shocked if it's in a BDB mutex lock.
Also, what version of BDB are you using? (And, for that matter, what SVN
version?) -- justin
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Philip Martin <ph...@codematters.co.uk>.
Ryan Hunt <rh...@hp.com> writes:
>>> The import is killed mid stream.
What does this mean? Do you manually abort the import? Does the
system kill the client or the server? Does the server abort?
If the process accessing the repository (the server) is killed or
aborts while it is holding BDB locks then it is quite likely that the
repository will have problems.
--
Philip Martin
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Philip Martin <ph...@codematters.co.uk>.
Ryan Hunt <rh...@hp.com> writes:
>>> The import is killed mid stream.
What does this mean? Do you manually abort the import? Does the
system kill the client or the server? Does the server abort?
If the process accessing the repository (the server) is killed or
aborts while it is holding BDB locks then it is quite likely that the
repository will have problems.
--
Philip Martin
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Ryan Hunt <rh...@hp.com>.
Has no one ever come across anything like this?
I have seen this issue in .28, .29 and now in .32.
It is 100% repeatable. Every time several checkouts are taking place
and an import is started (or vice/versa) all processes go to sleep, the
load drops and I/O is reduced to almost nothing...
-Ryan
On Wednesday, November 12, 2003, at 06:40 PM, Ryan Hunt wrote:
> And some more info...
> After running a svnadmin recover, future transactions again assume the
> run state rather than the sleep state.
>
> Would this indicate that importing simultaneous with a checkout will
> cause database corruption?
>
> -Ryan
>
> On Wednesday, November 12, 2003, at 06:00 PM, Ryan Hunt wrote:
>
>> So I have some more information on this problem.
>>
>> I have say 9 checkouts occurring simultaneously. Load is up to around
>> 10. Each process has about 9-10% CPU, and has a state of run. Files
>> are being written to the clients at about 30MB per min.
>>
>> As soon as I start an import for a 10th simultaneous svnserve process
>> all process assume the sleep state and drop down to 1% CPU or less.
>> Load drops to 1-2.
>>
>> The import is killed mid stream. All remaining svnserve processes
>> performing the checkouts remain in sleep state. While in sleep state
>> files are written to the clients at a rate that nonexistent.
>>
>> Any ideas on why this might occur and how to prevent it?
>>
>> -Ryan
>>
>> On Tuesday, November 11, 2003, at 05:35 PM, Ryan Hunt wrote:
>>
>>> I am running my repository on an HP-UX 11i system using the svn+ssh
>>> access method.
>>>
>>> When 2 separate users start 4 simultaneous checkouts each for a
>>> total of 8 checkouts, and a 3rd user initiates an import, the import
>>> grinds to a halt, and the checkouts proceed at a rate of .5MB per
>>> hour.
>>>
>>> Each transaction ranges in total size from 200MB to 2.5GB with the
>>> largest file size being 600MB.
>>>
>>> After all the transactions are canceled and another transaction is
>>> initiated the same slow pace is achieved.
>>>
>>> To revive the speed a reboot is required.
>>>
>>> Load never goes above 1.5, and no resources seem over taxed: disk
>>> I/O, memory, CPU all seem fine.
>>>
>>> Does anyone have any ideas or suggestions to allow multiple
>>> simultaneous large transactions??
>>>
>>> Ryan
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
>>> For additional commands, e-mail: users-help@subversion.tigris.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
>> For additional commands, e-mail: users-help@subversion.tigris.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: dev-help@subversion.tigris.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Ryan Hunt <rh...@hp.com>.
Has no one ever come across anything like this?
I have seen this issue in .28, .29 and now in .32.
It is 100% repeatable. Every time several checkouts are taking place
and an import is started (or vice/versa) all processes go to sleep, the
load drops and I/O is reduced to almost nothing...
-Ryan
On Wednesday, November 12, 2003, at 06:40 PM, Ryan Hunt wrote:
> And some more info...
> After running a svnadmin recover, future transactions again assume the
> run state rather than the sleep state.
>
> Would this indicate that importing simultaneous with a checkout will
> cause database corruption?
>
> -Ryan
>
> On Wednesday, November 12, 2003, at 06:00 PM, Ryan Hunt wrote:
>
>> So I have some more information on this problem.
>>
>> I have say 9 checkouts occurring simultaneously. Load is up to around
>> 10. Each process has about 9-10% CPU, and has a state of run. Files
>> are being written to the clients at about 30MB per min.
>>
>> As soon as I start an import for a 10th simultaneous svnserve process
>> all process assume the sleep state and drop down to 1% CPU or less.
>> Load drops to 1-2.
>>
>> The import is killed mid stream. All remaining svnserve processes
>> performing the checkouts remain in sleep state. While in sleep state
>> files are written to the clients at a rate that nonexistent.
>>
>> Any ideas on why this might occur and how to prevent it?
>>
>> -Ryan
>>
>> On Tuesday, November 11, 2003, at 05:35 PM, Ryan Hunt wrote:
>>
>>> I am running my repository on an HP-UX 11i system using the svn+ssh
>>> access method.
>>>
>>> When 2 separate users start 4 simultaneous checkouts each for a
>>> total of 8 checkouts, and a 3rd user initiates an import, the import
>>> grinds to a halt, and the checkouts proceed at a rate of .5MB per
>>> hour.
>>>
>>> Each transaction ranges in total size from 200MB to 2.5GB with the
>>> largest file size being 600MB.
>>>
>>> After all the transactions are canceled and another transaction is
>>> initiated the same slow pace is achieved.
>>>
>>> To revive the speed a reboot is required.
>>>
>>> Load never goes above 1.5, and no resources seem over taxed: disk
>>> I/O, memory, CPU all seem fine.
>>>
>>> Does anyone have any ideas or suggestions to allow multiple
>>> simultaneous large transactions??
>>>
>>> Ryan
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
>>> For additional commands, e-mail: users-help@subversion.tigris.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
>> For additional commands, e-mail: users-help@subversion.tigris.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: dev-help@subversion.tigris.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Ryan Hunt <rh...@hp.com>.
And some more info...
After running a svnadmin recover, future transactions again assume the
run state rather than the sleep state.
Would this indicate that importing simultaneous with a checkout will
cause database corruption?
-Ryan
On Wednesday, November 12, 2003, at 06:00 PM, Ryan Hunt wrote:
> So I have some more information on this problem.
>
> I have say 9 checkouts occurring simultaneously. Load is up to around
> 10. Each process has about 9-10% CPU, and has a state of run. Files
> are being written to the clients at about 30MB per min.
>
> As soon as I start an import for a 10th simultaneous svnserve process
> all process assume the sleep state and drop down to 1% CPU or less.
> Load drops to 1-2.
>
> The import is killed mid stream. All remaining svnserve processes
> performing the checkouts remain in sleep state. While in sleep state
> files are written to the clients at a rate that nonexistent.
>
> Any ideas on why this might occur and how to prevent it?
>
> -Ryan
>
> On Tuesday, November 11, 2003, at 05:35 PM, Ryan Hunt wrote:
>
>> I am running my repository on an HP-UX 11i system using the svn+ssh
>> access method.
>>
>> When 2 separate users start 4 simultaneous checkouts each for a total
>> of 8 checkouts, and a 3rd user initiates an import, the import grinds
>> to a halt, and the checkouts proceed at a rate of .5MB per hour.
>>
>> Each transaction ranges in total size from 200MB to 2.5GB with the
>> largest file size being 600MB.
>>
>> After all the transactions are canceled and another transaction is
>> initiated the same slow pace is achieved.
>>
>> To revive the speed a reboot is required.
>>
>> Load never goes above 1.5, and no resources seem over taxed: disk
>> I/O, memory, CPU all seem fine.
>>
>> Does anyone have any ideas or suggestions to allow multiple
>> simultaneous large transactions??
>>
>> Ryan
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
>> For additional commands, e-mail: users-help@subversion.tigris.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Ryan Hunt <rh...@hp.com>.
And some more info...
After running a svnadmin recover, future transactions again assume the
run state rather than the sleep state.
Would this indicate that importing simultaneous with a checkout will
cause database corruption?
-Ryan
On Wednesday, November 12, 2003, at 06:00 PM, Ryan Hunt wrote:
> So I have some more information on this problem.
>
> I have say 9 checkouts occurring simultaneously. Load is up to around
> 10. Each process has about 9-10% CPU, and has a state of run. Files
> are being written to the clients at about 30MB per min.
>
> As soon as I start an import for a 10th simultaneous svnserve process
> all process assume the sleep state and drop down to 1% CPU or less.
> Load drops to 1-2.
>
> The import is killed mid stream. All remaining svnserve processes
> performing the checkouts remain in sleep state. While in sleep state
> files are written to the clients at a rate that nonexistent.
>
> Any ideas on why this might occur and how to prevent it?
>
> -Ryan
>
> On Tuesday, November 11, 2003, at 05:35 PM, Ryan Hunt wrote:
>
>> I am running my repository on an HP-UX 11i system using the svn+ssh
>> access method.
>>
>> When 2 separate users start 4 simultaneous checkouts each for a total
>> of 8 checkouts, and a 3rd user initiates an import, the import grinds
>> to a halt, and the checkouts proceed at a rate of .5MB per hour.
>>
>> Each transaction ranges in total size from 200MB to 2.5GB with the
>> largest file size being 600MB.
>>
>> After all the transactions are canceled and another transaction is
>> initiated the same slow pace is achieved.
>>
>> To revive the speed a reboot is required.
>>
>> Load never goes above 1.5, and no resources seem over taxed: disk
>> I/O, memory, CPU all seem fine.
>>
>> Does anyone have any ideas or suggestions to allow multiple
>> simultaneous large transactions??
>>
>> Ryan
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
>> For additional commands, e-mail: users-help@subversion.tigris.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Ryan Hunt <rh...@hp.com>.
So I have some more information on this problem.
I have say 9 checkouts occurring simultaneously. Load is up to around
10. Each process has about 9-10% CPU, and has a state of run. Files
are being written to the clients at about 30MB per min.
As soon as I start an import for a 10th simultaneous svnserve process
all process assume the sleep state and drop down to 1% CPU or less.
Load drops to 1-2.
The import is killed mid stream. All remaining svnserve processes
performing the checkouts remain in sleep state. While in sleep state
files are written to the clients at a rate that nonexistent.
Any ideas on why this might occur and how to prevent it?
-Ryan
On Tuesday, November 11, 2003, at 05:35 PM, Ryan Hunt wrote:
> I am running my repository on an HP-UX 11i system using the svn+ssh
> access method.
>
> When 2 separate users start 4 simultaneous checkouts each for a total
> of 8 checkouts, and a 3rd user initiates an import, the import grinds
> to a halt, and the checkouts proceed at a rate of .5MB per hour.
>
> Each transaction ranges in total size from 200MB to 2.5GB with the
> largest file size being 600MB.
>
> After all the transactions are canceled and another transaction is
> initiated the same slow pace is achieved.
>
> To revive the speed a reboot is required.
>
> Load never goes above 1.5, and no resources seem over taxed: disk I/O,
> memory, CPU all seem fine.
>
> Does anyone have any ideas or suggestions to allow multiple
> simultaneous large transactions??
>
> Ryan
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: multiple access bog down on HP-UX 11i
Posted by Ryan Hunt <rh...@hp.com>.
So I have some more information on this problem.
I have say 9 checkouts occurring simultaneously. Load is up to around
10. Each process has about 9-10% CPU, and has a state of run. Files
are being written to the clients at about 30MB per min.
As soon as I start an import for a 10th simultaneous svnserve process
all process assume the sleep state and drop down to 1% CPU or less.
Load drops to 1-2.
The import is killed mid stream. All remaining svnserve processes
performing the checkouts remain in sleep state. While in sleep state
files are written to the clients at a rate that nonexistent.
Any ideas on why this might occur and how to prevent it?
-Ryan
On Tuesday, November 11, 2003, at 05:35 PM, Ryan Hunt wrote:
> I am running my repository on an HP-UX 11i system using the svn+ssh
> access method.
>
> When 2 separate users start 4 simultaneous checkouts each for a total
> of 8 checkouts, and a 3rd user initiates an import, the import grinds
> to a halt, and the checkouts proceed at a rate of .5MB per hour.
>
> Each transaction ranges in total size from 200MB to 2.5GB with the
> largest file size being 600MB.
>
> After all the transactions are canceled and another transaction is
> initiated the same slow pace is achieved.
>
> To revive the speed a reboot is required.
>
> Load never goes above 1.5, and no resources seem over taxed: disk I/O,
> memory, CPU all seem fine.
>
> Does anyone have any ideas or suggestions to allow multiple
> simultaneous large transactions??
>
> Ryan
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org