You are viewing a plain text version of this content. The canonical link for it is here.
Posted to server-user@james.apache.org by Vincenzo Gianferrari Pini <vi...@praxis.it> on 2003/05/08 16:50:10 UTC
RE: extreme processor usage
Noel,
I confirm after running several hours with <deliveryThreads> set to 5 that bug #19418 ("100 processor usage if RemoteDelivery uses more then 1 thread") seems to have been solved in James Version 2.1.3a4 (second post).
Thank you,
Vincenzo
> -----Original Message-----
> From: Cameron Braid [mailto:cameron@datacodex.net]
> Sent: lunedi 14 aprile 2003 14.14
> To: 'James Users List'
> Subject: RE: extreme processor usage
>
>
> I found the same problem, and after much painful debugging, tracked it to
> the avalon AvalonMailRepository / AvalonSpoolRepository
> classes... Sorry but
> my memory is a bit vague since it was a few weeks ago, and since then, we
> have aborted the James approach, in favour of a EZML or some
> other lmailing
> list manager. We were sending a weekly mailing list of 160,000+ emails
>
> The problem was when there were more than 1 remote delivery threads.
>
> It was to do with the threads waking each other up, while waiting the
> accept(long delay) block.
>
> The internal code caused the first thread to iterate through the
> messages in
> the spool to determine the minimum time to wait, then it executed
> wait(timeToWait).
>
> The second (or any other thread) comes along, and goes through the same
> process, however, it awakens the other threads, due to the lock(s) call.
> Thereby causing a continual state of insomnia.
>
> I havn't found a soloution, though my thoughts are to change the way the
> waiting and wakening happens. I would stop each and every remote delivery
> thread from going through this process, and instead, have a singe thread
> who's job it is to keep track of the wait time, and waken the threads then
> it knows there is work to do.
>
> I hope this can help. I can look into my memory a little bit
> more, if some
> more clarification is required.
>
> Cameron.
>
> > -----Original Message-----
> > From: Vincenzo Gianferrari Pini
> > [mailto:vincenzo.gianferraripini@praxis.it]
> > Sent: Monday, 14 April 2003 4:53 PM
> > To: James Users List
> > Subject: RE: extreme processor usage
> >
> >
> > What is the value of your <deliveryThreads> setting in the
> > "remoteDelivery" mailet? I experienced consistently your same
> > problem some time ago raising such value from the default 1
> > to 5 under a dual processor, Windows 2000 server, Java VM Sun
> > j2re1.4.0. With a value of 1 it always worked OK. For me it's
> > still an open problem, though I havent yet tried the same
> > situation under j2re 1.4.1.
> >
> > Bye,
> >
> > Vincenzo
> >
> > > -----Original Message-----
> > > From: Hontvari Jozsef [mailto:hontvari2@solware.com]
> > > Sent: lunedi 14 aprile 2003 8.25
> > > To: James Users List
> > > Subject: Re: extreme processor usage
> > >
> > >
> > > Configuration:
> > > Sun Java Client VM build 1.4.1_01-b01, mixed mode), Windows 2000
> > > Server
> > >
> > > I am using the file spool and the file based mail stores (in their
> > > default configuration). I have no mailboxes, every address is
> > > forwarded by using matchers and mailets (about 50).
> > >
> > > I started running James from a dos prompt, with runhprof
> > > (cpu=samples,depth=15). Interestingly the processor usage
> > is about 60%
> > > continuously. I guess this is the result of running with hprof, and
> > > not the symptom I am looking after (that was a stable 100%).
> > >
> > >
> > >
> > >
> > >
> > >
> > > ----- Original Message -----
> > > From: "Noel J. Bergman" <no...@devtech.com>
> > > To: "James Users List" <ja...@jakarta.apache.org>
> > > Sent: Monday, April 14, 2003 7:03 AM
> > > Subject: RE: extreme processor usage
> > >
> > >
> > > > What repository types, operating system, VM? I have not seen
> > > > anything
> > > like
> > > > what you are describing. One thing that I have, on rare
> > > occasion, noticed
> > > > is that mysql benefited from being restarted.
> > > >
> > > > --- Noel
> > > >
> > > >
> > > >
> > --------------------------------------------------------------------
> > > > -
> > > > To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
> > > > For additional commands, e-mail:
> > james-user-help@jakarta.apache.org
> > > >
> > >
> > >
> > >
> > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
> > > For additional commands, e-mail: james-user-help@jakarta.apache.org
> > >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: james-user-help@jakarta.apache.org
> >
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: james-user-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: james-user-help@jakarta.apache.org
Re: extreme processor usage
Posted by Marco Tedone <mt...@jemos.org>.
I could confirm it, as i'm running this version and everything now seems to
work greatly.
Marco
----- Original Message -----
From: "Vincenzo Gianferrari Pini" <vi...@praxis.it>
To: "James Users List" <ja...@jakarta.apache.org>
Sent: Thursday, May 08, 2003 3:50 PM
Subject: RE: extreme processor usage
Noel,
I confirm after running several hours with <deliveryThreads> set to 5 that
bug #19418 ("100 processor usage if RemoteDelivery uses more then 1 thread")
seems to have been solved in James Version 2.1.3a4 (second post).
Thank you,
Vincenzo
> -----Original Message-----
> From: Cameron Braid [mailto:cameron@datacodex.net]
> Sent: lunedi 14 aprile 2003 14.14
> To: 'James Users List'
> Subject: RE: extreme processor usage
>
>
> I found the same problem, and after much painful debugging, tracked it to
> the avalon AvalonMailRepository / AvalonSpoolRepository
> classes... Sorry but
> my memory is a bit vague since it was a few weeks ago, and since then, we
> have aborted the James approach, in favour of a EZML or some
> other lmailing
> list manager. We were sending a weekly mailing list of 160,000+ emails
>
> The problem was when there were more than 1 remote delivery threads.
>
> It was to do with the threads waking each other up, while waiting the
> accept(long delay) block.
>
> The internal code caused the first thread to iterate through the
> messages in
> the spool to determine the minimum time to wait, then it executed
> wait(timeToWait).
>
> The second (or any other thread) comes along, and goes through the same
> process, however, it awakens the other threads, due to the lock(s) call.
> Thereby causing a continual state of insomnia.
>
> I havn't found a soloution, though my thoughts are to change the way the
> waiting and wakening happens. I would stop each and every remote delivery
> thread from going through this process, and instead, have a singe thread
> who's job it is to keep track of the wait time, and waken the threads then
> it knows there is work to do.
>
> I hope this can help. I can look into my memory a little bit
> more, if some
> more clarification is required.
>
> Cameron.
>
> > -----Original Message-----
> > From: Vincenzo Gianferrari Pini
> > [mailto:vincenzo.gianferraripini@praxis.it]
> > Sent: Monday, 14 April 2003 4:53 PM
> > To: James Users List
> > Subject: RE: extreme processor usage
> >
> >
> > What is the value of your <deliveryThreads> setting in the
> > "remoteDelivery" mailet? I experienced consistently your same
> > problem some time ago raising such value from the default 1
> > to 5 under a dual processor, Windows 2000 server, Java VM Sun
> > j2re1.4.0. With a value of 1 it always worked OK. For me it's
> > still an open problem, though I havent yet tried the same
> > situation under j2re 1.4.1.
> >
> > Bye,
> >
> > Vincenzo
> >
> > > -----Original Message-----
> > > From: Hontvari Jozsef [mailto:hontvari2@solware.com]
> > > Sent: lunedi 14 aprile 2003 8.25
> > > To: James Users List
> > > Subject: Re: extreme processor usage
> > >
> > >
> > > Configuration:
> > > Sun Java Client VM build 1.4.1_01-b01, mixed mode), Windows 2000
> > > Server
> > >
> > > I am using the file spool and the file based mail stores (in their
> > > default configuration). I have no mailboxes, every address is
> > > forwarded by using matchers and mailets (about 50).
> > >
> > > I started running James from a dos prompt, with runhprof
> > > (cpu=samples,depth=15). Interestingly the processor usage
> > is about 60%
> > > continuously. I guess this is the result of running with hprof, and
> > > not the symptom I am looking after (that was a stable 100%).
> > >
> > >
> > >
> > >
> > >
> > >
> > > ----- Original Message -----
> > > From: "Noel J. Bergman" <no...@devtech.com>
> > > To: "James Users List" <ja...@jakarta.apache.org>
> > > Sent: Monday, April 14, 2003 7:03 AM
> > > Subject: RE: extreme processor usage
> > >
> > >
> > > > What repository types, operating system, VM? I have not seen
> > > > anything
> > > like
> > > > what you are describing. One thing that I have, on rare
> > > occasion, noticed
> > > > is that mysql benefited from being restarted.
> > > >
> > > > --- Noel
> > > >
> > > >
> > > >
> > --------------------------------------------------------------------
> > > > -
> > > > To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
> > > > For additional commands, e-mail:
> > james-user-help@jakarta.apache.org
> > > >
> > >
> > >
> > >
> > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
> > > For additional commands, e-mail: james-user-help@jakarta.apache.org
> > >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: james-user-help@jakarta.apache.org
> >
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: james-user-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: james-user-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: james-user-help@jakarta.apache.org
RE: extreme processor usage
Posted by "Noel J. Bergman" <no...@devtech.com>.
Excellent. Any other problems?
--- Noel
-----Original Message-----
From: Vincenzo Gianferrari Pini
[mailto:vincenzo.gianferraripini@praxis.it]
Sent: Thursday, May 08, 2003 10:50
To: James Users List
Subject: RE: extreme processor usage
Noel,
I confirm after running several hours with <deliveryThreads> set to 5 that
bug #19418 ("100 processor usage if RemoteDelivery uses more then 1 thread")
seems to have been solved in James Version 2.1.3a4 (second post).
Thank you,
Vincenzo
---------------------------------------------------------------------
To unsubscribe, e-mail: james-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: james-user-help@jakarta.apache.org