You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Eduardo <ot...@fef.unicamp.br> on 2006/01/24 17:01:55 UTC

Exim+SA=Server Overloaded!

Hello!
Sorry to send another email about the same subject. But my mail server 
crashed so i couldn't see the answers.

I am calling my spamassassin service in SMTP time with some ACL rules in 
my exim4 configuration file. I start the SA service, start exim4 service 
and i wait only some minutes and the server gets overloaded!... almost 
impossible to loggin and shutdown manually the server.

I have 216 users in the server, and I have an avarege about 10 access / 
minute.

I THINK that the problem is that I am calling the SA service from ACL 
rules (in SMTP time)... but dont know how to change it to another way to 
fix the problem.

Ah! When I turn off the SA service the server goes perfectly.

Could somebody help me?!
Thanks anyway!



Re: Exim+SA=Server Overloaded!

Posted by "Chr. v. Stuckrad" <st...@mi.fu-berlin.de>.
On Tue, Jan 24, 2006 at 02:01:55PM -0200, Eduardo wrote:
> Hello!
> Sorry to send another email about the same subject. But my mail server 
> crashed so i couldn't see the answers.
> 
> I am calling my spamassassin service in SMTP time with some ACL rules in 
> my exim4 configuration file. I start the SA service, start exim4 service 

As far as I had the same problem, while I work on our
new/future exim+amavis+spamassassin-MTA, it stems from
'too many SMTP-connections in parallel' and in my case it
forced me after a few tests to move from 'spamassassin by ACL'
to 'scanning by pipe / in queue-runners'.

After you stop/restart the server, all MTAs which waited for
your server to come up, will 'crowd in' to deliver. So your
number of parallel incoming connections will be at its maximum.

If you do spam-checks 'by ACL' (in the SMTP dialog), you'll
need spamd-access for each connection in parallel, which
nearly always will either crash the server by overload,
or begin to let spam through (or defer connections) by timeout
(too many connections to one spamd).

Therefore we changed our spam-check to the other method
'by pipe', only checking for spam 'in the queue'.

This way, we can tell exim to accept the mail, put it
into the queue ('queue_only'), and then set the number of
parallel queue-runners exactly to the maximum capacity of
the spam-filter.  This visibly slows down delivery at a whole,
but it should never force the server into thrashing.

The ideal setup though would be adapting to the load, scanning
by ACL, until too crowded, then switching to 'scan later' in
the queue, but I did not yet understand exim THAT far.

Stucki (postmaster of math/inf/mi.fu-berlin.de)

-- 
Christoph von Stuckrad      * * |nickname |<st...@mi.fu-berlin.de>  \
Freie Universitaet Berlin   |/_*|'stucki' |Tel(days):+49 30 838-75 459|
Mathematik & Informatik EDV |\ *|if online|Tel(else):+49 30 77 39 6600|
Arnimallee 2-6/14195 Berlin * * |on IRCnet|Fax(alle):+49 30 838-75454/

Re: [exim] Exim+SA=Server Overloaded!

Posted by Loren Wilton <lw...@earthlink.net>.
> My problem still remains: I disabled ALL the rules I use to check (Rules
> du Jour, Bayes, Razor and Pyzor) and, believe it or not, it is still
> getting overloaded :(

How many children are you running?  Overload is almost always due to running
out of memory and going into thrashing.  This happens because the total size
of the spamd children is larger than your available memory.  The total size
can be because you have too many children running, or sometimes because the
children get too big.

I would expect the children to be around 50MB or a little less, depending on
the rulesets you have.  You can check this.  If one or more of the children
is much bigger than 50MB, then this may be causing your problem.

You should also check how many spamd children are running, and compare their
total size to your available memory size.  With 512MB of memory, you
probably do not want more than about 5 children maximum.

All of this assumes you are running spamd.  If you are using some other
method, then the problem might lie elsewhere.

        Loren


Re: [exim] Exim+SA=Server Overloaded!

Posted by Eduardo <ot...@fef.unicamp.br>.
George R. Kasica wrote:
>> On Tue, 24 Jan 2006 14:01:55 -0200, you wrote:
>>     
>
>   
>> Hello!
>> Sorry to send another email about the same subject. But my mail server 
>> crashed so i couldn't see the answers.
>>
>> I am calling my spamassassin service in SMTP time with some ACL rules in 
>> my exim4 configuration file. I start the SA service, start exim4 service 
>> and i wait only some minutes and the server gets overloaded!... almost 
>> impossible to loggin and shutdown manually the server.
>>
>> I have 216 users in the server, and I have an avarege about 10 access / 
>> minute.
>>
>> I THINK that the problem is that I am calling the SA service from ACL 
>> rules (in SMTP time)... but dont know how to change it to another way to 
>> fix the problem.
>>
>> Ah! When I turn off the SA service the server goes perfectly.
>>
>> Could somebody help me?!
>> Thanks anyway!
>>     
>
> Also check to make sure your not using HUGE rulesets like the 2
> blacklist ones, that's what caused a problem here, once we stopped
> using those 2 all was happy.
>
> ===[George R. Kasica]===        +1 262 677 0766
> President                       +1 206 374 6482 FAX 
> Netwrx Consulting Inc.          Jackson, WI USA 
> http://www.netwrx1.com
> georgek@netwrx1.com
> ICQ #12862186
>   
My problem still remains: I disabled ALL the rules I use to check (Rules 
du Jour, Bayes, Razor and Pyzor) and, believe it or not, it is still 
getting overloaded :(

There is some way to check WHAT is causing the overload? Some debug?! 
(can I check the possible cause os the overload with "spamassassing 
--lint -D" command?!)

Thanks to all :)

Re: [exim] Exim+SA=Server Overloaded!

Posted by "George R. Kasica" <ge...@netwrx1.com>.
>On Tue, 24 Jan 2006 14:01:55 -0200, you wrote:

>Hello!
>Sorry to send another email about the same subject. But my mail server 
>crashed so i couldn't see the answers.
>
>I am calling my spamassassin service in SMTP time with some ACL rules in 
>my exim4 configuration file. I start the SA service, start exim4 service 
>and i wait only some minutes and the server gets overloaded!... almost 
>impossible to loggin and shutdown manually the server.
>
>I have 216 users in the server, and I have an avarege about 10 access / 
>minute.
>
>I THINK that the problem is that I am calling the SA service from ACL 
>rules (in SMTP time)... but dont know how to change it to another way to 
>fix the problem.
>
>Ah! When I turn off the SA service the server goes perfectly.
>
>Could somebody help me?!
>Thanks anyway!

Also check to make sure your not using HUGE rulesets like the 2
blacklist ones, that's what caused a problem here, once we stopped
using those 2 all was happy.

===[George R. Kasica]===        +1 262 677 0766
President                       +1 206 374 6482 FAX 
Netwrx Consulting Inc.          Jackson, WI USA 
http://www.netwrx1.com
georgek@netwrx1.com
ICQ #12862186