You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by "Qnet .." <ca...@hotmail.com> on 2007/11/05 20:47:18 UTC
Spamd HIGH LOAD
Hi,
My Qmail server work with spamassassin + clamav. The processes Spamd take the most part of the load so it 's Spamassassin crash. Do you know any way to solve it?
Please look the attach file( top -d1 ). Thank you so munch !
_________________________________________________________________
Express yourself instantly with MSN Messenger! Download today it's FREE!
http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
Re: FW: Spamd HIGH LOAD
Posted by SM <sm...@resistor.net>.
At 14:13 05-11-2007, Qnet .. wrote:
>I used /usr/bin/sa-update D allways. then
>restart. but I have the load problem still. Do
>you know other way to solve it? thanks.
http://wiki.apache.org/spamassassin/FasterPerformance
Regards,
-sm
Re: Spamd HIGH LOAD
Posted by Matt Kettler <mk...@verizon.net>.
Matt Kettler wrote:
>
> Your swap used should never be more than mem free if you can
> avoid it.
>
Note: by "mem free" I mean total "free" memory.. i.e.: mem free +
buffers + cache.
It's quite normal for just the "free" memory number to be low. Most OS's
will turn free memory into a really big disk cache if they can, but
they'll readily turn this back into memory for processes when needed.
In your example, you've got 37024k of "total" free memory, even though
there's only 1848k that's truly not being used at all. However, 1335848k
of swap is being used, which is more than 3 times as much as your total
free memory.. That's not good, and likely indicates you'll be grinding
your disk quite heavily as processes thrash in and out of the swap.
Re: FW: Spamd HIGH LOAD
Posted by Matt Kettler <mk...@verizon.net>.
Qnet .. wrote:
>
>
> Thank you so much.
> My
> Qmail server have 1GB RAM
> now I set -m 20.
> My doubt is: what consequences it implies over queue ?
It depends a bit on where in your mail processing spamc is called.
I *think* you're using spamcontrol under qmail, which calls spamassassin
at the SMTP data phase.
If you are calling SA at the SMTP data phase, this will essentially
"bottleneck" your server to 20 simultaneous email messages in the data
phase. You can have more connections, but they'll queue up waiting for
the data phase OK.
> i will have more spam ?
No, not generally. If your spamd children are desperately too low, then
spamc clients will eventually time out and skip the scan, but that's
unlikely unless your mail load is *really* high.
> What is "normal" high load for a server?
What's a "high load"?
Really there's no general "normal" for a "high load" because everyones
definition of "high load" is different. What's your average message load
like? 100,000 messages a day? 1 million a day? 10 million a day?
Assuming an average scan time of 2 seconds per message, 20 spamds could
theoretically handle 864,000 messages a day. Of course, email rate isn't
exactly smooth throughout the day, mid-day rates can easily be 4 times
higher than overnight rates, but it's still enough for 100k/day, but not
enough for 1 million.
Also, your scan time may be noticeably higher, or lower, than 2 seconds,
depending on what features you've got enabled, if you've got local RBL
servers (ie: rsync and rbldnsd), if you're using "expensive" plugins
like fuzzyocr.. However, it's a good rough estimate to start from.
>
> Thank you and sorry for my bad english.
That's Ok.. I'm a native speaker of English, and even mine isn't so great..
FW: Spamd HIGH LOAD
Posted by "Qnet .." <ca...@hotmail.com>.
> Date: Mon, 5 Nov 2007 18:53:07 -0500
> From: mkettler_sa@verizon.net
> Subject: Re: Spamd HIGH LOAD
> To: carnival2171@hotmail.com
> CC: users@spamassassin.apache.org
>
> Qnet .. wrote:
> > I start :
> >
> > #!/bin/sh
> > # spamassassin This script starts and stops the spamd daemon
> > #
> >
> > PATH=$PATH:/usr/local/sbin:/usr/local/bin
> > case "$1" in
> > start)
> > cd /
> >
> > /usr/bin/spamd -v -u vpopmail -m 60 -x -q -s stderr -r
> > /var/run/spamd/spamd.pid \
> > -i 172.16.10.14 -A 172.16.10.0/24 2>&1 | \
> > /usr/local/bin/setuidgid qmaill \
> > /usr/local/bin/multilog t !spamdappend /var/log/qmail/spamd &
> > echo "spamd started"
>
> 60 is *WAY* too many spamd children unless you've got a *VERY* beefy system.
>
> Try modifying that "-m 60" to something more sane, like the default,
> which would be "-m 5". If you've got a lot of mail going through, 5
> won't handle it, so for that I might start at 15.
>
> If your mail starts backing up, you can increase the number of spamd
> children, but be aware that too many will just grind your system to a
> halt. Try adding spamd children in increments of 5, and watch the "top"
> output. Your swap used should never be more than mem free if you can
> avoid it.
>
> You've got a gig of ram, and your spamds are 30mb a pop or so... you
> should be ok up to about 20-25 spamd children, depending on how much
> other stuff is eating your memory, but you'll quickly run into trouble
> if you go over 30.
>
> (30 spamds at 30mb each is 900mb of ram.. probably the absolute max you
> can fit even if the server isn't doing anything else but mail..)
>
Thank you so much.
My
Qmail server have 1GB RAM
now I set -m 20.
My doubt is: what consequences it implies over queue ?
i will have more spam ?
What is "normal" high load for a server?
Thank you and sorry for my bad english.
_________________________________________________________________
Express yourself instantly with MSN Messenger! Download today it's FREE!
http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
Re: Spamd HIGH LOAD
Posted by Matt Kettler <mk...@verizon.net>.
Qnet .. wrote:
> I start :
>
> #!/bin/sh
> # spamassassin This script starts and stops the spamd daemon
> #
>
> PATH=$PATH:/usr/local/sbin:/usr/local/bin
> case "$1" in
> start)
> cd /
>
> /usr/bin/spamd -v -u vpopmail -m 60 -x -q -s stderr -r
> /var/run/spamd/spamd.pid \
> -i 172.16.10.14 -A 172.16.10.0/24 2>&1 | \
> /usr/local/bin/setuidgid qmaill \
> /usr/local/bin/multilog t !spamdappend /var/log/qmail/spamd &
> echo "spamd started"
60 is *WAY* too many spamd children unless you've got a *VERY* beefy system.
Try modifying that "-m 60" to something more sane, like the default,
which would be "-m 5". If you've got a lot of mail going through, 5
won't handle it, so for that I might start at 15.
If your mail starts backing up, you can increase the number of spamd
children, but be aware that too many will just grind your system to a
halt. Try adding spamd children in increments of 5, and watch the "top"
output. Your swap used should never be more than mem free if you can
avoid it.
You've got a gig of ram, and your spamds are 30mb a pop or so... you
should be ok up to about 20-25 spamd children, depending on how much
other stuff is eating your memory, but you'll quickly run into trouble
if you go over 30.
(30 spamds at 30mb each is 900mb of ram.. probably the absolute max you
can fit even if the server isn't doing anything else but mail..)
RE: Spamd HIGH LOAD
Posted by "Qnet .." <ca...@hotmail.com>.
I start :
#!/bin/sh
# spamassassin This script starts and
stops the spamd daemon
#
PATH=$PATH:/usr/local/sbin:/usr/local/bin
case
"$1" in
start)
cd
/
/usr/bin/spamd -v -u vpopmail -m 60 -x -q -s stderr -r /var/run/spamd/spamd.pid
\
-i 172.16.10.14 -A
172.16.10.0/24 2>&1 | \
/usr/local/bin/setuidgid qmaill \
/usr/local/bin/multilog t !spamdappend /var/log/qmail/spamd
&
echo "spamd
started"
;;
stop)
if [ -r
/var/run/spamd/spamd.pid ];
then
pid=`cat
/var/run/spamd/spamd.pid`
kill $pid || ( echo "failed to stop spamd" && exit 1
)
echo "spamd (pid
$pid) stopped"
else
echo
"/var/run/spamd/spamd.pid doesn't exist, is spamd
running?"
fi
;;
restart)
$0 stop && sleep
2 && $0 start
;;
*)
echo "usage: spamassassin.rc
(start|stop|restart)"
;;
esac
> Date: Mon, 5 Nov 2007 17:16:29 -0500
> From: francois.rousseau.tech@gmail.com
> To: carnival2171@hotmail.com; users@spamassassin.apache.org
> Subject: Re: Spamd HIGH LOAD
>
> How do you start spamassassin?
>
>
>
> On 11/5/07, Qnet .. <ca...@hotmail.com> wrote:
> >
> >
> > I used /usr/bin/sa-update –D allways. then restart. but I have the load
> > problem still. Do you know other way to solve it? thanks.
> > From: Joey@Web56.Net
> > To: users@spamassassin.apache.org
> > Subject: RE: Spamd HIGH LOAD
> > Date: Mon, 5 Nov 2007 16:11:57 -0500
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > From: Qnet ..
> > [mailto:carnival2171@hotmail.com]
> >
> > Sent: Monday, November 05, 2007 2:47 PM
> >
> > To: users@spamassassin.apache.org
> >
> > Subject: Spamd HIGH LOAD
> >
> >
> >
> >
> >
> >
> >
> > Hi,
> >
> >
> > My Qmail server work with spamassassin + clamav. The processes
> > Spamd take the most part of the load so it 's Spamassassin
> > crash. Do you know any way to solve it?
> >
> > Please look the attach file( top -d1 ). Thank you so munch !
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > Try running /usr/bin/sa-update –D, then restart SA see if this
> > helps.
> >
> >
> >
> > Also do you run rulesdajour?
> >
> >
> >
> > Joey
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > _________________________________________________________________
> > Express yourself instantly with MSN Messenger! Download today it's FREE!
> > http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
_________________________________________________________________
Express yourself instantly with MSN Messenger! Download today it's FREE!
http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
Re: Spamd HIGH LOAD
Posted by François Rousseau <fr...@gmail.com>.
How do you start spamassassin?
On 11/5/07, Qnet .. <ca...@hotmail.com> wrote:
>
>
> I used /usr/bin/sa-update –D allways. then restart. but I have the load
> problem still. Do you know other way to solve it? thanks.
> From: Joey@Web56.Net
> To: users@spamassassin.apache.org
> Subject: RE: Spamd HIGH LOAD
> Date: Mon, 5 Nov 2007 16:11:57 -0500
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> From: Qnet ..
> [mailto:carnival2171@hotmail.com]
>
> Sent: Monday, November 05, 2007 2:47 PM
>
> To: users@spamassassin.apache.org
>
> Subject: Spamd HIGH LOAD
>
>
>
>
>
>
>
> Hi,
>
>
> My Qmail server work with spamassassin + clamav. The processes
> Spamd take the most part of the load so it 's Spamassassin
> crash. Do you know any way to solve it?
>
> Please look the attach file( top -d1 ). Thank you so munch !
>
>
>
>
>
>
>
>
>
>
>
> Try running /usr/bin/sa-update –D, then restart SA see if this
> helps.
>
>
>
> Also do you run rulesdajour?
>
>
>
> Joey
>
>
>
>
>
>
>
>
>
> _________________________________________________________________
> Express yourself instantly with MSN Messenger! Download today it's FREE!
> http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
FW: Spamd HIGH LOAD
Posted by "Qnet .." <ca...@hotmail.com>.
I used /usr/bin/sa-update –D allways. then restart. but I have the load problem still. Do you know other way to solve it? thanks.
From: Joey@Web56.Net
To: users@spamassassin.apache.org
Subject: RE: Spamd HIGH LOAD
Date: Mon, 5 Nov 2007 16:11:57 -0500
From: Qnet ..
[mailto:carnival2171@hotmail.com]
Sent: Monday, November 05, 2007 2:47 PM
To: users@spamassassin.apache.org
Subject: Spamd HIGH LOAD
Hi,
My Qmail server work with spamassassin + clamav. The processes
Spamd take the most part of the load so it 's Spamassassin
crash. Do you know any way to solve it?
Please look the attach file( top -d1 ). Thank you so munch !
Try running /usr/bin/sa-update –D, then restart SA see if this
helps.
Also do you run rulesdajour?
Joey
_________________________________________________________________
Express yourself instantly with MSN Messenger! Download today it's FREE!
http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
RE: Spamd HIGH LOAD
Posted by Joey <Jo...@Web56.Net>.
From: Qnet .. [mailto:carnival2171@hotmail.com]
Sent: Monday, November 05, 2007 2:47 PM
To: users@spamassassin.apache.org
Subject: Spamd HIGH LOAD
Hi,
My Qmail server work with spamassassin + clamav. The processes Spamd take
the most part of the load so it 's Spamassassin crash. Do you know any way
to solve it?
Please look the attach file( top -d1 ). Thank you so munch !
_____
Try running /usr/bin/sa-update -D, then restart SA see if this helps.
Also do you run rulesdajour?
Joey
Re: Spamd HIGH LOAD
Posted by Richard Frovarp <Ri...@sendit.nodak.edu>.
Qnet .. wrote:
> Hi,
> My Qmail server work with spamassassin + clamav. The processes Spamd
> take the most part of the *load *so it 's Spamassassin crash. Do you
> know any way to solve it?
> Please look the attach file( top -d1 ). Thank you so munch !
> ------------------------------------------------------------------------
I don't run qmail or spamd, but I can tell you that you shouldn't be
running so many spamd processes. You probably only need a couple.
Whatever program is calling the scanning should be calling spamc. Your
system is most definitely not properly configured, so I would review the
correct instructions to do so.