You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Morris Jones <mo...@whiteoaks.com> on 2004/10/02 20:44:06 UTC
Memory usage spikes ...
Yesterday I commented that I was seeing spamd children eating a lot of
memory, pushing the machine into swap. I've been keeping an eye on
the spamd children this morning.
Overnight, all five children were using around 4 meg. This morning
sometime, one spamd child shot up to 250M:
Mem: 513948K av, 504660K used, 9288K free, 0K shrd, 15532K buff
Swap: 1052216K av, 263780K used, 788436K free 68408K cached
PID PPID USER SIZE STAT %CPU %MEM COMMAND
1537 15624 root 250M S 0.0 44.5 spamd child
25394 15624 root 40056 S 0.0 6.1 spamd child
1432 15624 root 38932 S 0.0 6.0 spamd child
1241 15624 root 38768 S 0.0 6.0 spamd child
1754 15624 root 39308 S 0.0 6.0 spamd child
Yesterday afternoon when I killed and restarted spamd, they were all using
about that much.
Mojo
--
Morris Jones <*>
Monrovia, CA
mojo@whiteoaks.com
http://www.whiteoaks.com
Re: Memory usage spikes ...
Posted by Jim Gifford <ma...@jg555.com>.
Morris Jones wrote:
>On Mon, 4 Oct 2004, David Brodbeck wrote:
>
>
>
>>I've seen this problem. I avoid it by bypassing SpamAssassin for all mail
>>larger than 1 megabyte. Very little spam is this large, since it'd be
>>inefficient to send.
>>
>>
>
>I'm already bypassing it for anything over 256000 bytes.
>
>Mojo
>
>
Same here.
--
----
Jim Gifford
maillist@jg555.com
RE: Memory usage spikes ...
Posted by Morris Jones <mo...@whiteoaks.com>.
On Mon, 4 Oct 2004, David Brodbeck wrote:
> I've seen this problem. I avoid it by bypassing SpamAssassin for all mail
> larger than 1 megabyte. Very little spam is this large, since it'd be
> inefficient to send.
I'm already bypassing it for anything over 256000 bytes.
Mojo
--
Morris Jones <*>
Monrovia, CA
mojo@whiteoaks.com
http://www.whiteoaks.com
RE: Memory usage spikes ...
Posted by David Brodbeck <gu...@gull.us>.
On Sun, 3 Oct 2004 12:00:51 -0700, Potato Chip wrote
> It's happened to me about 3 times, where an email will be sent to my
> server that specifically causes the problem. Killing the spamd process
> causes the sending MTA to resend. It usually occurs with an email
> with a large MIME attachment. In the last occurrence, the attachment
> was around 20MB and was only a .TXT attachment. The sending MTA will
> resend its Scud missle and I'll see the 250MB spamd process using up
> all available CPU.
I've seen this problem. I avoid it by bypassing SpamAssassin for all mail
larger than 1 megabyte. Very little spam is this large, since it'd be
inefficient to send.
Re: Memory usage spikes ...
Posted by John Fleming <jo...@wa9als.com>.
----- Original Message -----
From: "Potato Chip" <jc...@jline.com>
To: <us...@spamassassin.apache.org>
Sent: Sunday, October 03, 2004 2:00 PM
Subject: RE: Memory usage spikes ...
> I've been calling this the Email Scud problem. I've been hoping for a
> patriot missle for a long time. I have noticed the same problem with
> v2.63 and v2.64. I upgraded to v3.0 hoping that the problem would go
> away but it's still there.
>
> It's happened to me about 3 times, where an email will be sent to my
> server that specifically causes the problem. Killing the spamd process
> causes the sending MTA to resend. It usually occurs with an email with a
> large MIME attachment. In the last occurrence, the attachment was around
> 20MB and was only a .TXT attachment. The sending MTA will resend its
> Scud missle and I'll see the 250MB spamd process using up all available
> CPU.
>
> Unfortunately, I didn't save the problem message and its attachment.
> Hopefully, that sheds a bit of light on this common problem.
>
> jae
>
> -----Original Message-----
> From: Morris Jones [mailto:mojo@whiteoaks.com]
> Sent: Saturday, October 02, 2004 11:44 AM
> To: users@spamassassin.apache.org
> Subject: Memory usage spikes ...
>
>
> Yesterday I commented that I was seeing spamd children eating a lot of
> memory, pushing the machine into swap. I've been keeping an eye on the
> spamd children this morning.
>
> Overnight, all five children were using around 4 meg. This morning
> sometime, one spamd child shot up to 250M:
>
> Mem: 513948K av, 504660K used, 9288K free, 0K shrd, 15532K
> buff
> Swap: 1052216K av, 263780K used, 788436K free 68408K
> cached
>
> PID PPID USER SIZE STAT %CPU %MEM COMMAND
> 1537 15624 root 250M S 0.0 44.5 spamd child
>
> 25394 15624 root 40056 S 0.0 6.1 spamd child
>
> 1432 15624 root 38932 S 0.0 6.0 spamd child
>
> 1241 15624 root 38768 S 0.0 6.0 spamd child
>
> 1754 15624 root 39308 S 0.0 6.0 spamd child
I've had the same problem, but I hadn't isolated it to a certain type of
email. v2.63 - John
RE: Memory usage spikes ...
Posted by Potato Chip <jc...@jline.com>.
I've been calling this the Email Scud problem. I've been hoping for a
patriot missle for a long time. I have noticed the same problem with
v2.63 and v2.64. I upgraded to v3.0 hoping that the problem would go
away but it's still there.
It's happened to me about 3 times, where an email will be sent to my
server that specifically causes the problem. Killing the spamd process
causes the sending MTA to resend. It usually occurs with an email with a
large MIME attachment. In the last occurrence, the attachment was around
20MB and was only a .TXT attachment. The sending MTA will resend its
Scud missle and I'll see the 250MB spamd process using up all available
CPU.
Unfortunately, I didn't save the problem message and its attachment.
Hopefully, that sheds a bit of light on this common problem.
jae
-----Original Message-----
From: Morris Jones [mailto:mojo@whiteoaks.com]
Sent: Saturday, October 02, 2004 11:44 AM
To: users@spamassassin.apache.org
Subject: Memory usage spikes ...
Yesterday I commented that I was seeing spamd children eating a lot of
memory, pushing the machine into swap. I've been keeping an eye on the
spamd children this morning.
Overnight, all five children were using around 4 meg. This morning
sometime, one spamd child shot up to 250M:
Mem: 513948K av, 504660K used, 9288K free, 0K shrd, 15532K
buff
Swap: 1052216K av, 263780K used, 788436K free 68408K
cached
PID PPID USER SIZE STAT %CPU %MEM COMMAND
1537 15624 root 250M S 0.0 44.5 spamd child
25394 15624 root 40056 S 0.0 6.1 spamd child
1432 15624 root 38932 S 0.0 6.0 spamd child
1241 15624 root 38768 S 0.0 6.0 spamd child
1754 15624 root 39308 S 0.0 6.0 spamd child
Yesterday afternoon when I killed and restarted spamd, they were all
using about that much.
Mojo
--
Morris Jones <*>
Monrovia, CA
mojo@whiteoaks.com
http://www.whiteoaks.com
Re: Memory usage spikes ...
Posted by Morris Jones <mo...@whiteoaks.com>.
When the memory usage spikes up on a spamd child, it does so on a single
message; from 36K or so up to 250M. That one message shows up in my
logs taking a _long_ time:
Oct 4 18:46:06 devilrock spamd[1800]: identified spam (12.8/5.0) for xxxx:500 in 165.3 seconds, 1490 bytes.
Most of the spams are identified in 2-4 seconds.
I decided to watch my logs for one of these to come by, and save out the
message.
But that was really useless. The message itself doesn't trigger the
memory spike. In this case the triggering message was a simple little
random spam, with a few random words thrown in. Repeat runs through
spamc give a two second result and no memory spike.
So something else is causing the memory spike. Something to do with
bayes db maintenance perhaps?
Best regards,
Mojo
On Sat, 2 Oct 2004, Morris Jones wrote:
> Yesterday I commented that I was seeing spamd children eating a lot of
> memory, pushing the machine into swap. I've been keeping an eye on
> the spamd children this morning.
>
> Overnight, all five children were using around 4 meg. This morning
> sometime, one spamd child shot up to 250M:
>
> Mem: 513948K av, 504660K used, 9288K free, 0K shrd, 15532K buff
> Swap: 1052216K av, 263780K used, 788436K free 68408K cached
>
> PID PPID USER SIZE STAT %CPU %MEM COMMAND
> 1537 15624 root 250M S 0.0 44.5 spamd child
> 25394 15624 root 40056 S 0.0 6.1 spamd child
> 1432 15624 root 38932 S 0.0 6.0 spamd child
> 1241 15624 root 38768 S 0.0 6.0 spamd child
> 1754 15624 root 39308 S 0.0 6.0 spamd child
>
> Yesterday afternoon when I killed and restarted spamd, they were all using
> about that much.
>
> Mojo
>
--
Morris Jones <*>
Monrovia, CA
mojo@whiteoaks.com
http://www.whiteoaks.com