You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Justin Mason <jm...@jmason.org> on 2005/03/16 19:56:54 UTC
Re: SA 3.0.2 MASSIVE memory cpu problems
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
I would suggest running with -D and monitoring spamd memory size
as it starts up. Something is causing it to balloon to massive
sizes after startup.
Presumably you are limiting the size of the messages sent in for scanning,
as recommended in the documentation? Scanning messages over 500KB in size
will result in a corresponding increase in resident size for the scanner
process, so a very large message could cause a massive scanner process.
(spamc will do this limit by default.)
Also you're the first person on linux to note the "select timeout
failed" bug. could you attach output from strace and "spamd -D"
to a new bugzilla bug on this?
- --j.
Wolfgang.Fuertbauer@ebewe.com writes:
> Greg,
> i have
>
> use_auto_whitelist 0
>
> in the local.cf
>
> But thanks anyway
> Wolfgang
>
> "Greg Allen" <ga...@netrox.net> schrieb am 16.03.2005 13:54:24:
>
> > Some users have had problems with corrupt AWL database after upgrade of
> > Spamassassin. Try disabling AWL to see if that is your issue.
>
> >
> > -----Original Message-----
> > From: Wolfgang.Fuertbauer@ebewe.com
> > [mailto:Wolfgang.Fuertbauer@ebewe.com]
> > Sent: Wednesday, March 16, 2005 5:44 AM
> > To: spamassassin-users@incubator.apache.org
> > Cc: Leopold.Schenner@ebewe.com
> > Subject: SA 3.0.2 MASSIVE memory cpu problems
>
> >
> > Dear collegues,
>
> > I'm having still extrem problems with memory and cpu consumation of SA
> > 3.0.2 spamd;
>
> > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ Command
> > 19098 exim 30 5 399m 398m 34m R 99.7 65.8 1:37.47 spamd
> > 19121 exim 20 5 111m 111m 34m S 0.7 4.4 0:20.78 spamd
> > 24591 exim 22 5 75844 74m 35m S 0.0 2.9 0:02.90 spamd
> > 25802 exim 21 5 75040 73m 35m S 0.0 2.9 0:01.46 spamd
> > 20548 exim 20 5 69836 68m 67m S 0.0 2.7 0:03.03 spamd
> > 26479 exim 20 5 69836 68m 67m S 0.0 2.7 0:00.00 spamd
>
> > I already limited the # of children to 5 and the # of connections to 20
> > my own comment on this problem some month (restart spamd daily) does not
> > work anymore;
>
> > I've seen, there is a patch in Bugzilla addressing this problem, which
> > hasn't made his
> > way into 3.0.2; I tried to apply it against 3.0.2 with the following
> > result:
>
> > Mar 16 05:47:03 saxophon spamd[5201]: prefork: select timeout failed!
> > recovering
> > (repeated 20x and more)
>
> > the only solution for the moment is to restart spamd on an hourly basis
> ?!
>
> > WHAT CAN I DO?
>
> > Wolfgang
> > P.S.: some environment
>
> > perl -v
> > This is perl, v5.8.0 built for i586-linux-thread-multi
>
> > saxophon:~ # spamassassin -V
> > SpamAssassin version 3.0.2
> > running on Perl version
> > saxophon:~ # uname -a
> > Linux saxophon 2.4.20-64GB-SMP #1 SMP Fri Jan 14 15:08:48 UTC 2005 i686
> > unknown unknown GNU/Linux
>
> > ----------------------------------------------------------------------
> > Wolfgang Fuertbauer (E-Mail: Wolfgang.Fuertbauer@ebewe.com)
> > EBEWE Pharma
> > Mondseestrasse 11
> > 4866 Unterach, Austria
> > Tel: ++43 7665 8123 315
> > Fax: ++43 7665 8123 11
> > http://www.ebewe.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.5 (GNU/Linux)
Comment: Exmh CVS
iD8DBQFCOIF2MJF5cimLx9ARApqoAJ46iCjfM13XD0MF08ViuuduVW6ASACfRat9
XaB8642NZWeXoclyDuLXR0g=
=v3ys
-----END PGP SIGNATURE-----
Re: Re: SA 3.0.2 MASSIVE memory cpu problems
Posted by qqqq <qq...@usermail.com>.
Same problem here. I have written a script to cycle spamd when the CPU hits
a load average of 8 for now.
QQQQ
----- Original Message -----
From: <Wo...@ebewe.com>
To: "Justin Mason" <jm...@jmason.org>
Cc: <sp...@incubator.apache.org>
Sent: Tuesday, March 22, 2005 5:53 AM
Subject: Re: Re: SA 3.0.2 MASSIVE memory cpu problems
| please help! still no solution for that!
| still massive CPU and Mem problems
|
| jm@jmason.org schrieb am 16.03.2005 19:56:54:
|
| > -----BEGIN PGP SIGNED MESSAGE-----
| > Hash: SHA1
|
| >
| > I would suggest running with -D and monitoring spamd memory size
| > as it starts up. Something is causing it to balloon to massive
| > sizes after startup.
|
| > Presumably you are limiting the size of the messages sent in for
| scanning,
| > as recommended in the documentation? Scanning messages over 500KB in
size
| > will result in a corresponding increase in resident size for the scanner
| > process, so a very large message could cause a massive scanner process.
| > (spamc will do this limit by default.)
|
| > Also you're the first person on linux to note the "select timeout
| > failed" bug. could you attach output from strace and "spamd -D"
| > to a new bugzilla bug on this?
|
| > - --j.
|
| > Wolfgang.Fuertbauer@ebewe.com writes:
| > > Greg,
| > > i have
| > >
| > > use_auto_whitelist 0
| > >
| > > in the local.cf
| > >
| > > But thanks anyway
| > > Wolfgang
| > >
| > > "Greg Allen" <ga...@netrox.net> schrieb am 16.03.2005 13:54:24:
| > >
| > > > Some users have had problems with corrupt AWL database after upgrade
| of
| > > > Spamassassin. Try disabling AWL to see if that is your issue.
| > >
| > > >
| > > > -----Original Message-----
| > > > From: Wolfgang.Fuertbauer@ebewe.com
| > > > [mailto:Wolfgang.Fuertbauer@ebewe.com]
| > > > Sent: Wednesday, March 16, 2005 5:44 AM
| > > > To: spamassassin-users@incubator.apache.org
| > > > Cc: Leopold.Schenner@ebewe.com
| > > > Subject: SA 3.0.2 MASSIVE memory cpu problems
| > >
| > > >
| > > > Dear collegues,
| > >
| > > > I'm having still extrem problems with memory and cpu consumation of
| SA
| > > > 3.0.2 spamd;
| > >
| > > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ Command
| > > > 19098 exim 30 5 399m 398m 34m R 99.7 65.8 1:37.47 spamd
| > > > 19121 exim 20 5 111m 111m 34m S 0.7 4.4 0:20.78 spamd
| > > > 24591 exim 22 5 75844 74m 35m S 0.0 2.9 0:02.90 spamd
| > > > 25802 exim 21 5 75040 73m 35m S 0.0 2.9 0:01.46 spamd
| > > > 20548 exim 20 5 69836 68m 67m S 0.0 2.7 0:03.03 spamd
| > > > 26479 exim 20 5 69836 68m 67m S 0.0 2.7 0:00.00 spamd
| > >
| > > > I already limited the # of children to 5 and the # of connections to
| 20
| > > > my own comment on this problem some month (restart spamd daily) does
| not
| > > > work anymore;
| > >
| > > > I've seen, there is a patch in Bugzilla addressing this problem,
| which
| > > > hasn't made his
| > > > way into 3.0.2; I tried to apply it against 3.0.2 with the following
| > > > result:
| > >
| > > > Mar 16 05:47:03 saxophon spamd[5201]: prefork: select timeout
failed!
| > > > recovering
| > > > (repeated 20x and more)
| > >
| > > > the only solution for the moment is to restart spamd on an hourly
| basis
| > > ?!
| > >
| > > > WHAT CAN I DO?
| > >
| > > > Wolfgang
| > > > P.S.: some environment
| > >
| > > > perl -v
| > > > This is perl, v5.8.0 built for i586-linux-thread-multi
| > >
| > > > saxophon:~ # spamassassin -V
| > > > SpamAssassin version 3.0.2
| > > > running on Perl version
| > > > saxophon:~ # uname -a
| > > > Linux saxophon 2.4.20-64GB-SMP #1 SMP Fri Jan 14 15:08:48 UTC 2005
| i686
| > > > unknown unknown GNU/Linux
| > >
| > > >
| ----------------------------------------------------------------------
| > > > Wolfgang Fuertbauer (E-Mail: Wolfgang.Fuertbauer@ebewe.com)
| > > > EBEWE Pharma
| > > > Mondseestrasse 11
| > > > 4866 Unterach, Austria
| > > > Tel: ++43 7665 8123 315
| > > > Fax: ++43 7665 8123 11
| > > > http://www.ebewe.com
| > -----BEGIN PGP SIGNATURE-----
| > Version: GnuPG v1.2.5 (GNU/Linux)
| > Comment: Exmh CVS
|
| > iD8DBQFCOIF2MJF5cimLx9ARApqoAJ46iCjfM13XD0MF08ViuuduVW6ASACfRat9
| > XaB8642NZWeXoclyDuLXR0g=
| > =v3ys
| > -----END PGP SIGNATURE-----
| ----------------------------------------------------------------------
| Wolfgang Fuertbauer (E-Mail: Wolfgang.Fuertbauer@ebewe.com)
| EBEWE Pharma
| Mondseestrasse 11
| 4866 Unterach, Austria
| Tel: ++43 7665 8123 315
| Fax: ++43 7665 8123 11
| http://www.ebewe.com
|
|
Re: Re: SA 3.0.2 MASSIVE memory cpu problems
Posted by Wo...@ebewe.com.
please help! still no solution for that!
still massive CPU and Mem problems
jm@jmason.org schrieb am 16.03.2005 19:56:54:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> I would suggest running with -D and monitoring spamd memory size
> as it starts up. Something is causing it to balloon to massive
> sizes after startup.
> Presumably you are limiting the size of the messages sent in for
scanning,
> as recommended in the documentation? Scanning messages over 500KB in size
> will result in a corresponding increase in resident size for the scanner
> process, so a very large message could cause a massive scanner process.
> (spamc will do this limit by default.)
> Also you're the first person on linux to note the "select timeout
> failed" bug. could you attach output from strace and "spamd -D"
> to a new bugzilla bug on this?
> - --j.
> Wolfgang.Fuertbauer@ebewe.com writes:
> > Greg,
> > i have
> >
> > use_auto_whitelist 0
> >
> > in the local.cf
> >
> > But thanks anyway
> > Wolfgang
> >
> > "Greg Allen" <ga...@netrox.net> schrieb am 16.03.2005 13:54:24:
> >
> > > Some users have had problems with corrupt AWL database after upgrade
of
> > > Spamassassin. Try disabling AWL to see if that is your issue.
> >
> > >
> > > -----Original Message-----
> > > From: Wolfgang.Fuertbauer@ebewe.com
> > > [mailto:Wolfgang.Fuertbauer@ebewe.com]
> > > Sent: Wednesday, March 16, 2005 5:44 AM
> > > To: spamassassin-users@incubator.apache.org
> > > Cc: Leopold.Schenner@ebewe.com
> > > Subject: SA 3.0.2 MASSIVE memory cpu problems
> >
> > >
> > > Dear collegues,
> >
> > > I'm having still extrem problems with memory and cpu consumation of
SA
> > > 3.0.2 spamd;
> >
> > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ Command
> > > 19098 exim 30 5 399m 398m 34m R 99.7 65.8 1:37.47 spamd
> > > 19121 exim 20 5 111m 111m 34m S 0.7 4.4 0:20.78 spamd
> > > 24591 exim 22 5 75844 74m 35m S 0.0 2.9 0:02.90 spamd
> > > 25802 exim 21 5 75040 73m 35m S 0.0 2.9 0:01.46 spamd
> > > 20548 exim 20 5 69836 68m 67m S 0.0 2.7 0:03.03 spamd
> > > 26479 exim 20 5 69836 68m 67m S 0.0 2.7 0:00.00 spamd
> >
> > > I already limited the # of children to 5 and the # of connections to
20
> > > my own comment on this problem some month (restart spamd daily) does
not
> > > work anymore;
> >
> > > I've seen, there is a patch in Bugzilla addressing this problem,
which
> > > hasn't made his
> > > way into 3.0.2; I tried to apply it against 3.0.2 with the following
> > > result:
> >
> > > Mar 16 05:47:03 saxophon spamd[5201]: prefork: select timeout failed!
> > > recovering
> > > (repeated 20x and more)
> >
> > > the only solution for the moment is to restart spamd on an hourly
basis
> > ?!
> >
> > > WHAT CAN I DO?
> >
> > > Wolfgang
> > > P.S.: some environment
> >
> > > perl -v
> > > This is perl, v5.8.0 built for i586-linux-thread-multi
> >
> > > saxophon:~ # spamassassin -V
> > > SpamAssassin version 3.0.2
> > > running on Perl version
> > > saxophon:~ # uname -a
> > > Linux saxophon 2.4.20-64GB-SMP #1 SMP Fri Jan 14 15:08:48 UTC 2005
i686
> > > unknown unknown GNU/Linux
> >
> > >
----------------------------------------------------------------------
> > > Wolfgang Fuertbauer (E-Mail: Wolfgang.Fuertbauer@ebewe.com)
> > > EBEWE Pharma
> > > Mondseestrasse 11
> > > 4866 Unterach, Austria
> > > Tel: ++43 7665 8123 315
> > > Fax: ++43 7665 8123 11
> > > http://www.ebewe.com
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.2.5 (GNU/Linux)
> Comment: Exmh CVS
> iD8DBQFCOIF2MJF5cimLx9ARApqoAJ46iCjfM13XD0MF08ViuuduVW6ASACfRat9
> XaB8642NZWeXoclyDuLXR0g=
> =v3ys
> -----END PGP SIGNATURE-----
----------------------------------------------------------------------
Wolfgang Fuertbauer (E-Mail: Wolfgang.Fuertbauer@ebewe.com)
EBEWE Pharma
Mondseestrasse 11
4866 Unterach, Austria
Tel: ++43 7665 8123 315
Fax: ++43 7665 8123 11
http://www.ebewe.com