You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by "Dan Mahoney, System Admin" <da...@prime.gushi.org> on 2006/03/02 19:04:30 UTC

Re: [sa-list] Re: Spamd keeps getting hung up!

On Fri, 10 Feb 2006, Daryl C. W. O'Shea wrote:

Had another hangup today.  Should I comment on the bug report, or just 
reply here, and note http://www.gushi.org/maillog.txt

-Dan


> Dan Mahoney, System Admin wrote:
>> Hey All,
>> 
>> I've been running the latest spamd for months now, and it seems to be a 
>> weekly (at least) occurence that all my child processes will fill up and 
>> hang the thing and allow spam to start seeping through.
>> 
>> However, today I woke up to find this error:
>> 
>> Feb 10 08:57:40 quark spamd[66716]: prefork: select returned error on 
>> server filehandle: Bad file descriptor
>> Feb 10 08:57:51 quark last message repeated 20403 times
>
> Please try out Justin's latest patch in bug 4696 and PLEASE comment on that 
> bug to let us know how it goes.  Even if it doesn't fix your problem, it'll 
> probably provide different errors that may help us.
>
> http://issues.apache.org/SpamAssassin/show_bug.cgi?id=4696
>
>
> Daryl
>

--

"Long live little fat girls!"

-Recent Taco Bell Ad Slogan, Literally Translated.  (Viva Gorditas)

--------Dan Mahoney--------
Techie,  Sysadmin,  WebGeek
Gushi on efnet/undernet IRC
ICQ: 13735144   AIM: LarpGM
Site:  http://www.gushi.org
---------------------------


Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by Theo Van Dinter <fe...@apache.org>.
On Thu, Mar 02, 2006 at 01:33:24PM -0500, Dan Mahoney, System Admin wrote:
> Here's the errors I'm currently seeing that do not seem right to me:
> 
> 1) An error relating to Textcat that I can find no real documentation on 
> in the wiki or the docs, and reading the source does not imply specifying 
> a filename:
> 
> Mar  2 13:09:07 quark spamd[52083]: textcat: languages filename not 
> defined at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Plugin/TextCat.pm 
> line 320.

There should be a file called "languages" in the default rules directory
(/usr/share/spamassassin).  It gets installed with the standard rules.  If
it's not there, TextCat won't work.

> 2) A bunch of warnings, all in a row (I see this regularly, I think when 
> a new child spawns):
> 
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in addition 
> (+) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 

This is related to http://issues.apache.org/SpamAssassin/show_bug.cgi?id=4699

We still haven't been able to standardly reproduce the issue, so it's hard to
track down.

> 3) This on startup:
> 
> Mar  2 13:43:57 quark spamd[52090]: Use of uninitialized value in pattern 
> match (m//) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Conf/Parser.pm line 
> 547, <GEN2752> line 2.
> Mar  2 13:43:57 quark spamd[52090]: Use of uninitialized value in pattern 
> match (m//) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Conf/Parser.pm line 
> 547, <GEN2752> line 2.

Could be related to the above.  line 547 in 3.1.0 is:

      $set_score = -$set_score if ( $conf->{tflags}->{$k} =~ /\bnice\b/ );

This should definitely never be possible with the standard code.  When a rule
is added, the function that adds it specifically does:

  $conf->{tflags}->{$name} ||= '';

The #2 issue above is that there's a rule hit for a rule without a score set,
which should also never be possible -- in fact, the function from #3 sets the
default score for all rules, which means #2 shouldn't be possible.

-- 
Randomly Generated Tagline:
Two heads are better than one.
 		-- John Heywood

Errors in SQL config.

Posted by "Dan Mahoney, System Admin" <da...@prime.gushi.org>.
On Wed, 8 Mar 2006, Dan Mahoney, System Admin wrote:

> On Wed, 8 Mar 2006, Daryl C. W. O'Shea wrote:
>
>> On 08/03/06 09:17 PM, Dan Mahoney, System Admin wrote:
>>> On Tue, 7 Mar 2006, Theo Van Dinter wrote:
>>> 
>>>> On Tue, Mar 07, 2006 at 08:14:38PM -0500, Dan Mahoney, System Admin 
>>>> wrote:
>> 
>>> [Odd SQL Error]

Nevermind.  You said "invalid", and I misunderstood that you said it 
meaning obsolete/deprecated, as opposed to "incorrectly formatted". 
*foreheadsmack*

Is there a complete list of deprecated options somewhere (along with the 
versions they were valid for, and/or what's replaced them?)  I know for 
the most recent version, it's always in the release notes -- but it would 
be good if SA could warn on obsolete options.

Alternatively -- is there an easy way to make use of the 
Mail::SpamAssassin::Conf class when importing options INTO my DB?

Sorry to come at you guys with so many issues at once -- the desire to 
clean up the original issue is making me take further scrutiny on my logs 
than probably ever before.

-Dan

--

"You're a nomad billygoat!"

-Juston, July 18th, 2002

--------Dan Mahoney--------
Techie,  Sysadmin,  WebGeek
Gushi on efnet/undernet IRC
ICQ: 13735144   AIM: LarpGM
Site:  http://www.gushi.org
---------------------------


Re: Spamd keeps getting hung up!

Posted by "Dan Mahoney, System Admin" <da...@prime.gushi.org>.
On Wed, 8 Mar 2006, Daryl C. W. O'Shea wrote:

> On 08/03/06 09:17 PM, Dan Mahoney, System Admin wrote:
>> On Tue, 7 Mar 2006, Theo Van Dinter wrote:
>> 
>>> On Tue, Mar 07, 2006 at 08:14:38PM -0500, Dan Mahoney, System Admin wrote:
>
>> [Odd SQL Error]

> Just because the configs are in a SQL database, doesn't mean that they'll 
> work even though they are invalid.  ;)
>
> Underscore or not, they're not valid.

That's fine -- but the format they're IN in the DB *IS* valid.  Somewhere 
between being in the DB and getting read into spamd something's putting an 
underscore where there should be whitespace (hence my logic at pasting 
those SQL queries -- note that it also ONLY happens for certain prefs, 
too -- another user could have identical prefs and be fine)

It's a separate issue from the lockups -- and I'm not sure why it's 
happening -- but it's definitely an issue.  What action is best to take on 
this?  Bug report?  It goes without saying here, but if anyone needs a 
shell (I think JM has one on the box where spamc runs), let me know and 
I'll get you one without question.

>> [pyzor, razor, dcc]
>> 
>>>> I could see trouble with any ONE of these things -- but all three?
>>>> Something feels odd.
>>> 
>>> Do you have a firewall blocking those services from working?
>> 
>> No firewall at all, and those processes hit (as in, generate scores) most 
>> of the time.  I'm under the impression if they were going to be killed by a 
>> firewall config, it would be a very all or nothing type thing.
>> 
>> It's a realtek NIC, but that shouldn't matter at all since ALL this box 
>> does is mysql and spam processes (less than a meg).  Duplex is 100/full 
>> (auto) on a known good (but unmanaged) switch.
>
> Well, if the timeouts (and they are just timeouts) are congestion related, it 
> would make sense that all three would timeout.

True, of course.  I don't think it's congestion either -- although at some 
point we may start running our own (public) DCC server in-house.  Need to 
speak to Vernon about that.

>> And there was the mention I saw earlier of still-escaping alarms. However, 
>> I haven't had a true lockup since making all these changes. Usually those 
>> happen late at night when I say "they musta fixed it, things haven't locked 
>> up in a while..." :)
>
> Mine only hangs up when I think to myself, "gee it's been awhile since it 
> last hung up" and then proceed to travel at least three hours away form the 
> server, often far from connectivity or into exceptionally slow or unreliable 
> dial-up land.

It's at the point where I've thought about having a process tail -F the 
log for the occurence of BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB, and take action 
on it.  There's only been once or twice where it's hung up AGAIN after 
restarting -- usually on a ton of messages for one user.  This is usually 
the point at which I send a message to the mailing list about "can we 
please get a way to dump messages-in-process to a single file, ala the 
apache server-status screen" so I can see WHY it's hanging up, and on 
which rule.

On the thought that it's congestion, maybe I should start running 
smokeping against the various servers utilized by dcc/pyzor/razor -- 
would anyone else be interested in this data?

>> I'll let you guys know as soon as I do (it does), however.  __alarm__ 
>> messages without a corresponding freeze CONCERN me, but not NEARLY as much 
>> as when the system is "of a down".
>
> "__alarm__" without another warning explaining it immediately afterwards are 
> bad.
>
> "__alarm__ignore__" are just timeouts that can be, well, ignored.

I await your reply :)

-Dan

--

"The first annual 5th of July party...have you been invited?"
"It's a Jack Party."
"Okay, so Long Island's been invited."

--Cali and Gushi, 6/23/02


--------Dan Mahoney--------
Techie,  Sysadmin,  WebGeek
Gushi on efnet/undernet IRC
ICQ: 13735144   AIM: LarpGM
Site:  http://www.gushi.org
---------------------------


Re: [sa-list] Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by "Daryl C. W. O'Shea" <sp...@dostech.ca>.
On 08/03/06 09:17 PM, Dan Mahoney, System Admin wrote:
> On Tue, 7 Mar 2006, Theo Van Dinter wrote:
> 
>> On Tue, Mar 07, 2006 at 08:14:38PM -0500, Dan Mahoney, System Admin 
>> wrote:

> [Odd SQL Error]
> 
>>
>>> The only VERY ODD error I am seeing now (and only for ONE user) is this:
>>>
>>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>>> skipping: rewrite_subject_0
>>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>>> skipping: report_header_1
>>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>>> skipping: use_terse_report_1
>>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>>> skipping: defang_mime_0
>>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>>> skipping: auto_learn_0
>>
>> Why are these odd?  None of these are valid config lines for 3.1.
> 
> Because my configs are in a SQL database, and for that user, the config 
> lines look totally normal.  For this user only, the SQL interpreter is 
> adding an underscore where there shouldn't be one.  The user doesn't 
> even have a homedir on the system where spamd runs -- and spamd runs as 
> user "spamd" who has no prefs of its own.

Just because the configs are in a SQL database, doesn't mean that 
they'll work even though they are invalid.  ;)

Underscore or not, they're not valid.


> [pyzor, razor, dcc]
> 
>>> I could see trouble with any ONE of these things -- but all three?
>>> Something feels odd.
>>
>> Do you have a firewall blocking those services from working?
> 
> No firewall at all, and those processes hit (as in, generate scores) 
> most of the time.  I'm under the impression if they were going to be 
> killed by a firewall config, it would be a very all or nothing type thing.
> 
> It's a realtek NIC, but that shouldn't matter at all since ALL this box 
> does is mysql and spam processes (less than a meg).  Duplex is 100/full 
> (auto) on a known good (but unmanaged) switch.

Well, if the timeouts (and they are just timeouts) are congestion 
related, it would make sense that all three would timeout.


> And there was the mention I saw earlier of still-escaping alarms. 
> However, I haven't had a true lockup since making all these changes. 
> Usually those happen late at night when I say "they musta fixed it, 
> things haven't locked up in a while..." :)

Mine only hangs up when I think to myself, "gee it's been awhile since 
it last hung up" and then proceed to travel at least three hours away 
form the server, often far from connectivity or into exceptionally slow 
or unreliable dial-up land.


> I'll let you guys know as soon as I do (it does), however.  __alarm__ 
> messages without a corresponding freeze CONCERN me, but not NEARLY as 
> much as when the system is "of a down".

"__alarm__" without another warning explaining it immediately afterwards 
are bad.

"__alarm__ignore__" are just timeouts that can be, well, ignored.


Daryl


Re: [sa-list] Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by Michael Parker <pa...@pobox.com>.
Theo Van Dinter wrote:
> On Wed, Mar 08, 2006 at 09:17:52PM -0500, Dan Mahoney, System Admin wrote:
>>>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>>>> skipping: rewrite_subject_0
>>> Why are these odd?  None of these are valid config lines for 3.1.
>> Because my configs are in a SQL database, and for that user, the config 
>> lines look totally normal.  For this user only, the SQL interpreter is 
>> adding an underscore where there shouldn't be one.
> 
> I have a feeling this is a display issue with the error message and not
> when reading in the options (or else every option would throw an error).
> Regardless of that, the options are invalid so the errors are valid.
> 

The logger module replaces spaces with underscores.

Michael

Re: Spamd keeps getting hung up!

Posted by "Dan Mahoney, System Admin" <da...@prime.gushi.org>.
On Wed, 8 Mar 2006, Theo Van Dinter wrote:

>> match (m//) at /usr/local/lib/perl5/site_perl/5.8.6/Mail/S
>> pamAssassin/Conf/Parser.pm line 547, <GEN2284> line 2.
>
>      $set_score = -$set_score if ( $conf->{tflags}->{$k} =~ /\bnice\b/ );
>
> $conf->{tflags}->{$k} is undefined, which shouldn't be possible with the
> standard code (tflags are set to '' whenever a test is added).

So what should I do about it?  Apply the line above?

>> No firewall at all, and those processes hit (as in, generate scores) most
>> of the time.  I'm under the impression if they were going to be killed by
>> a firewall config, it would be a very all or nothing type thing.
>
> Sure.  If it's intermittant, and not a local system issue, it could just be
> timeouts on the Internet connect, at the remote end, etc.

Which I guess begs the question -- is there a way to get more verbose 
logging from those three services?  Either related to connection times on 
average, or at least spewing timeout/connect failures in the log.

Usualy on nights I'm having connectivity issues, other "odd" things 
happen.  IRC connections bounce.  My IM connection (which runs from the 
server) hangs up, and of course, people complain.

I'm not saying this is NOT it, but I haven't noticed a correlation between 
SA hangups and this.

--

"You're a daddy.  I'm a mommy.  She's our baby.  Deal with it."

-Cali, 11/7/02, about 1:35 AM

--------Dan Mahoney--------
Techie,  Sysadmin,  WebGeek
Gushi on efnet/undernet IRC
ICQ: 13735144   AIM: LarpGM
Site:  http://www.gushi.org
---------------------------


Re: [sa-list] Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by Theo Van Dinter <fe...@apache.org>.
On Wed, Mar 08, 2006 at 09:17:52PM -0500, Dan Mahoney, System Admin wrote:
> >>Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
> >>skipping: rewrite_subject_0
> >Why are these odd?  None of these are valid config lines for 3.1.
> 
> Because my configs are in a SQL database, and for that user, the config 
> lines look totally normal.  For this user only, the SQL interpreter is 
> adding an underscore where there shouldn't be one.

I have a feeling this is a display issue with the error message and not
when reading in the options (or else every option would throw an error).
Regardless of that, the options are invalid so the errors are valid.

> Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
> skipping: report_header_1
> Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
> skipping: use_terse_report_0
> Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
> skipping: defang_mime_1
> Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
> skipping: bayes_auto_learn_threshold_spa_6.6
> Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
> skipping: bayes_auto_learn_threshold_non_2.0

these are all invalid options as well.

> Mar  8 00:01:57 quark spamd[83570]: Use of uninitialized value in pattern 
> match (m//) at /usr/local/lib/perl5/site_perl/5.8.6/Mail/S
> pamAssassin/Conf/Parser.pm line 547, <GEN2284> line 2.

      $set_score = -$set_score if ( $conf->{tflags}->{$k} =~ /\bnice\b/ );

$conf->{tflags}->{$k} is undefined, which shouldn't be possible with the
standard code (tflags are set to '' whenever a test is added).

> >Do you have a firewall blocking those services from working?
> 
> No firewall at all, and those processes hit (as in, generate scores) most 
> of the time.  I'm under the impression if they were going to be killed by 
> a firewall config, it would be a very all or nothing type thing.

Sure.  If it's intermittant, and not a local system issue, it could just be
timeouts on the Internet connect, at the remote end, etc.

-- 
Randomly Generated Tagline:
"The quickest way to double your money is to fold it in half and put it
 back in your pocket." - Zen Musings

Re: [sa-list] Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by "Dan Mahoney, System Admin" <da...@prime.gushi.org>.
On Tue, 7 Mar 2006, Theo Van Dinter wrote:

> On Tue, Mar 07, 2006 at 08:14:38PM -0500, Dan Mahoney, System Admin wrote:

>>> =item languages_filename
>>>
>>> If you want to be able to use the language-guessing rule
>>> C<UNWANTED_LANGUAGE_BODY>, and are using C<config_text> instead of
>>> C<rules_filename>, C<site_rules_filename>, and C<userprefs_filename>, you
> [...]
>>
>> I'm NOT using rules_text though, unless this is the default behavior.
>> I got this for a while:
>>
>> Mar  7 19:51:17 quark spamd[81728]: config: failed to parse line,
>> skipping: languages_filename /usr/local/share/spamassassin/languages
>
> rules_text, languages_filename, etc, are parameters to the Mail::SpamAssassin
> object during creation, not config options.  So "languages_filename" won't
> really help you unless you're writing your own code.
>
>> I gave up and disabled textcat -- it's a shame, I'd like to use it.
>
> TextCat will use <default path to rules>/languages.  Run "spamassassin -D
> --lint" and look for the default rules line:
>
> [22346] dbg: config: using "/usr/share/spamassassin" for default rules dir

Yes, it did.  I'll kill that bug off in a few.  Thanks.  BTW, for some 
reason the languages file was MISSING originally.  Possibly due to package 
maintainer insanity, I've been using SA for a WHILE now.

> I responded with this information in the ticket but you never responded.

I'll deal with the ticket shortly.

[Odd SQL Error]

>
>> The only VERY ODD error I am seeing now (and only for ONE user) is this:
>>
>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>> skipping: rewrite_subject_0
>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>> skipping: report_header_1
>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>> skipping: use_terse_report_1
>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>> skipping: defang_mime_0
>> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line,
>> skipping: auto_learn_0
>
> Why are these odd?  None of these are valid config lines for 3.1.

Because my configs are in a SQL database, and for that user, the config 
lines look totally normal.  For this user only, the SQL interpreter is 
adding an underscore where there shouldn't be one.  The user doesn't even 
have a homedir on the system where spamd runs -- and spamd runs as user 
"spamd" who has no prefs of its own.

mysql> select * from userpref WHERE username = 'cww'
     -> ;
+----------+------------------+--------------------+--------+
| username | preference       | value              | prefid |
+----------+------------------+--------------------+--------+
| cww      | required_hits    | 6                  |    600 |
| cww      | rewrite_subject  | 0                  |    601 |
| cww      | report_header    | 1                  |    602 |
| cww      | report_safe      | 1                  |    603 |
| cww      | use_terse_report | 1                  |    604 |
| cww      | defang_mime      | 0                  |    605 |
| cww      | whitelist_from   | list@myucomics.com |    606 |
| cww      | whitelist_from   | *@rwmt.com         |    607 |
| cww      | whitelist_from   | *komando.com       |    608 |
| cww      | use_bayes        | 0                  |    609 |
| cww      | auto_learn       | 0                  |    610 |
+----------+------------------+--------------------+--------+

It's definitely that user, but just to be sure, I decided to double check:

mysql> select * from userpref where preference LIKE "%subject%";
+-----------------------+------------------------+---------------+--------+
| username              | preference             | value         | prefid 
|
+-----------------------+------------------------+---------------+--------+
| mirthika              | rewrite_subject        | 0             |    211 
|
| computechie           | subject_tag            | {SpamAssasin} |    230 
|
| madge@prime.gushi.org | rewrite_header subject | SPAM          |    442 
|
| cww                   | rewrite_subject        | 0             |    601 
|
+-----------------------+------------------------+---------------+--------+
4 rows in set (0.02 sec)

Here's proof it's that user:

Mar  8 00:04:21 quark spamd[83570]: config: failed to parse line, 
skipping: rewrite_subject_0
Mar  8 00:04:21 quark spamd[83570]: config: failed to parse line, 
skipping: report_header_1
Mar  8 00:04:21 quark spamd[83570]: config: failed to parse line, 
skipping: use_terse_report_1
Mar  8 00:04:21 quark spamd[83570]: config: failed to parse line, 
skipping: defang_mime_0
Mar  8 00:04:21 quark spamd[83570]: config: failed to parse line, 
skipping: auto_learn_0
Mar  8 00:04:21 quark spamd[83570]: Use of uninitialized value in pattern 
match (m//) at /usr/local/lib/perl5/site_perl/5.8.6/Mail/S
pamAssassin/Conf/Parser.pm line 547, <GEN2412> line 2.
Mar  8 00:04:21 quark spamd[83570]: Use of uninitialized value in pattern 
match (m//) at /usr/local/lib/perl5/site_perl/5.8.6/Mail/S
pamAssassin/Conf/Parser.pm line 547, <GEN2412> line 2.
Mar  8 00:04:21 quark spamd[83570]: spamd: processing message 
<21...@0845dial.com> for cww:58

OCCASIONALLY I see it for other users, like this -- however cww hits ALL 
the time:

Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
skipping: report_header_1
Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
skipping: use_terse_report_0
Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
skipping: defang_mime_1
Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
skipping: bayes_auto_learn_threshold_spa_6.6
Mar  8 00:01:57 quark spamd[83570]: config: failed to parse line, 
skipping: bayes_auto_learn_threshold_non_2.0
Mar  8 00:01:57 quark spamd[83570]: Use of uninitialized value in pattern 
match (m//) at /usr/local/lib/perl5/site_perl/5.8.6/Mail/S
pamAssassin/Conf/Parser.pm line 547, <GEN2284> line 2.
Mar  8 00:01:57 quark spamd[83570]: Use of uninitialized value in pattern 
match (m//) at /usr/local/lib/perl5/site_perl/5.8.6/Mail/S
pamAssassin/Conf/Parser.pm line 547, <GEN2284> line 2.
Mar  8 00:01:57 quark spamd[83570]: spamd: processing message 
<14...@guruweb2> for sdk:58

That's likely the cause of the uninitialized pattern error -- I believe 
one of you (Justin/Theo/Daryl) suggested a possible fix -- should I try it 
-- it wouldn't fix the fact that these things are being occasionally put 
together wrong, but would at least quell the uninitialzed value error :)

[pyzor, razor, dcc]

>> I could see trouble with any ONE of these things -- but all three?
>> Something feels odd.
>
> Do you have a firewall blocking those services from working?

No firewall at all, and those processes hit (as in, generate scores) most 
of the time.  I'm under the impression if they were going to be killed by 
a firewall config, it would be a very all or nothing type thing.

It's a realtek NIC, but that shouldn't matter at all since ALL this box 
does is mysql and spam processes (less than a meg).  Duplex is 100/full 
(auto) on a known good (but unmanaged) switch.

And there was the mention I saw earlier of still-escaping alarms. 
However, I haven't had a true lockup since making all these changes. 
Usually those happen late at night when I say "they musta fixed it, things 
haven't locked up in a while..." :)

I'll let you guys know as soon as I do (it does), however.  __alarm__ 
messages without a corresponding freeze CONCERN me, but not NEARLY as much 
as when the system is "of a down".

-Dan

--

"Why are you wearing TWO grounding straps?"

-John Evans, Ezzi Computers August 23, 2001


--------Dan Mahoney--------
Techie,  Sysadmin,  WebGeek
Gushi on efnet/undernet IRC
ICQ: 13735144   AIM: LarpGM
Site:  http://www.gushi.org
---------------------------


Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by Theo Van Dinter <fe...@apache.org>.
On Tue, Mar 07, 2006 at 08:14:38PM -0500, Dan Mahoney, System Admin wrote:
> >=item languages_filename
> >
> >If you want to be able to use the language-guessing rule
> >C<UNWANTED_LANGUAGE_BODY>, and are using C<config_text> instead of
> >C<rules_filename>, C<site_rules_filename>, and C<userprefs_filename>, you 
[...]
> 
> I'm NOT using rules_text though, unless this is the default behavior.
> I got this for a while:
> 
> Mar  7 19:51:17 quark spamd[81728]: config: failed to parse line, 
> skipping: languages_filename /usr/local/share/spamassassin/languages

rules_text, languages_filename, etc, are parameters to the Mail::SpamAssassin
object during creation, not config options.  So "languages_filename" won't
really help you unless you're writing your own code.

> I gave up and disabled textcat -- it's a shame, I'd like to use it.

TextCat will use <default path to rules>/languages.  Run "spamassassin -D
--lint" and look for the default rules line:

[22346] dbg: config: using "/usr/share/spamassassin" for default rules dir

I responded with this information in the ticket but you never responded.

> The only VERY ODD error I am seeing now (and only for ONE user) is this:
> 
> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
> skipping: rewrite_subject_0
> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
> skipping: report_header_1
> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
> skipping: use_terse_report_1
> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
> skipping: defang_mime_0
> Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
> skipping: auto_learn_0

Why are these odd?  None of these are valid config lines for 3.1.

> I could see trouble with any ONE of these things -- but all three? 
> Something feels odd.

Do you have a firewall blocking those services from working?

-- 
Randomly Generated Tagline:
 Zoidberg: So many memories, so many strange fluids gushing out 
    of patients' bodies....

Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by "Dan Mahoney, System Admin" <da...@prime.gushi.org>.
On Thu, 2 Mar 2006, Daryl C. W. O'Shea wrote:

> Hmm, that's your bug: 
> http://issues.apache.org/SpamAssassin/show_bug.cgi?id=4803
>
> From SpamAssassin.pm pod (I don't think anything else uses this config 
> option... it should probably be moved to the plugin):
>
> =item languages_filename
>
> If you want to be able to use the language-guessing rule
> C<UNWANTED_LANGUAGE_BODY>, and are using C<config_text> instead of
> C<rules_filename>, C<site_rules_filename>, and C<userprefs_filename>, you 
> will
> need to set this.  It should be the path to the B<languages> file normally
> found in the SpamAssassin B<rules> directory.

I'm NOT using rules_text though, unless this is the default behavior.

I got this for a while:

Mar  7 19:51:17 quark spamd[81728]: config: failed to parse line, 
skipping: languages_filename /usr/local/share/spamassassin/languages

I gave up and disabled textcat -- it's a shame, I'd like to use it.

But I'm leaving the bug open.

> If this applies, make sure you set the path to your languages file as above. 
> If this works, please note the fix in your bug 4803 and close it as invalid.




>> 2) A bunch of warnings, all in a row (I see this regularly, I think when a 
>> new child spawns):
>>

I nuked my ruleset from orbit and redid make install, which seemed to have 
fixed it.


> This looks like something is calling _handle_hit() without passing a defined 
> score.  I'd look for a third-party plugin causing the problem. Try disabling 
> one plugin at a time until the errors disappear.

The only VERY ODD error I am seeing now (and only for ONE user) is this:

Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
skipping: rewrite_subject_0
Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
skipping: report_header_1
Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
skipping: use_terse_report_1
Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
skipping: defang_mime_0
Mar  7 20:19:12 quark spamd[83564]: config: failed to parse line, 
skipping: auto_learn_0

I don't know why I think this, but it should be mentioned that the 
username is short, as in only three characters.

>> 3) This on startup:
>> 
>> Mar  2 13:43:57 quark spamd[52090]: Use of uninitialized value in pattern 
>> match (m//) at 
>> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Conf/Parser.pm line 
>> 547, <GEN2752> line 2.
>> Mar  2 13:43:57 quark spamd[52090]: Use of uninitialized value in pattern 
>> match (m//) at 
>> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Conf/Parser.pm line 
>> 547, <GEN2752> line 2.
>
> This looks like it might be caused by a plugin handling the configuration of 
> a rule that does have a score defined or tflags defined.

I went through the DB and deleted all such rules, I think that's actually 
what solved MOST of these issues. (but see above)

> I'd be interested in if this is true or not.
>
>
> This (around Parser.pm line 547):
>
> $set_score = -$set_score if ( $conf->{tflags}->{$k} =~ /\bnice\b/);
>
>
> Should probably be changed to:
>
> $set_score = -$set_score if ( exists $conf->{tflags}->{$k} && 
> $conf->{tflags}->{$k} =~ /\bnice\b/ );
>
>
>> And 4) This whenever it gets hung up (those __alarm__ things couldn't be 
>> more vague, could they?):
>
> They're timeouts.  Running in debug mode will make it clear where the 
> timeouts are from.
>
>
>> Mar  2 12:53:07 quark spamd[94770]: __alarm__
>> Mar  2 12:53:07 quark spamd[94770]: __alarm__
>> Mar  2 12:53:08 quark spamd[62721]: prefork: child states: 
>> BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
>> Mar  2 12:53:08 quark spamd[62721]: prefork: server reached --max-clients 
>> setting, consider raising it
>> Mar  2 12:53:08 quark spamd[47482]: spamd: processing message 
>> <20...@prime.gushi.org> for spam:58
>> Mar  2 12:53:09 quark spamd[51067]: child processing timeout at 
>> /usr/local/bin/spamd line 1088, <GEN1808> line 184.
>> Mar  2 12:53:09 quark spamd[51067]: child processing timeout at 
>> /usr/local/bin/spamd line 1088, <GEN1808> line 184.
>> Mar  2 12:53:09 quark spamd[94770]: spamd: connection from prime.gushi.org 
>> [65.125.228.130] at port 2352
>> Mar  2 12:53:13 quark spamd[94757]: __alarm__
>> Mar  2 12:53:13 quark spamd[94757]: __alarm__
>> Mar  2 12:53:14 quark spamd[92467]: __alarm__
>> Mar  2 12:53:14 quark spamd[92467]: __alarm__
>> Mar  2 12:53:14 quark spamd[62721]: prefork: child states: 
>> BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
>> Mar  2 12:53:14 quark spamd[62721]: prefork: server reached --max-clients 
>> setting, consider raising it
>> Mar  2 12:53:15 quark spamd[49242]: spamd: processing message 
>> <67...@msn.com> for tylersticka:58
>> Mar  2 12:53:15 quark spamd[62721]: prefork: child states: 
>> BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
>> Mar  2 12:53:15 quark spamd[62721]: prefork: server reached --max-clients 
>> setting, consider raising it
>> Mar  2 12:53:16 quark spamd[51061]: child processing timeout at 
>> /usr/local/bin/spamd line 1088, <GEN1801> line 86.
>> Mar  2 12:53:16 quark spamd[51061]: child processing timeout at 
>> /usr/local/bin/spamd line 1088, <GEN1801> line 86.
>> Mar  2 12:53:16 quark spamd[51066]: spamd: identified spam (8.2/5.0) for 
>> nomylamm:58 in 314.8 seconds, 1430 bytes.
>> 
>> I don't know if these relate to the original bug enough -- perchance you 
>> can tell me?
>
> If all those busy children aren't actually doing anything, then yeah, that's 
> a problem.

After cleanly reinstalling most of what I use (what a pain in the ass) -- 
I'm seeing this (this is a grep):

Mar  7 20:06:41 quark spamd[81823]: razor2: razor2 check failed: 
__alarm___ignore__ at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Plugin/Razor2.pm 
line 316.
Mar  7 20:11:23 quark spamd[81824]: dcc: check failed: __alarm___ignore__
Mar  7 20:11:27 quark spamd[81823]: dcc: check failed: __alarm___ignore__
Mar  7 20:11:54 quark spamd[81824]: dcc: check failed: __alarm___ignore__
Mar  7 20:11:54 quark spamd[81823]: dcc: check failed: __alarm___ignore__
Mar  7 20:18:38 quark spamd[83437]: dcc: check failed: __alarm___ignore__
Mar  7 20:18:39 quark spamd[83436]: dcc: check failed: __alarm___ignore__
Mar  7 20:18:39 quark spamd[83438]: dcc: check failed: __alarm___ignore__
Mar  7 20:19:19 quark spamd[83564]: dcc: check failed: __alarm___ignore__
Mar  7 20:19:20 quark spamd[83563]: dcc: check failed: __alarm___ignore__
Mar  7 20:19:29 quark spamd[83564]: dcc: check failed: __alarm___ignore__
Mar  7 20:21:31 quark spamd[83563]: pyzor: check failed: 
__alarm___ignore__
Mar  7 20:22:11 quark spamd[83563]: dcc: check failed: __alarm___ignore__
Mar  7 20:22:13 quark spamd[83565]: dcc: check failed: __alarm___ignore__

I could see trouble with any ONE of these things -- but all three? 
Something feels odd.

Still, with things newly cleaned, I'm going to wait and see if I get 
another lockup.  You'll be the second and third to know if I do.

> I'd get all your other problems cleared up first though.

Done.  And I really appreciate all the time and pointers.

-Dan


--

"It's three o'clock in the morning.  It's too late for 'oops'.  After
Locate Updates, don't even go there."

-Paul Baecker
  January 3, 2k
  Indeed, sometime after 3AM

--------Dan Mahoney--------
Techie,  Sysadmin,  WebGeek
Gushi on efnet/undernet IRC
ICQ: 13735144   AIM: LarpGM
Site:  http://www.gushi.org
---------------------------


Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by "Dan Mahoney, System Admin" <da...@prime.gushi.org>.
On Thu, 2 Mar 2006, Daryl C. W. O'Shea wrote:

Daryl,

Still working on clearing the other issues.  I'm using MOST of the plugins 
that come with spamassassin, but no third party plugins -- there's some 
third party RULESETS including rules du jour, chickenpox, etc -- but those 
are all fairly straightforwards, and reasonably well maintained.

There's one minor issue that I'd like to bring to your attention:

>> And 4) This whenever it gets hung up (those __alarm__ things couldn't be 
>> more vague, could they?):
>
> They're timeouts.  Running in debug mode will make it clear where the 
> timeouts are from.
>
>
>> Mar  2 12:53:07 quark spamd[94770]: __alarm__
>> Mar  2 12:53:07 quark spamd[94770]: __alarm__
>> Mar  2 12:53:08 quark spamd[62721]: prefork: child states: 
>> BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
>> Mar  2 12:53:08 quark spamd[62721]: prefork: server reached --max-clients 
>> setting, consider raising it
>> Mar  2 12:53:08 quark spamd[47482]: spamd: processing message 
>> <20...@prime.gushi.org> for spam:58
>> Mar  2 12:53:09 quark spamd[51067]: child processing timeout at 
>> /usr/local/bin/spamd line 1088, <GEN1808> line 184.
>> Mar  2 12:53:09 quark spamd[51067]: child processing timeout at 
>> /usr/local/bin/spamd line 1088, <GEN1808> line 184.
>> Mar  2 12:53:09 quark spamd[94770]: spamd: connection from prime.gushi.org 
>> [65.125.228.130] at port 2352
>> Mar  2 12:53:13 quark spamd[94757]: __alarm__
>> Mar  2 12:53:13 quark spamd[94757]: __alarm__
>> Mar  2 12:53:14 quark spamd[92467]: __alarm__
>> Mar  2 12:53:14 quark spamd[92467]: __alarm__
>> Mar  2 12:53:14 quark spamd[62721]: prefork: child states: 
>> BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
>> Mar  2 12:53:14 quark spamd[62721]: prefork: server reached --max-clients 
>> setting, consider raising it
>> Mar  2 12:53:15 quark spamd[49242]: spamd: processing message 
>> <67...@msn.com> for tylersticka:58
>> Mar  2 12:53:15 quark spamd[62721]: prefork: child states: 
>> BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
>> Mar  2 12:53:15 quark spamd[62721]: prefork: server reached --max-clients 
>> setting, consider raising it
>> Mar  2 12:53:16 quark spamd[51061]: child processing timeout at 
>> /usr/local/bin/spamd line 1088, <GEN1801> line 86.
>> Mar  2 12:53:16 quark spamd[51061]: child processing timeout at 
>> /usr/local/bin/spamd line 1088, <GEN1801> line 86.
>> Mar  2 12:53:16 quark spamd[51066]: spamd: identified spam (8.2/5.0) for 
>> nomylamm:58 in 314.8 seconds, 1430 bytes.
>> 
>> I don't know if these relate to the original bug enough -- perchance you 
>> can tell me?

I *AM* running in debug mode -- have been for months.  My full command 
line is as follows:

-D -u spamd -i -A 72.9.101.130,65.125.237.232,65.125.228.130,127.0.0.1 -q 
-d -m 40 -r /tmp/spamd.pid -l --min-spare=5 --max-spare=20

I also draw attention to the fact that each PID is __alarm__'ing TWICE.



> If all those busy children aren't actually doing anything, then yeah, that's 
> a problem.
>
> I'd get all your other problems cleared up first though.

Working on it.

-Dan

--

"No mowore webooting!!!"

-Paul, 10-16-99, 10 PM

--------Dan Mahoney--------
Techie,  Sysadmin,  WebGeek
Gushi on efnet/undernet IRC
ICQ: 13735144   AIM: LarpGM
Site:  http://www.gushi.org
---------------------------


Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by "Daryl C. W. O'Shea" <sp...@dostech.ca>.
Dan Mahoney, System Admin wrote:
> On Thu, 2 Mar 2006, Daryl C. W. O'Shea wrote:
> 
>> Dan Mahoney, System Admin wrote:
>>> On Fri, 10 Feb 2006, Daryl C. W. O'Shea wrote:
>>>
>>> Had another hangup today.  Should I comment on the bug report, or 
>>> just reply here, and note http://www.gushi.org/maillog.txt
>>
>> If you're seeing this again...
>>
>>>> Dan Mahoney, System Admin wrote:
>>>>> Feb 10 08:57:40 quark spamd[66716]: prefork: select returned error 
>>>>> on server filehandle: Bad file descriptor
>>>>> Feb 10 08:57:51 quark last message repeated 20403 times
> 
> I am not seeing that.

I would never have guessed from "had another hangup today". :)
The link you posted to your maillog was first 404 and now 403.


> Here's the errors I'm currently seeing that do not seem right to me:
> 
> 1) An error relating to Textcat that I can find no real documentation on 
> in the wiki or the docs, and reading the source does not imply 
> specifying a filename:
> 
> Mar  2 13:09:07 quark spamd[52083]: textcat: languages filename not 
> defined at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Plugin/TextCat.pm 
> line 320.
> Mar  2 13:09:07 quark spamd[52083]: plugin: failed to create instance of 
> plugin Mail::SpamAssassin::Plugin::TextCat: textcat: languages filename 
> not defined at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Plugin/TextCat.pm 
> line 320.

Hmm, that's your bug: 
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=4803

 From SpamAssassin.pm pod (I don't think anything else uses this config 
option... it should probably be moved to the plugin):

=item languages_filename

If you want to be able to use the language-guessing rule
C<UNWANTED_LANGUAGE_BODY>, and are using C<config_text> instead of
C<rules_filename>, C<site_rules_filename>, and C<userprefs_filename>, 
you will
need to set this.  It should be the path to the B<languages> file normally
found in the SpamAssassin B<rules> directory.


If this applies, make sure you set the path to your languages file as 
above.  If this works, please note the fix in your bug 4803 and close it 
as invalid.


> 2) A bunch of warnings, all in a row (I see this regularly, I think when 
> a new child spawns):
> 
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> addition (+) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2698, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> numeric ge (>=) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2703, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> numeric le (<=) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2703, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> sprintf at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2707, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> addition (+) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2698, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> numeric ge (>=) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2703, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> numeric le (<=) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2703, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> sprintf at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2707, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> addition (+) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2698, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> numeric ge (>=) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2703, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> numeric le (<=) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2703, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> sprintf at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2707, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> addition (+) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2698, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> numeric ge (>=) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2703, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> numeric le (<=) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2703, <GEN1723> line 97.
> Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in 
> sprintf at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 2707, <GEN1723> line 97.
> Mar  2 13:07:56 quark spamd[95378]: Use of uninitialized value in 
> numeric eq (==) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 430, <GEN1723> line 97.
> Mar  2 13:07:56 quark spamd[95378]: Use of uninitialized value in 
> numeric eq (==) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 430, <GEN1723> line 97.
> Mar  2 13:07:56 quark spamd[95378]: Use of uninitialized value in 
> numeric eq (==) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
> line 430, <GEN1723> line 97.

This looks like something is calling _handle_hit() without passing a 
defined score.  I'd look for a third-party plugin causing the problem. 
Try disabling one plugin at a time until the errors disappear.


> 3) This on startup:
> 
> Mar  2 13:43:57 quark spamd[52090]: Use of uninitialized value in 
> pattern match (m//) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Conf/Parser.pm 
> line 547, <GEN2752> line 2.
> Mar  2 13:43:57 quark spamd[52090]: Use of uninitialized value in 
> pattern match (m//) at 
> /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Conf/Parser.pm 
> line 547, <GEN2752> line 2.

This looks like it might be caused by a plugin handling the 
configuration of a rule that does have a score defined or tflags defined.

I'd be interested in if this is true or not.


This (around Parser.pm line 547):

$set_score = -$set_score if ( $conf->{tflags}->{$k} =~ /\bnice\b/);


Should probably be changed to:

$set_score = -$set_score if ( exists $conf->{tflags}->{$k} && 
$conf->{tflags}->{$k} =~ /\bnice\b/ );


> And 4) This whenever it gets hung up (those __alarm__ things couldn't be 
> more vague, could they?):

They're timeouts.  Running in debug mode will make it clear where the 
timeouts are from.


> Mar  2 12:53:07 quark spamd[94770]: __alarm__
> Mar  2 12:53:07 quark spamd[94770]: __alarm__
> Mar  2 12:53:08 quark spamd[62721]: prefork: child states: 
> BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
> Mar  2 12:53:08 quark spamd[62721]: prefork: server reached 
> --max-clients setting, consider raising it
> Mar  2 12:53:08 quark spamd[47482]: spamd: processing message 
> <20...@prime.gushi.org> for spam:58
> Mar  2 12:53:09 quark spamd[51067]: child processing timeout at 
> /usr/local/bin/spamd line 1088, <GEN1808> line 184.
> Mar  2 12:53:09 quark spamd[51067]: child processing timeout at 
> /usr/local/bin/spamd line 1088, <GEN1808> line 184.
> Mar  2 12:53:09 quark spamd[94770]: spamd: connection from 
> prime.gushi.org [65.125.228.130] at port 2352
> Mar  2 12:53:13 quark spamd[94757]: __alarm__
> Mar  2 12:53:13 quark spamd[94757]: __alarm__
> Mar  2 12:53:14 quark spamd[92467]: __alarm__
> Mar  2 12:53:14 quark spamd[92467]: __alarm__
> Mar  2 12:53:14 quark spamd[62721]: prefork: child states: 
> BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
> Mar  2 12:53:14 quark spamd[62721]: prefork: server reached 
> --max-clients setting, consider raising it
> Mar  2 12:53:15 quark spamd[49242]: spamd: processing message 
> <67...@msn.com> for tylersticka:58
> Mar  2 12:53:15 quark spamd[62721]: prefork: child states: 
> BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
> Mar  2 12:53:15 quark spamd[62721]: prefork: server reached 
> --max-clients setting, consider raising it
> Mar  2 12:53:16 quark spamd[51061]: child processing timeout at 
> /usr/local/bin/spamd line 1088, <GEN1801> line 86.
> Mar  2 12:53:16 quark spamd[51061]: child processing timeout at 
> /usr/local/bin/spamd line 1088, <GEN1801> line 86.
> Mar  2 12:53:16 quark spamd[51066]: spamd: identified spam (8.2/5.0) for 
> nomylamm:58 in 314.8 seconds, 1430 bytes.
> 
> I don't know if these relate to the original bug enough -- perchance you 
> can tell me?

If all those busy children aren't actually doing anything, then yeah, 
that's a problem.

I'd get all your other problems cleared up first though.


Daryl


Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by "Dan Mahoney, System Admin" <da...@prime.gushi.org>.
On Thu, 2 Mar 2006, Daryl C. W. O'Shea wrote:

> Dan Mahoney, System Admin wrote:
>> On Fri, 10 Feb 2006, Daryl C. W. O'Shea wrote:
>> 
>> Had another hangup today.  Should I comment on the bug report, or just 
>> reply here, and note http://www.gushi.org/maillog.txt
>
> If you're seeing this again...
>
>>> Dan Mahoney, System Admin wrote:
>>>> Feb 10 08:57:40 quark spamd[66716]: prefork: select returned error on 
>>>> server filehandle: Bad file descriptor
>>>> Feb 10 08:57:51 quark last message repeated 20403 times

I am not seeing that.

Here's the errors I'm currently seeing that do not seem right to me:

1) An error relating to Textcat that I can find no real documentation on 
in the wiki or the docs, and reading the source does not imply specifying 
a filename:

Mar  2 13:09:07 quark spamd[52083]: textcat: languages filename not 
defined at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Plugin/TextCat.pm 
line 320.
Mar  2 13:09:07 quark spamd[52083]: plugin: failed to create instance of 
plugin Mail::SpamAssassin::Plugin::TextCat: textcat: languages filename 
not defined at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Plugin/TextCat.pm 
line 320.

2) A bunch of warnings, all in a row (I see this regularly, I think when 
a new child spawns):

Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in addition 
(+) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2698, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in numeric 
ge (>=) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2703, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in numeric 
le (<=) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2703, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in sprintf 
at /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2707, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in addition 
(+) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2698, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in numeric 
ge (>=) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2703, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in numeric 
le (<=) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2703, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in sprintf 
at /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2707, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in addition 
(+) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2698, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in numeric 
ge (>=) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2703, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in numeric 
le (<=) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2703, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in sprintf 
at /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2707, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in addition 
(+) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2698, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in numeric 
ge (>=) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2703, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in numeric 
le (<=) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2703, <GEN1723> line 97.
Mar  2 13:07:55 quark spamd[95378]: Use of uninitialized value in sprintf 
at /usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 2707, <GEN1723> line 97.
Mar  2 13:07:56 quark spamd[95378]: Use of uninitialized value in numeric 
eq (==) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 430, <GEN1723> line 97.
Mar  2 13:07:56 quark spamd[95378]: Use of uninitialized value in numeric 
eq (==) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 430, <GEN1723> line 97.
Mar  2 13:07:56 quark spamd[95378]: Use of uninitialized value in numeric 
eq (==) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/PerMsgStatus.pm 
line 430, <GEN1723> line 97.

3) This on startup:

Mar  2 13:43:57 quark spamd[52090]: Use of uninitialized value in pattern 
match (m//) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Conf/Parser.pm line 
547, <GEN2752> line 2.
Mar  2 13:43:57 quark spamd[52090]: Use of uninitialized value in pattern 
match (m//) at 
/usr/local/lib/perl5/site_perl/5.8.6/Mail/SpamAssassin/Conf/Parser.pm line 
547, <GEN2752> line 2.

And 4) This whenever it gets hung up (those __alarm__ things couldn't be 
more vague, could they?):

Mar  2 12:53:07 quark spamd[94770]: __alarm__
Mar  2 12:53:07 quark spamd[94770]: __alarm__
Mar  2 12:53:08 quark spamd[62721]: prefork: child states: 
BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
Mar  2 12:53:08 quark spamd[62721]: prefork: server reached --max-clients 
setting, consider raising it
Mar  2 12:53:08 quark spamd[47482]: spamd: processing message 
<20...@prime.gushi.org> for spam:58
Mar  2 12:53:09 quark spamd[51067]: child processing timeout at 
/usr/local/bin/spamd line 1088, <GEN1808> line 184.
Mar  2 12:53:09 quark spamd[51067]: child processing timeout at 
/usr/local/bin/spamd line 1088, <GEN1808> line 184.
Mar  2 12:53:09 quark spamd[94770]: spamd: connection from prime.gushi.org 
[65.125.228.130] at port 2352
Mar  2 12:53:13 quark spamd[94757]: __alarm__
Mar  2 12:53:13 quark spamd[94757]: __alarm__
Mar  2 12:53:14 quark spamd[92467]: __alarm__
Mar  2 12:53:14 quark spamd[92467]: __alarm__
Mar  2 12:53:14 quark spamd[62721]: prefork: child states: 
BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
Mar  2 12:53:14 quark spamd[62721]: prefork: server reached --max-clients 
setting, consider raising it
Mar  2 12:53:15 quark spamd[49242]: spamd: processing message 
<67...@msn.com> for tylersticka:58
Mar  2 12:53:15 quark spamd[62721]: prefork: child states: 
BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
Mar  2 12:53:15 quark spamd[62721]: prefork: server reached --max-clients 
setting, consider raising it
Mar  2 12:53:16 quark spamd[51061]: child processing timeout at 
/usr/local/bin/spamd line 1088, <GEN1801> line 86.
Mar  2 12:53:16 quark spamd[51061]: child processing timeout at 
/usr/local/bin/spamd line 1088, <GEN1801> line 86.
Mar  2 12:53:16 quark spamd[51066]: spamd: identified spam (8.2/5.0) for 
nomylamm:58 in 314.8 seconds, 1430 bytes.

I don't know if these relate to the original bug enough -- perchance you 
can tell me?





>
> Provide what you can for bug 4590:
> http://issues.apache.org/SpamAssassin/show_bug.cgi?id=4590
>
> Providing info about actual bugs with the software (and not configuration 
> errors/problems) is almost always best done on Bugzilla.
>
>
> Daryl
>

--

"A mother can be an inspiration to her little son, change his thoughts,
his mind, his life, just with her gentle hum."

-No Doubt, "Different People", from "Tragic Kingdom"


--------Dan Mahoney--------
Techie,  Sysadmin,  WebGeek
Gushi on efnet/undernet IRC
ICQ: 13735144   AIM: LarpGM
Site:  http://www.gushi.org
---------------------------


Re: [sa-list] Re: Spamd keeps getting hung up!

Posted by "Daryl C. W. O'Shea" <sp...@dostech.ca>.
Dan Mahoney, System Admin wrote:
> On Fri, 10 Feb 2006, Daryl C. W. O'Shea wrote:
> 
> Had another hangup today.  Should I comment on the bug report, or just 
> reply here, and note http://www.gushi.org/maillog.txt

If you're seeing this again...

>> Dan Mahoney, System Admin wrote:
>>> Feb 10 08:57:40 quark spamd[66716]: prefork: select returned error on 
>>> server filehandle: Bad file descriptor
>>> Feb 10 08:57:51 quark last message repeated 20403 times

Provide what you can for bug 4590:
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=4590

Providing info about actual bugs with the software (and not 
configuration errors/problems) is almost always best done on Bugzilla.


Daryl