You are viewing a plain text version of this content. The canonical link for it is here.
Posted to ruleqa@spamassassin.apache.org by Marc Andre Selig <a2...@sedacon.com> on 2012/10/24 11:40:20 UTC
Errors while running mass-check today
Hi all,
I received lots of warning messages from auto-mass-check.sh today.
I hope this is the right place to forward them.
Regards,
Marc
Syncing nightly_mass_check
+ ./mass-check --hamlog=ham-mas.log --spamlog=spam-mas.log -j 1 --progress --reuse ham:dir:/home/sacheck/corpora/ham spam:dir:/home/mas/Home/Mail/archives/spam
status: starting scan stage now: 2012-10-24 11:00:19 AM
status: completed scan stage, 7638 messages now: 2012-10-24 11:00:21 AM
status: starting run stage now: 2012-10-24 11:00:21 AM
Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
[... 7587 identical lines omitted ...]
Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
status: completed run stage now: 2012-10-24 11:29:23 AM
+ LOGLIST=' ham-mas.log spam-mas.log'
+ set +x
rsync -qPcvz ham-mas.log spam-mas.log maselig@rsync.spamassassin.org::corpus/
Re: Errors while running mass-check today
Posted by Jari Fredriksson <ja...@iki.fi>.
27.10.2012 16:25, Jari Fredriksson kirjoitti:
>
> Indeed, the error is gone. Two other odd errors still exists, but it
> seems they are not bugs of SA.
>
>
... and I goofed again. That account name was not supposed to be posted
to internet :(
--
"Don't do the upgrade to 7.0.4 it'll give you problems if you're not really skilled. Even I would refrain"
Husse May 1 2007
Re: Errors while running mass-check today
Posted by Jari Fredriksson <ja...@iki.fi>.
27.10.2012 16:43, John Hardin kirjoitti:
> On Sat, 27 Oct 2012, Jari Fredriksson wrote:
>
>> Indeed, the error is gone. Two other odd errors still exists, but it
>> seems they are not bugs of SA.
>>
>> dns: new_dns_packet (host=npcloud..org. type=A class=IN) failed: a
>> domain name contains a null label
>> dns: new_dns_packet
>> (host=solarwinds-%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20marketing.s3.amazonaws.com.
>> type=A class=IN) failed: a label in a domain name is longer than 63
>> bytes
>
> The last time you mentioned these DNS failures I asked if you could
> share the messages. If DNS-invalid hostnames like that are actually
> appearing in spam, then they might be worthy of a rule.
>
Ahh, I must have forgotten the request, I try to find those now.
Hang on...
--
You're ugly and your mother dresses you funny.
Re: Errors while running mass-check today
Posted by Jari Fredriksson <ja...@iki.fi>.
27.10.2012 16:43, John Hardin kirjoitti:
> On Sat, 27 Oct 2012, Jari Fredriksson wrote:
>
>> Indeed, the error is gone. Two other odd errors still exists, but it
>> seems they are not bugs of SA.
>>
>> dns: new_dns_packet (host=npcloud..org. type=A class=IN) failed: a
>> domain name contains a null label
>> dns: new_dns_packet
>> (host=solarwinds-%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20marketing.s3.amazonaws.com.
>> type=A class=IN) failed: a label in a domain name is longer than 63
>> bytes
>
> The last time you mentioned these DNS failures I asked if you could
> share the messages. If DNS-invalid hostnames like that are actually
> appearing in spam, then they might be worthy of a rule.
>
I sent the corpus of mails containing "npcloud" or
"solarwinds.*marketing.s3.amazonaws.com" to John Hardin off list.
The files do not contain any direct matches to the values in the error
messages, so I think there may be a bug in some plugin or something...
Hopefully it can be found.
--
If you stand on your head, you will get footprints in your hair.
Re: Errors while running mass-check today
Posted by John Hardin <jh...@impsec.org>.
On Sat, 27 Oct 2012, Jari Fredriksson wrote:
> Indeed, the error is gone. Two other odd errors still exists, but it
> seems they are not bugs of SA.
>
> dns: new_dns_packet (host=npcloud..org. type=A class=IN) failed: a domain name contains a null label
> dns: new_dns_packet (host=solarwinds-%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20marketing.s3.amazonaws.com. type=A class=IN) failed: a label in a domain name is longer than 63 bytes
The last time you mentioned these DNS failures I asked if you could share
the messages. If DNS-invalid hostnames like that are actually appearing in
spam, then they might be worthy of a rule.
--
John Hardin KA7OHZ http://www.impsec.org/~jhardin/
jhardin@impsec.org FALaholic #11174 pgpk -a jhardin@impsec.org
key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
...the Fates notice those who buy chainsaws...
-- www.darwinawards.com
-----------------------------------------------------------------------
4 days until Halloween
Re: Errors while running mass-check today
Posted by Jari Fredriksson <ja...@iki.fi>.
27.10.2012 12:14, Marc Andre Selig kirjoitti:
> On Thu, Oct 25, 2012 at 09:59:12AM -0400, Kevin A. McGrail wrote:
>
>> Thanks Jari and Marc, I've opened a bug about this:
>>
>> https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6856
> Just for completeness' sake: The bug has been found and fixed.
>
Indeed, the error is gone. Two other odd errors still exists, but it
seems they are not bugs of SA.
Removing duplicates from HAM SPAM ... done.
Removing unwanted SPAM mail from corpus
Syncing weekly_mass_check
+ ./mass-check --hamlog=ham-net-jarif.log --spamlog=spam-net-jarif.log -j 8 --net --progress --reuse ham:dir:/home/jarif/Maildir/.Confirmed-HAM spam:dir:/home/jarif/Maildir/.Confirmed-SPAM
status: starting scan stage now: 2012-10-27 12:05:25
status: completed scan stage, 25777 messages now: 2012-10-27 12:09:58
status: starting run stage now: 2012-10-27 12:09:58
status: 10% ham: 2257 spam: 321 date: 2011-01-21 now: 2012-10-27 12:14:30
status: 20% ham: 4518 spam: 638 date: 2011-05-17 now: 2012-10-27 12:20:05
status: 30% ham: 6779 spam: 955 date: 2011-09-07 now: 2012-10-27 12:25:36
status: 40% ham: 9042 spam: 1270 date: 2011-11-28 now: 2012-10-27 12:31:38
status: 50% ham: 11303 spam: 1587 date: 2012-02-29 now: 2012-10-27 12:37:27
dns: new_dns_packet (host=npcloud..org. type=A class=IN) failed: a domain name contains a null label
plugin: eval failed: oops, no key at /home/jarif/masscheckwork/weekly_mass_check/masses/../lib/Mail/SpamAssassin/AsyncLoop.pm line 176.
status: 60% ham: 13562 spam: 1906 date: 2012-05-17 now: 2012-10-27 12:43:09
status: 70% ham: 15823 spam: 2223 date: 2012-07-04 now: 2012-10-27 12:48:44
status: 80% ham: 18084 spam: 2540 date: 2012-08-10 now: 2012-10-27 12:53:56
status: 90% ham: 20347 spam: 2855 date: 2012-09-28 now: 2012-10-27 12:59:48
dns: new_dns_packet (host=solarwinds-%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20marketing.s3.amazonaws.com. type=A class=IN) failed: a label in a domain name is longer than 63 bytes
plugin: eval failed: oops, no key at /home/jarif/masscheckwork/weekly_mass_check/masses/../lib/Mail/SpamAssassin/AsyncLoop.pm line 176.
status: completed run stage now: 2012-10-27 13:04:17
+ LOGLIST=' ham-net-jarif.log spam-net-jarif.log'
+ set +x
rsync -Pcqz ham-net-jarif.log spam-net-jarif.log jarif@rsync.spamassassin.org::corpu
--
Q: How many lawyers does it take to change a light bulb?
A: You won't find a lawyer who can change a light bulb. Now, if
you're looking for a lawyer to screw a light bulb...
Re: Errors while running mass-check today
Posted by Marc Andre Selig <a2...@sedacon.com>.
On Thu, Oct 25, 2012 at 09:59:12AM -0400, Kevin A. McGrail wrote:
> Thanks Jari and Marc, I've opened a bug about this:
>
> https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6856
Just for completeness' sake: The bug has been found and fixed.
Regards,
Marc
Re: Errors while running mass-check today
Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
Thanks Jari and Marc, I've On 10/25/2012 6:58 AM, Jari Fredriksson wrote:
> 24.10.2012 12:40, Marc Andre Selig kirjoitti:
>> Hi all,
>>
>> I received lots of warning messages from auto-mass-check.sh today.
>> I hope this is the right place to forward them.
>>
>> Regards,
>> Marc
>>
>> Syncing nightly_mass_check
>> + ./mass-check --hamlog=ham-mas.log --spamlog=spam-mas.log -j 1 --progress --reuse ham:dir:/home/sacheck/corpora/ham spam:dir:/home/mas/Home/Mail/archives/spam
>> status: starting scan stage now: 2012-10-24 11:00:19 AM
>> status: completed scan stage, 7638 messages now: 2012-10-24 11:00:21 AM
>> status: starting run stage now: 2012-10-24 11:00:21 AM
>> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
>> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
>> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
>> [... 7587 identical lines omitted ...]
>> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
>> status: completed run stage now: 2012-10-24 11:29:23 AM
>> + LOGLIST=' ham-mas.log spam-mas.log'
>> + set +x
>> rsync -qPcvz ham-mas.log spam-mas.log maselig@rsync.spamassassin.org::corpus/
>>
> Same here. I have 25000+ rows with this message in my cron job email
> from masscheck. It seems that every email in my corpus triggers this.
Thanks Jari and Marc, I've opened a bug about this:
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6856
Anyone have an inkling about the cause?
As noted in the bug, it's this code from got_hit (the $value logic at
the bottom)
...
sub got_hit {
my ($self, $rule, $area, %params) = @_;
my $conf_ref = $self->{conf};
my $dynamic_score_provided;
my $score = $params{score};
if (defined $score) { # overrides any configured scores
$dynamic_score_provided = 1;
} else {
$score = $conf_ref->{scores}->{$rule};
$score = $params{defscore} if !defined $score;
}
# adding a hit does nothing if we don't have a score -- we probably
# shouldn't have run it in the first place
return unless $score;
# ensure that rule values always result in an *increase*
# of $self->{tests_already_hit}->{$rule}:
my $value = $params{value};
if (!$value || $value <= 0) { $value = 1 }
...
Regards,
KAM
Re: Errors while running mass-check today
Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
Thanks Jari and Marc, I've On 10/25/2012 6:58 AM, Jari Fredriksson wrote:
> 24.10.2012 12:40, Marc Andre Selig kirjoitti:
>> Hi all,
>>
>> I received lots of warning messages from auto-mass-check.sh today.
>> I hope this is the right place to forward them.
>>
>> Regards,
>> Marc
>>
>> Syncing nightly_mass_check
>> + ./mass-check --hamlog=ham-mas.log --spamlog=spam-mas.log -j 1 --progress --reuse ham:dir:/home/sacheck/corpora/ham spam:dir:/home/mas/Home/Mail/archives/spam
>> status: starting scan stage now: 2012-10-24 11:00:19 AM
>> status: completed scan stage, 7638 messages now: 2012-10-24 11:00:21 AM
>> status: starting run stage now: 2012-10-24 11:00:21 AM
>> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
>> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
>> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
>> [... 7587 identical lines omitted ...]
>> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
>> status: completed run stage now: 2012-10-24 11:29:23 AM
>> + LOGLIST=' ham-mas.log spam-mas.log'
>> + set +x
>> rsync -qPcvz ham-mas.log spam-mas.log maselig@rsync.spamassassin.org::corpus/
>>
> Same here. I have 25000+ rows with this message in my cron job email
> from masscheck. It seems that every email in my corpus triggers this.
Thanks Jari and Marc, I've opened a bug about this:
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6856
Anyone have an inkling about the cause?
As noted in the bug, it's this code from got_hit (the $value logic at
the bottom)
...
sub got_hit {
my ($self, $rule, $area, %params) = @_;
my $conf_ref = $self->{conf};
my $dynamic_score_provided;
my $score = $params{score};
if (defined $score) { # overrides any configured scores
$dynamic_score_provided = 1;
} else {
$score = $conf_ref->{scores}->{$rule};
$score = $params{defscore} if !defined $score;
}
# adding a hit does nothing if we don't have a score -- we probably
# shouldn't have run it in the first place
return unless $score;
# ensure that rule values always result in an *increase*
# of $self->{tests_already_hit}->{$rule}:
my $value = $params{value};
if (!$value || $value <= 0) { $value = 1 }
...
Regards,
KAM
Re: Errors while running mass-check today
Posted by Jari Fredriksson <ja...@iki.fi>.
24.10.2012 12:40, Marc Andre Selig kirjoitti:
> Hi all,
>
> I received lots of warning messages from auto-mass-check.sh today.
> I hope this is the right place to forward them.
>
> Regards,
> Marc
>
> Syncing nightly_mass_check
> + ./mass-check --hamlog=ham-mas.log --spamlog=spam-mas.log -j 1 --progress --reuse ham:dir:/home/sacheck/corpora/ham spam:dir:/home/mas/Home/Mail/archives/spam
> status: starting scan stage now: 2012-10-24 11:00:19 AM
> status: completed scan stage, 7638 messages now: 2012-10-24 11:00:21 AM
> status: starting run stage now: 2012-10-24 11:00:21 AM
> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
> [... 7587 identical lines omitted ...]
> Argument "1/8" isn't numeric in numeric le (<=) at /home/sacheck/masscheckwork/nightly_mass_check/masses/../lib/Mail/SpamAssassin/PerMsgStatus.pm line 2441.
> status: completed run stage now: 2012-10-24 11:29:23 AM
> + LOGLIST=' ham-mas.log spam-mas.log'
> + set +x
> rsync -qPcvz ham-mas.log spam-mas.log maselig@rsync.spamassassin.org::corpus/
>
Same here. I have 25000+ rows with this message in my cron job email
from masscheck. It seems that every email in my corpus triggers this.
--
Q: What does a WASP Mom make for dinner?
A: A crisp salad, a hearty soup, a lovely entree, followed by
a delicious dessert.