You are viewing a plain text version of this content. The canonical link for it is here.
Posted to ruleqa@spamassassin.apache.org by John Hardin <jh...@impsec.org> on 2012/11/23 05:47:07 UTC

Masscheck results ignored due to formatting errors

danmcdonald, mmiroslaw: please check your logs, they don't appear to be 
properly generating and are being ignored...

LOG: starting rsync slow reports (15202) at Fri Nov 23 04:41:31 2012
[cd masses/rule-qa ; ./import-logs --override='output_classes=OVERLAP.new' --tag=n]
/export/home/corpus-rsync/corpus/ham-danmcdonald.log: not tagged with a revision, ignored
/export/home/corpus-rsync/corpus/ham-mmiroslaw-ham.log: no time found, ignored
/export/home/corpus-rsync/corpus/ham-mmiroslaw-spam.log: no time found, ignored
/export/home/corpus-rsync/corpus/ham-net-danmcdonald.log: not tagged with a revision, ignored
/export/home/corpus-rsync/corpus/spam-danmcdonald.log: not tagged with a revision, ignored
/export/home/corpus-rsync/corpus/spam-mmiroslaw-ham.log: no time found, ignored
/export/home/corpus-rsync/corpus/spam-mmiroslaw-spam.log: no time found, ignored
/export/home/corpus-rsync/corpus/spam-net-danmcdonald.log: not tagged with a revision, ignored



-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   You can't reason a person out of a position if he didn't use
   reason to get there in the first place.   -- Kristopher, at Marko's
-----------------------------------------------------------------------
  175 days since the first successful private support mission to ISS (SpaceX)

Re: Masscheck results ignored due to formatting errors

Posted by John Hardin <jh...@impsec.org>.
On Fri, 23 Nov 2012, Kevin A. McGrail wrote:

> I am not 100% sure they are on this list.  What's the date on their files? 
> Are they still uploading and I should track down an email address?

The files do appear to be current:

bash-3.00$ ls -l /export/home/corpus-rsync/corpus/*danmcdonald*.log
-rw-r--r--   1 buildbot 104      19463494 Nov 23 10:28 /export/home/corpus-rsync/corpus/ham-danmcdonald.log
-rw-r--r--   1 buildbot 104      21138461 Nov 17 11:09 /export/home/corpus-rsync/corpus/ham-net-danmcdonald.log
-rw-r--r--   1 buildbot 104      1353158 Nov 23 10:28 /export/home/corpus-rsync/corpus/spam-danmcdonald.log
-rw-r--r--   1 buildbot 104      1426243 Nov 17 11:09 /export/home/corpus-rsync/corpus/spam-net-danmcdonald.log
bash-3.00$ ls -l /export/home/corpus-rsync/corpus/*mmiroslaw*.log
-rw-r--r--   1 buildbot 104      12006034 Nov 22 18:03 /export/home/corpus-rsync/corpus/ham-mmiroslaw-ham.log
-rw-r--r--   1 buildbot 104          376 Nov 22 18:03 /export/home/corpus-rsync/corpus/ham-mmiroslaw-spam.log
-rw-r--r--   1 buildbot 104          367 Nov 22 18:03 /export/home/corpus-rsync/corpus/spam-mmiroslaw-ham.log
-rw-r--r--   1 buildbot 104      25457148 Nov 22 18:03 /export/home/corpus-rsync/corpus/spam-mmiroslaw-spam.log



>
> On 11/22/2012 11:47 PM, John Hardin wrote:
>>
>>  danmcdonald, mmiroslaw: please check your logs, they don't appear to be
>>  properly generating and are being ignored...
>>
>>  LOG: starting rsync slow reports (15202) at Fri Nov 23 04:41:31 2012
>>  [cd masses/rule-qa ; ./import-logs --override='output_classes=OVERLAP.new'
>>  --tag=n]
>>  /export/home/corpus-rsync/corpus/ham-danmcdonald.log: not tagged with a
>>  revision, ignored
>>  /export/home/corpus-rsync/corpus/ham-mmiroslaw-ham.log: no time found,
>>  ignored
>>  /export/home/corpus-rsync/corpus/ham-mmiroslaw-spam.log: no time found,
>>  ignored
>>  /export/home/corpus-rsync/corpus/ham-net-danmcdonald.log: not tagged with
>>  a revision, ignored
>>  /export/home/corpus-rsync/corpus/spam-danmcdonald.log: not tagged with a
>>  revision, ignored
>>  /export/home/corpus-rsync/corpus/spam-mmiroslaw-ham.log: no time found,
>>  ignored
>>  /export/home/corpus-rsync/corpus/spam-mmiroslaw-spam.log: no time found,
>>  ignored
>>  /export/home/corpus-rsync/corpus/spam-net-danmcdonald.log: not tagged with
>>  a revision, ignored 
>
>

-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   Rights can only ever be individual, which means that you cannot
   gain a right by joining a mob, no matter how shiny the issued
   badges are, or how many of your neighbors are part of it.  -- Marko
-----------------------------------------------------------------------
  176 days since the first successful private support mission to ISS (SpaceX)

Re: Masscheck results ignored due to formatting errors

Posted by Marcin Mirosław <ma...@mejor.pl>.
W dniu 23.11.2012 16:28, Marc Andre Selig pisze:

Hi!

> On Fri, Nov 23, 2012 at 09:51:52AM -0500, Kevin A. McGrail wrote:
> 
>> On 11/22/2012 11:47 PM, John Hardin wrote:
>>> danmcdonald, mmiroslaw: please check your logs, they don't appear
>>> to be properly generating and are being ignored...
> 
>> I am not 100% sure they are on this list.  What's the date on their
>> files?  Are they still uploading and I should track down an email
>> address?

I'm on the list.

> According to rsync.spamassassin.org, their last uploads were today and
> yesterday, respectively.
> 
> Danmcdonald has "SVN revision: unknown" in the header of his log.  No
> idea what can cause this.
> 
> Mmiroslaw has a localized time stamp in the first line of his logs that
> some tool is probably misunderstanding/unable to interpret.  IMHO that's
> a bug in either mass-check (for localizing the time stamp when another
> tools expects a non-localized time stamp) or whatever is reading the
> logs (for not being able to deal with localized time stamps) or in the
> documentation (for not documenting that mass-check tools will break
> if locale is set to anything but C or en_*).  Actually it might be a
> design problem instead (for using a localizable human-readable time
> stamp instead of a unix date). ;)
> 
> # mass-check results from masscheck@poczta, on czw, 22 lis 2012, 09:11:37 UTC

I can change locale to en_US.utf-8.


Re: Masscheck results ignored due to formatting errors

Posted by John Hardin <jh...@impsec.org>.
On Fri, 23 Nov 2012, John Hardin wrote:

> On Fri, 23 Nov 2012, Marc Andre Selig wrote:
>
>>  Mmiroslaw has a localized time stamp in the first line of his logs that
>>  some tool is probably misunderstanding/unable to interpret.  IMHO that's
>>  a bug in either mass-check (for localizing the time stamp when another
>>  tools expects a non-localized time stamp) or whatever is reading the
>>  logs (for not being able to deal with localized time stamps) or in the
>>  documentation (for not documenting that mass-check tools will break
>>  if locale is set to anything but C or en_*).  Actually it might be a
>>  design problem instead (for using a localizable human-readable time
>>  stamp instead of a unix date). ;)
>>
>>  # mass-check results from masscheck@poczta, on czw, 22 lis 2012, 09:11:37
>>  UTC
>
> Yabbut, there's another date header in ISO format:
>
> # Date: 20121122T120720Z
>
> I'll take a look at which header ruleqa is looking at, it might be using the 
> localized one...

https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6867

Proposed patch attached to bug, comments solicited.

-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   Rights can only ever be individual, which means that you cannot
   gain a right by joining a mob, no matter how shiny the issued
   badges are, or how many of your neighbors are part of it.  -- Marko
-----------------------------------------------------------------------
  176 days since the first successful private support mission to ISS (SpaceX)

Re: Masscheck results ignored due to formatting errors

Posted by John Hardin <jh...@impsec.org>.
On Fri, 23 Nov 2012, Marc Andre Selig wrote:

> Mmiroslaw has a localized time stamp in the first line of his logs that
> some tool is probably misunderstanding/unable to interpret.  IMHO that's
> a bug in either mass-check (for localizing the time stamp when another
> tools expects a non-localized time stamp) or whatever is reading the
> logs (for not being able to deal with localized time stamps) or in the
> documentation (for not documenting that mass-check tools will break
> if locale is set to anything but C or en_*).  Actually it might be a
> design problem instead (for using a localizable human-readable time
> stamp instead of a unix date). ;)
>
> # mass-check results from masscheck@poczta, on czw, 22 lis 2012, 09:11:37 UTC

Yabbut, there's another date header in ISO format:

# Date: 20121122T120720Z

I'll take a look at which header ruleqa is looking at, it might be using 
the localized one...


-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   Rights can only ever be individual, which means that you cannot
   gain a right by joining a mob, no matter how shiny the issued
   badges are, or how many of your neighbors are part of it.  -- Marko
-----------------------------------------------------------------------
  176 days since the first successful private support mission to ISS (SpaceX)

Re: Masscheck results ignored due to formatting errors

Posted by Marc Andre Selig <a2...@sedacon.com>.
On Fri, Nov 23, 2012 at 09:51:52AM -0500, Kevin A. McGrail wrote:

> On 11/22/2012 11:47 PM, John Hardin wrote:
> >danmcdonald, mmiroslaw: please check your logs, they don't appear
> >to be properly generating and are being ignored...

> I am not 100% sure they are on this list.  What's the date on their
> files?  Are they still uploading and I should track down an email
> address?

According to rsync.spamassassin.org, their last uploads were today and
yesterday, respectively.

Danmcdonald has "SVN revision: unknown" in the header of his log.  No
idea what can cause this.

Mmiroslaw has a localized time stamp in the first line of his logs that
some tool is probably misunderstanding/unable to interpret.  IMHO that's
a bug in either mass-check (for localizing the time stamp when another
tools expects a non-localized time stamp) or whatever is reading the
logs (for not being able to deal with localized time stamps) or in the
documentation (for not documenting that mass-check tools will break
if locale is set to anything but C or en_*).  Actually it might be a
design problem instead (for using a localizable human-readable time
stamp instead of a unix date). ;)

# mass-check results from masscheck@poczta, on czw, 22 lis 2012, 09:11:37 UTC

Regards
Marc

Re: Masscheck results ignored due to formatting errors

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
I am not 100% sure they are on this list.  What's the date on their 
files?  Are they still uploading and I should track down an email address?


On 11/22/2012 11:47 PM, John Hardin wrote:
>
> danmcdonald, mmiroslaw: please check your logs, they don't appear to 
> be properly generating and are being ignored...
>
> LOG: starting rsync slow reports (15202) at Fri Nov 23 04:41:31 2012
> [cd masses/rule-qa ; ./import-logs 
> --override='output_classes=OVERLAP.new' --tag=n]
> /export/home/corpus-rsync/corpus/ham-danmcdonald.log: not tagged with 
> a revision, ignored
> /export/home/corpus-rsync/corpus/ham-mmiroslaw-ham.log: no time found, 
> ignored
> /export/home/corpus-rsync/corpus/ham-mmiroslaw-spam.log: no time 
> found, ignored
> /export/home/corpus-rsync/corpus/ham-net-danmcdonald.log: not tagged 
> with a revision, ignored
> /export/home/corpus-rsync/corpus/spam-danmcdonald.log: not tagged with 
> a revision, ignored
> /export/home/corpus-rsync/corpus/spam-mmiroslaw-ham.log: no time 
> found, ignored
> /export/home/corpus-rsync/corpus/spam-mmiroslaw-spam.log: no time 
> found, ignored
> /export/home/corpus-rsync/corpus/spam-net-danmcdonald.log: not tagged 
> with a revision, ignored