You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by Warren Togami <wt...@redhat.com> on 2009/09/15 23:40:59 UTC

ruleqa question

http://ruleqa.spamassassin.org/20090915-r815222-n

Can someone figure out why wt-en4 isn't appearing on ruleqa?

On previous days wt-en3 disappeared for no reason I am able to ascertain.

Warren Togami
wtogami@redhat.com

Re: ruleqa question

Posted by Justin Mason <jm...@jmason.org>.
On Thu, Sep 17, 2009 at 09:58, Warren Togami <wt...@redhat.com> wrote:
> http://ruleqa.spamassassin.org/20090917-r816097-n
> Today is showing the same failure, except this time wt-en3 and wt-en4 are
> missing.  Something is wrong with ruleqa?

I think it's a delay in processing -- they're there now...

'20090917-r816097-n   (Viewing)
bb-doc bb-fredt bb-guenther_fraud bb-jhardin bb-jhardin_fraud bb-jm
bb-kmcgrail bb-trec_enron bb-zmi dos wt-en1 wt-en2 wt-en3 wt-en4
wt-jp1 wt-jp2 [+]'

However, the 20090915-r815022-n case is less simple.
LOGS.all-ham-wt-en4.20090915-r815222-n.log.gz is a file containing no
logs:

# mass-check results from sa-reporter@master3.togami.com, on Tue Sep
15 18:06:21 UTC 20
09
# M:SA version 3.3.0-alpha3-r808953
# SVN revision: 815222
# Date: 20090915T180621Z
# Perl version: 5.008008 on x86_64-linux-thread-multi
# Switches: '"--hamlog=ham-wt-en4.log" "--spamlog=spam-wt-en4.log" -j
4 --progress --re
use "spam:mbox:/home/sa-sorter/mail/TSPAM"
"spam:mbox:/home/sa-sorter/mail/TSPAM-10"'


Could it be that the uploading process is uploading before the
mass-checks complete?  Once a file appears in the rsync dir, it's
added for processing, and later modifications will not be picked up.

-- 
--j.

Re: ruleqa question

Posted by Warren Togami <wt...@redhat.com>.
http://ruleqa.spamassassin.org/20090917-r816097-n
Today is showing the same failure, except this time wt-en3 and wt-en4 
are missing.  Something is wrong with ruleqa?

Warren Togami
wtogami@redhat.com

Re: ruleqa question

Posted by Warren Togami <wt...@redhat.com>.
On 09/15/2009 10:38 PM, Justin Mason wrote:
> Could it be that the comments at the top of the log differ in
> mass-check revision number?  could you post those comments?
>
> I can't look right now on the spamassassin2 server to check :(
>
> --j.

Nope.

wt-en3
# mass-check results from sa-reporter@master3.togami.com, on Tue Sep 15 
17:21:40 UTC 2009
# M:SA version 3.3.0-alpha3-r808953
# SVN revision: 815222
# Date: 20090915T172140Z
# Perl version: 5.008008 on x86_64-linux-thread-multi

wt-en4
# mass-check results from sa-reporter@master3.togami.com, on Tue Sep 15 
18:06:21 UTC 2009
# M:SA version 3.3.0-alpha3-r808953
# SVN revision: 815222
# Date: 20090915T180621Z
# Perl version: 5.008008 on x86_64-linux-thread-multi


Re: ruleqa question

Posted by Justin Mason <jm...@jmason.org>.
Could it be that the comments at the top of the log differ in
mass-check revision number?  could you post those comments?

I can't look right now on the spamassassin2 server to check :(

--j.

On Wed, Sep 16, 2009 at 00:31, Warren Togami <wt...@redhat.com> wrote:
> On 09/15/2009 06:00 PM, John Hardin wrote:
>>
>> On Tue, 15 Sep 2009, Warren Togami wrote:
>>
>>> http://ruleqa.spamassassin.org/20090915-r815222-n
>>>
>>> Can someone figure out why wt-en4 isn't appearing on ruleqa?
>>>
>>> On previous days wt-en3 disappeared for no reason I am able to ascertain.
>>
>> It might not be done running the masscheck for the 15th yet...?
>>
>> I'm assuming that the ruleqa analysis starts being visible when
>> masscheck starts producing results, and if you keep revisiting the
>> current run while it's still underway, the results will change (e.g. hit
>> rate, S/O, etc.)
>>
>> Am I mistaken?
>>
>
> wt-en4 was uploaded at roughly a similar time as wt-en[1-3] many hours ago,
> but wt-en4 doesn't appear on ruleqa.
>
> The previous two days wt-en3 was uploaded but didn't appear at all.
>
> Warren
>
>



-- 
--j.

Re: ruleqa question

Posted by John Hardin <jh...@impsec.org>.
On Tue, 15 Sep 2009, Warren Togami wrote:

> On 09/15/2009 09:44 PM, John Hardin wrote:
>> >  Am I missing something?
>>
>>  ham and spam subfolders to segregate the corpora?
>>
>>  http://wiki.apache.org/spamassassin/UploadedCorpora
>> 
>
> This isn't uploading the corpora.
>
> http://wiki.apache.org/spamassassin/NightlyMassCheck
>
> This is uploading the nightly masscheck logs, the results of which normally 
> appear at http://ruleqa.spamassassin.org/

Oops. Never mind that, then. I upload my corpora.

-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
  Warning Labels we'd like to see #1: "If you are a stupid idiot while
  using this product you may hurt yourself. And it won't be our fault."
-----------------------------------------------------------------------
  2 days until the 222nd anniversary of the signing of the U.S. Constitution

Re: ruleqa question

Posted by Warren Togami <wt...@redhat.com>.
On 09/15/2009 09:44 PM, John Hardin wrote:
>> Am I missing something?
>
> ham and spam subfolders to segregate the corpora?
>
> http://wiki.apache.org/spamassassin/UploadedCorpora
>

This isn't uploading the corpora.

http://wiki.apache.org/spamassassin/NightlyMassCheck

This is uploading the nightly masscheck logs, the results of which 
normally appear at http://ruleqa.spamassassin.org/

Warren

Re: ruleqa question

Posted by John Hardin <jh...@impsec.org>.
On Tue, 15 Sep 2009, Warren Togami wrote:

> On 09/15/2009 08:33 PM, John Hardin wrote:
>>
>>  ...file permissions?
>
> [sa-reporter@master3 ~]$ rsync wtogami@rsync.spamassassin.org::corpus/ham-wt*
> -rw-r--r--     5282521 2009/09/15 13:07:45 ham-wt-en1.log
> -rw-r--r--     2633680 2009/09/15 13:21:34 ham-wt-en2.log
> -rw-r--r--     9265691 2009/09/15 14:06:13 ham-wt-en3.log
> -rw-r--r--         401 2009/09/15 14:16:30 ham-wt-en4.log
> -rw-r--r--      934285 2009/09/15 12:02:03 ham-wt-jp1.log
> -rw-r--r--     3498545 2009/09/15 12:24:09 ham-wt-jp2.log
> [sa-reporter@master3 ~]$ rsync 
> wtogami@rsync.spamassassin.org::corpus/spam-wt*
> -rw-r--r--     6481419 2009/09/15 13:07:47 spam-wt-en1.log
> -rw-r--r--        1984 2009/09/15 13:21:35 spam-wt-en2.log
> -rw-r--r--         349 2009/09/15 14:06:15 spam-wt-en3.log
> -rw-r--r--     2916939 2009/09/15 14:16:32 spam-wt-en4.log
> -rw-r--r--      132354 2009/09/15 12:02:04 spam-wt-jp1.log
> -rw-r--r--         350 2009/09/15 12:24:10 spam-wt-jp2.log
>
> Am I missing something?

ham and spam subfolders to segregate the corpora?

http://wiki.apache.org/spamassassin/UploadedCorpora

-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   USMC Rules of Gunfighting #6: If you can choose what to bring to a
   gunfight, bring a long gun and a friend with a long gun.
-----------------------------------------------------------------------
  2 days until the 222nd anniversary of the signing of the U.S. Constitution

Re: ruleqa question

Posted by Warren Togami <wt...@redhat.com>.
On 09/15/2009 08:33 PM, John Hardin wrote:
> On Tue, 15 Sep 2009, Warren Togami wrote:
>
>> wt-en4 was uploaded at roughly a similar time as wt-en[1-3] many hours
>> ago, but wt-en4 doesn't appear on ruleqa.
>>
>> The previous two days wt-en3 was uploaded but didn't appear at all.
>
> ...file permissions?
>

[sa-reporter@master3 ~]$ rsync 
wtogami@rsync.spamassassin.org::corpus/ham-wt*
-rw-r--r--     5282521 2009/09/15 13:07:45 ham-wt-en1.log
-rw-r--r--     2633680 2009/09/15 13:21:34 ham-wt-en2.log
-rw-r--r--     9265691 2009/09/15 14:06:13 ham-wt-en3.log
-rw-r--r--         401 2009/09/15 14:16:30 ham-wt-en4.log
-rw-r--r--      934285 2009/09/15 12:02:03 ham-wt-jp1.log
-rw-r--r--     3498545 2009/09/15 12:24:09 ham-wt-jp2.log
[sa-reporter@master3 ~]$ rsync 
wtogami@rsync.spamassassin.org::corpus/spam-wt*
-rw-r--r--     6481419 2009/09/15 13:07:47 spam-wt-en1.log
-rw-r--r--        1984 2009/09/15 13:21:35 spam-wt-en2.log
-rw-r--r--         349 2009/09/15 14:06:15 spam-wt-en3.log
-rw-r--r--     2916939 2009/09/15 14:16:32 spam-wt-en4.log
-rw-r--r--      132354 2009/09/15 12:02:04 spam-wt-jp1.log
-rw-r--r--         350 2009/09/15 12:24:10 spam-wt-jp2.log

Am I missing something?

Warren

Re: ruleqa question

Posted by John Hardin <jh...@impsec.org>.
On Tue, 15 Sep 2009, Warren Togami wrote:

> wt-en4 was uploaded at roughly a similar time as wt-en[1-3] many hours ago, 
> but wt-en4 doesn't appear on ruleqa.
>
> The previous two days wt-en3 was uploaded but didn't appear at all.

...file permissions?

-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
  Windows and its users got mentioned at home today, after my wife the
  psych major brought up Seligman's theory of "learned helplessness."
 					     -- Dan Birchall in a.s.r
-----------------------------------------------------------------------
  2 days until the 222nd anniversary of the signing of the U.S. Constitution

Re: ruleqa question

Posted by Warren Togami <wt...@redhat.com>.
On 09/15/2009 06:00 PM, John Hardin wrote:
> On Tue, 15 Sep 2009, Warren Togami wrote:
>
>> http://ruleqa.spamassassin.org/20090915-r815222-n
>>
>> Can someone figure out why wt-en4 isn't appearing on ruleqa?
>>
>> On previous days wt-en3 disappeared for no reason I am able to ascertain.
>
> It might not be done running the masscheck for the 15th yet...?
>
> I'm assuming that the ruleqa analysis starts being visible when
> masscheck starts producing results, and if you keep revisiting the
> current run while it's still underway, the results will change (e.g. hit
> rate, S/O, etc.)
>
> Am I mistaken?
>

wt-en4 was uploaded at roughly a similar time as wt-en[1-3] many hours 
ago, but wt-en4 doesn't appear on ruleqa.

The previous two days wt-en3 was uploaded but didn't appear at all.

Warren

Re: ruleqa question

Posted by John Hardin <jh...@impsec.org>.
On Tue, 15 Sep 2009, Warren Togami wrote:

> http://ruleqa.spamassassin.org/20090915-r815222-n
>
> Can someone figure out why wt-en4 isn't appearing on ruleqa?
>
> On previous days wt-en3 disappeared for no reason I am able to 
> ascertain.

It might not be done running the masscheck for the 15th yet...?

I'm assuming that the ruleqa analysis starts being visible when masscheck 
starts producing results, and if you keep revisiting the current run while 
it's still underway, the results will change (e.g. hit rate, S/O, etc.)

Am I mistaken?

-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   ...much of our country's counterterrorism security spending is not
   designed to protect us from the terrorists, but instead to protect
   our public officials from criticism when another attack occurs.
                                                     -- Bruce Schneier
-----------------------------------------------------------------------
  2 days until the 222nd anniversary of the signing of the U.S. Constitution