You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by Theo Van Dinter <fe...@apache.org> on 2006/02/22 14:58:07 UTC
Nightly/Weekly mass-checks ... where are folks?
I was looking at the corpus area and was noticing that the only people
who are currently doing nightly/weekly runs are:
bzoetekouw
cthielen
daf
parkerm
theo
zmi
The buildbot ones haven't been updated in almost a week, jm hasn't
put results in for almost a month, rodbegbie is almost three months,
and quinlan is at around seven months (!!!).
There are a total of 39 accounts for submissions, having only 6 people
submitting results isn't good. We really need to have more/wider
participation for the nightly/weekly runs!
--
Randomly Generated Tagline:
"So, the long and short of it--if you have one sysadmin, you have a
"system administrator." If you have two sysadmins, you have two "system
administrators." If you have two thousand sysadmins, you're at LISA."
- Trey Harris <Pi...@shells.valinux.com>
Re: Nightly/Weekly mass-checks ... where are folks?
Posted by Theo Van Dinter <fe...@apache.org>.
On Sun, Feb 26, 2006 at 03:03:26PM +0100, Michael Monnerie wrote:
> So you didn't see my question, obviously ;-)
>
> Again:
> Is the spamfile in rsync.spamassassin.org/mailcorpus_zmi/spam/ also of
> use? It's all hand sorted.
Actually I did see it, I just didn't have an answer for you since JM is the
one who's been working on the rsync corpus/buildbot mass-check stuff. Justin?
--
Randomly Generated Tagline:
A person with two watches is never sure what time it is.
Re: Nightly/Weekly mass-checks ... where are folks?
Posted by Michael Monnerie <m....@zmi.at>.
On Sonntag, 26. Februar 2006 04:12 Theo Van Dinter wrote:
> Really? I didn't see it or else I would have responded earlier. :(
So you didn't see my question, obviously ;-)
Again:
Is the spamfile in rsync.spamassassin.org/mailcorpus_zmi/spam/ also of
use? It's all hand sorted.
mfg zmi
--
// Michael Monnerie, Ing.BSc --- it-management Michael Monnerie
// http://zmi.at Tel: 0660/4156531 Linux 2.6.11
// PGP Key: "lynx -source http://zmi.at/zmi2.asc | gpg --import"
// Fingerprint: EB93 ED8A 1DCD BB6C F952 F7F4 3911 B933 7054 5879
// Keyserver: www.keyserver.net Key-ID: 0x70545879
Re: Nightly/Weekly mass-checks ... where are folks?
Posted by Theo Van Dinter <fe...@apache.org>.
On Sat, Feb 25, 2006 at 08:51:47PM -0500, Warren Togami wrote:
> Evidently months of my submissions were getting lost due to a stupid
> mistake on my part, and when I attempted to ask here if it was working,
> nobody responded.
Really? I didn't see it or else I would have responded earlier. :(
> Would it be possible to setup an automated web page where people can see
> a list of accounts who are successfully uploading the right data? This
> would be valuable to folks starting out in mass checks to be sure they
> are doing the right thing.
Sort of. "the right data" isn't really detectable so completely.
There are three things that need to happen for a "successful" run:
- run mass-check nightly and/or weekly and upload the results
- use the correct version for the above, detectable by the
"Revision" header in the log file
- use all of the appropriate rules for the revision above
The first one is pretty easily determined. Goto
http://rsync.spamassassin.org/ and look for your files.
The second takes a little more work. You need to look at what
the version is supposed to be (last line in nightly-versions.txt or
weekly-versions.txt), then compare that to the Revision header in your log
files. If it says "unknown" or the revision number is wrong, that's bad!
The third would require a lot of work, probably checking statistics that
the hits look the same as everyone else's, etc. We're leaving that up to
submitters at the moment, and our docs could probably use some help.
Speaking of this... Justin -- is the auto-promoting
stuff / ruleqa site broken? There seem to be no results at
http://ruleqa.spamassassin.org/?daterev=last-night and prodding around
in the updatesd homedir:
-rw-r--r-- 1 updatesd other 14538 Feb 23 08:30 active.list
-rw-r--r-- 1 updatesd other 0 Feb 25 08:30 active.list.new
which seems bad. listpromotable gives me an error code of 29, but I have no
idea what that means. My guess is that it's erroring because the ruleqa site
isn't returning data, and I haven't yet figured out why that is.
--
Randomly Generated Tagline:
"We shall reach greater and greater platitudes of achievement."
-- Richard J. Daley
Re: Nightly/Weekly mass-checks ... where are folks?
Posted by Warren Togami <wt...@redhat.com>.
Michael Monnerie wrote:
> On Mittwoch, 22. Februar 2006 14:58 Theo Van Dinter wrote:
>> I was looking at the corpus area and was noticing that the only
>> people who are currently doing nightly/weekly runs are:
>>
>> zmi
>
> Good. I was just going to ask whether my stats are OK. Is the spamfile
> in rsync.spamassassin.org/mailcorpus_zmi/spam/ also of use? It's all
> hand sorted.
>
> mfg zmi
Evidently months of my submissions were getting lost due to a stupid
mistake on my part, and when I attempted to ask here if it was working,
nobody responded.
Would it be possible to setup an automated web page where people can see
a list of accounts who are successfully uploading the right data? This
would be valuable to folks starting out in mass checks to be sure they
are doing the right thing.
Warren Togami
wtogami@redhat.com
Re: Nightly/Weekly mass-checks ... where are folks?
Posted by Michael Monnerie <m....@zmi.at>.
On Mittwoch, 22. Februar 2006 14:58 Theo Van Dinter wrote:
> I was looking at the corpus area and was noticing that the only
> people who are currently doing nightly/weekly runs are:
>
> zmi
Good. I was just going to ask whether my stats are OK. Is the spamfile
in rsync.spamassassin.org/mailcorpus_zmi/spam/ also of use? It's all
hand sorted.
mfg zmi
--
// Michael Monnerie, Ing.BSc --- it-management Michael Monnerie
// http://zmi.at Tel: 0660/4156531 Linux 2.6.11
// PGP Key: "lynx -source http://zmi.at/zmi2.asc | gpg --import"
// Fingerprint: EB93 ED8A 1DCD BB6C F952 F7F4 3911 B933 7054 5879
// Keyserver: www.keyserver.net Key-ID: 0x70545879
Re: Nightly/Weekly mass-checks ... where are folks?
Posted by Theo Van Dinter <fe...@apache.org>.
On Wed, Feb 22, 2006 at 09:41:01AM -0500, Warren Togami wrote:
> I've been doing only nightly runs because weekly was too resource
> intensive on my box. Saturdays my box skips nightly. Were my daily run
> results being uploaded properly?
I'm not seeing any results from you. Looking at the log, there are two
auth failures per day from a machine in your domain. I'll send you a
copy of what I see as your auth credentials separately, just to make
sure things are aligned on both ends. :)
--
Randomly Generated Tagline:
A bird in the hand makes it awfully hard to blow your nose.
Re: Nightly/Weekly mass-checks ... where are folks?
Posted by Warren Togami <wt...@redhat.com>.
Theo Van Dinter wrote:
> I was looking at the corpus area and was noticing that the only people
> who are currently doing nightly/weekly runs are:
>
> bzoetekouw
> cthielen
> daf
> parkerm
> theo
> zmi
>
> The buildbot ones haven't been updated in almost a week, jm hasn't
> put results in for almost a month, rodbegbie is almost three months,
> and quinlan is at around seven months (!!!).
>
> There are a total of 39 accounts for submissions, having only 6 people
> submitting results isn't good. We really need to have more/wider
> participation for the nightly/weekly runs!
>
I've been doing only nightly runs because weekly was too resource
intensive on my box. Saturdays my box skips nightly. Were my daily run
results being uploaded properly?
I can try to enable the weekly again...
Warren
Re: Nightly/Weekly mass-checks ... where are folks?
Posted by Rod Begbie <ro...@gmail.com>.
On 2/22/06, Theo Van Dinter <fe...@apache.org> wrote:
> The buildbot ones haven't been updated in almost a week, jm hasn't
> put results in for almost a month, rodbegbie is almost three months,
Because I've started using qpsmtpd and SA to reject at SMTP
transactiontime, my corpus is missing all the spam I'm rejecting.
When jm added all the nice graph-drawing stuff, it showed up pretty
quickly that my corpus wasn't too helpful.
Sorry.
Rod.
--
:: Rod Begbie :: http://groovymother.com/ ::