You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by liyas_m m <li...@gmail.com> on 2005/07/01 05:56:10 UTC
Re: how do train SpamAssassin
running spamassassin --lint gives me these
config: SpamAssassin failed to parse line, skipping: report_header 1
config: SpamAssassin failed to parse line, skipping: detailed_phrase_score 1
config: SpamAssassin failed to parse line, skipping: spam_level_stars 1
warning: score set for non-existent rule MICROSOFT_EXECUTABLE
lint: 4 issues detected. please rerun with debug enabled for more information.
On 6/30/05, Andy Jezierski <aj...@stepan.com> wrote:
>
> liyas_m m <li...@gmail.com> wrote on 06/30/2005 12:02:15 AM:
>
> > :0fw
> > | /usr/bin/spamc
> > No i dont see any X_Spam_headers
> >
> >
>
> Please respond to the list so others can assist.
>
> I don't use procmail, so I can't help you there. I assume you have spamd
> running? Run spamassassin --lint does it produce any errors?
>
>
> Andy
>
>
>
> > On 6/29/05, Andy Jezierski <aj...@stepan.com> wrote:
> > >
> > > liyas_m m <li...@gmail.com> wrote on 06/29/2005 09:19:50 AM:
> > >
> > > > I just installed SpamAssassin, but it does not catcht any spam..
> > > > Does SA need to be trained? If it does, how do u do that?
> > >
> > > How are you invoking SA? Are you seeing any X_Spam_ headers in any of
> your
> > > messages?
> > > More info is required to help you.
> > >
> > > Andy
>
Re: how do train SpamAssassin
Posted by liyas_m m <li...@gmail.com>.
i meant ..overriding the OLD version
On 7/1/05, liyas_m m <li...@gmail.com> wrote:
> i installed new version completely...overiding the latest version.
>
>
> On 7/1/05, jdow <jd...@earthlink.net> wrote:
> > Per last message - did you just upgrade from a very old spamassassin
> > or did someone cleverly overwrite your /usr/mail/spamassassin/local.cf
> > file with something spurious?
> >
> > The three items that failed to parse are not valid in 3.0.4. And there
> > is a score defined for a rule that does not or no longer exists.
> >
> > The upgrade notes might help you. They are on the WIKI site.
> >
> > {^_^}
> > ----- Original Message -----
> > From: "liyas_m m" <li...@gmail.com>
> >
> >
> > > running spamassassin --lint gives me these
> > >
> > > config: SpamAssassin failed to parse line, skipping: report_header 1
> > > config: SpamAssassin failed to parse line, skipping: detailed_phrase_score
> > 1
> > > config: SpamAssassin failed to parse line, skipping: spam_level_stars 1
> > > warning: score set for non-existent rule MICROSOFT_EXECUTABLE
> > > lint: 4 issues detected. please rerun with debug enabled for more
> > information.
> > >
> > >
> > > On 6/30/05, Andy Jezierski <aj...@stepan.com> wrote:
> > > >
> > > > liyas_m m <li...@gmail.com> wrote on 06/30/2005 12:02:15 AM:
> > > >
> > > > > :0fw
> > > > > | /usr/bin/spamc
> > > > > No i dont see any X_Spam_headers
> > > > >
> > > > >
> > > >
> > > > Please respond to the list so others can assist.
> > > >
> > > > I don't use procmail, so I can't help you there. I assume you have spamd
> > > > running? Run spamassassin --lint does it produce any errors?
> > > >
> > > >
> > > > Andy
> > > >
> > > >
> > > >
> > > > > On 6/29/05, Andy Jezierski <aj...@stepan.com> wrote:
> > > > > >
> > > > > > liyas_m m <li...@gmail.com> wrote on 06/29/2005 09:19:50 AM:
> > > > > >
> > > > > > > I just installed SpamAssassin, but it does not catcht any
> > spam..
> > > > > > > Does SA need to be trained? If it does, how do u do that?
> > > > > >
> > > > > > How are you invoking SA? Are you seeing any X_Spam_ headers in any
> > of
> > > > your
> > > > > > messages?
> > > > > > More info is required to help you.
> > > > > >
> > > > > > Andy
> > > >
> >
> >
> >
>
Re: how do train SpamAssassin
Posted by Kai Schaetzl <ma...@conactive.com>.
Liyas_m m wrote on Sat, 2 Jul 2005 10:27:18 +0800:
> Do i really need to train SA.
If you don't want to wait very long for it to kick in: yes. Otherwise: no.
.so what is the purpose of auto learn bayes?
Relieving you of manual learning after the initial training.
> Do I also need to install Razor?
If you want to use it: yes. Otherwise: no.
May I suggest you read documentation before asking?
Kai
--
Kai Schätzl, Berlin, Germany
Get your web at Conactive Internet Services: http://www.conactive.com
IE-Center: http://ie5.de & http://msie.winware.org
Re: how do train SpamAssassin
Posted by Loren Wilton <lw...@earthlink.net>.
> Do i really need to train SA..so what is the purpose of auto learn bayes?
Not if you aren't planning on using Bayes.
> Do I also need to install Razor?
Not if you aren't using Razor.
> why why please make it simple and easy
Ok, simple and easy:
1. SA is a tool for fighting email spam
2. SA does this by applying various rules to the email.
3. The various rules look fo rdifferent spam signs, and assign different
scores if the rules match things found in the mail.
4. If enough rules match things in the mail, the total score is greater
than the spam threshhold (by default, 5) and SA will mark the message as
spam.
5. The more different rules you have checking various things, the more
likely you are to be able to catch different kinds of spam. If you have
fewer rules, you are less likely to detect that a spam is spam.
6. Bayes and Razor are two different kinds of rules that can be used to
detect spam. If you have them turned on, you have a better chance of
catching spam. If you don't have them turned on, there is a better chance
the spam will make it into your inbox.
7. If you are using SA to eliminate spam, then you probably want it to do
the best job it can. This would seem to imply that you want to have as many
rules as possible to catch spam. Since Bayes and Razor are rules to catch
spam, you might want to use them.
8. BUT --- Bayes and Razor are not "simple" rules. You have to do
something yourself to make them work. You might find this too hard, or too
much work, or have other problems with doing it. For instance, you might
have to pay someone to be able to use Razor, depending on how you are using
it. So Bayes and Razor (and some other rules) are optional. You don't have
to use them if you don't want to.
9. Why do you have to train Bayes --- Bayes is a very special kind of
rule. It matches words it finds in email to words it has found before in
ham mails and spam mails. If it finds a lot of words that match spam mails
in the current email, it guesses that it is spam. If it finds a lot of
words that match ham mails, it guesses that the current email is ham.
Bayes does not "know" which words appear in YOUR ham and YOUR spam. You
have to give it a handful of mail and say "these are ham" and another
handful and say "these are spam". Bayes can then go in an decide which
words show up in YOUR spam and in YOUR ham. Then it can render judgement on
new emails.
There are two ways to "train" Bayes - manual learning and auto-learning.
With Manual Learning, someone with a brain, you for instance, looks at the
emails and says "these are spam" and "these others are ham". There is no
guesswork involved -- YOU have decided what is spam and what is ham. You
then tell Bayes this, and it begins to know about your mail patterns.
With auto-learning, Bayes does not really KNOW which mails are REALLY spam
and ham. Instead, it relies on the other rules. Which are pretty good, but
aren't as good as a real person looking at the mail. The mail is given an
initial score from the other rules. Then this score is compared to the
"bayes auto-learn" thresholds. If the mail scores LESS than the "ham"
threshold, SA gives it to Bayes to learn as ham. Likewise if it scores more
than the Spam threshhold, SA gives it to Bayes to learn as spam. Then SA
adds the Bayes score to the mail and reports it as the final score.
Most people that have problems with Bayes rely on the auto-learning. And
for one reason or another, this doesn't work as well as they want it to, and
pretty soon Bayes starts thinking ham is spam and spam is ham, and screwing
up the score.
Now, can auto-learning work? Yes. *IF* you first train Bayes manually to
get it on the right track, and then adjust the bayes ham auto-learn score
down a little bit, so that it is less likely to learn spam as ham.
You can also spend a few hours feeding bayes, leave auto-learn off, and then
forget about it, and Bayes will work. Probably very well. Every month or
two you might feed Bayes a few more low-scoring spam or high-scoring ham to
keep it up with changing patterns.
Or if that is too much work, just don't use Bayes at all.
10. Razor is an optional test because you might have to pay for it,
depending on your situation. There is no requirement that you use it --
that is why it is optional. Just turn it off and forget about it if you
don't want it.
Simple enough?
Loren
Re: how do train SpamAssassin
Posted by Kai Schaetzl <ma...@conactive.com>.
Liyas_m m wrote on Sat, 2 Jul 2005 11:10:19 +0800:
> if that is so, why did i get these when doing spamassassin
you may want to install it if you want to use it.
Kai
--
Kai Schätzl, Berlin, Germany
Get your web at Conactive Internet Services: http://www.conactive.com
IE-Center: http://ie5.de & http://msie.winware.org
Re: how do train SpamAssassin
Posted by Loren Wilton <lw...@earthlink.net>.
> > I believe you will find that the default install for 3.0.4 has RAZOR2
> > rules running and hitting some spam.
>
> if that is so, why did i get these when doing spamassassin --lintt
> debug: SpamAssassin version 3.0.4
> debug: Score set 0 chosen.
Score set 0 is no net tests and no bayes.
This means that you either have net tests disabled, or your version of
Net::DNS doesn't exist, is too old, or is not properly installed.
spamassassin -D will tell you which of these is the case.
Since you are not running net tests, you are not going to be running razor,
dcc, or any of the other net tests. spamassassin -D will probably tell you
in various debug messages that it isn't using these parts.
Loren
Re: how do train SpamAssassin
Posted by liyas_m m <li...@gmail.com>.
debug: SpamAssassin version 3.0.4
debug: Score set 0 chosen.
.
.debug: Pyzor is not available: pyzor not found
debug: Razor2 is not available
debug: DCCifd is not available: no r/w dccifd socket found.
On 7/2/05, jdow <jd...@earthlink.net> wrote:
> From: "liyas_m m" <li...@gmail.com>
>
> I an the wrong person, in a politically correct sense, to ask this one:
>
> > Do i really need to train SA..so what is the purpose of auto learn bayes?
>
> As I see it the purpose of auto learn Bayes is to corrupt your Bayes
> database. I never use it. I manually train. My database is as clean and
> effective as the day it was born and passed double-200. In fact it's more
> effective because I train it on real new spam rather than every bit of
> random trash that comes through. But then, I am a stubborn old biddy who
> happens to like "what works" rather than "what's easy."
>
> Now, this one, I believe I "might" know in a PC sense (pun intended):
>
> > Do I also need to install Razor? why why please make it simple and easy
>
> I believe you will find that the default install for 3.0.4 has RAZOR2
> rules running and hitting some spam.
if that is so, why did i get these when doing spamassassin --lintt
debug: SpamAssassin version 3.0.4
debug: Score set 0 chosen.
.
.debug: Pyzor is not available: pyzor not found
debug: Razor2 is not available
debug: DCCifd is not available: no r/w dccifd socket found.
>
> {^_^}
>
>
Re: how do train SpamAssassin
Posted by liyas_m m <li...@gmail.com>.
Do i really need to train SA..so what is the purpose of auto learn bayes?
Do I also need to install Razor? why why please make it simple and easy
On 7/1/05, jdow <jd...@earthlink.net> wrote:
> You must realize that the local.cf file is NOT overwritten by upgrades.
> This is specifically mentioned in the notes.
>
> {^_^}
> ----- Original Message -----
> From: "liyas_m m" <li...@gmail.com>
>
>
> > i installed new version completely...overiding the latest version.
>
>
>
Re: how do train SpamAssassin
Posted by jdow <jd...@earthlink.net>.
You must realize that the local.cf file is NOT overwritten by upgrades.
This is specifically mentioned in the notes.
{^_^}
----- Original Message -----
From: "liyas_m m" <li...@gmail.com>
> i installed new version completely...overiding the latest version.
Re: how do train SpamAssassin
Posted by liyas_m m <li...@gmail.com>.
i installed new version completely...overiding the latest version.
On 7/1/05, jdow <jd...@earthlink.net> wrote:
> Per last message - did you just upgrade from a very old spamassassin
> or did someone cleverly overwrite your /usr/mail/spamassassin/local.cf
> file with something spurious?
>
> The three items that failed to parse are not valid in 3.0.4. And there
> is a score defined for a rule that does not or no longer exists.
>
> The upgrade notes might help you. They are on the WIKI site.
>
> {^_^}
> ----- Original Message -----
> From: "liyas_m m" <li...@gmail.com>
>
>
> > running spamassassin --lint gives me these
> >
> > config: SpamAssassin failed to parse line, skipping: report_header 1
> > config: SpamAssassin failed to parse line, skipping: detailed_phrase_score
> 1
> > config: SpamAssassin failed to parse line, skipping: spam_level_stars 1
> > warning: score set for non-existent rule MICROSOFT_EXECUTABLE
> > lint: 4 issues detected. please rerun with debug enabled for more
> information.
> >
> >
> > On 6/30/05, Andy Jezierski <aj...@stepan.com> wrote:
> > >
> > > liyas_m m <li...@gmail.com> wrote on 06/30/2005 12:02:15 AM:
> > >
> > > > :0fw
> > > > | /usr/bin/spamc
> > > > No i dont see any X_Spam_headers
> > > >
> > > >
> > >
> > > Please respond to the list so others can assist.
> > >
> > > I don't use procmail, so I can't help you there. I assume you have spamd
> > > running? Run spamassassin --lint does it produce any errors?
> > >
> > >
> > > Andy
> > >
> > >
> > >
> > > > On 6/29/05, Andy Jezierski <aj...@stepan.com> wrote:
> > > > >
> > > > > liyas_m m <li...@gmail.com> wrote on 06/29/2005 09:19:50 AM:
> > > > >
> > > > > > I just installed SpamAssassin, but it does not catcht any
> spam..
> > > > > > Does SA need to be trained? If it does, how do u do that?
> > > > >
> > > > > How are you invoking SA? Are you seeing any X_Spam_ headers in any
> of
> > > your
> > > > > messages?
> > > > > More info is required to help you.
> > > > >
> > > > > Andy
> > >
>
>
>
Re: how do train SpamAssassin
Posted by jdow <jd...@earthlink.net>.
Per last message - did you just upgrade from a very old spamassassin
or did someone cleverly overwrite your /usr/mail/spamassassin/local.cf
file with something spurious?
The three items that failed to parse are not valid in 3.0.4. And there
is a score defined for a rule that does not or no longer exists.
The upgrade notes might help you. They are on the WIKI site.
{^_^}
----- Original Message -----
From: "liyas_m m" <li...@gmail.com>
> running spamassassin --lint gives me these
>
> config: SpamAssassin failed to parse line, skipping: report_header 1
> config: SpamAssassin failed to parse line, skipping: detailed_phrase_score
1
> config: SpamAssassin failed to parse line, skipping: spam_level_stars 1
> warning: score set for non-existent rule MICROSOFT_EXECUTABLE
> lint: 4 issues detected. please rerun with debug enabled for more
information.
>
>
> On 6/30/05, Andy Jezierski <aj...@stepan.com> wrote:
> >
> > liyas_m m <li...@gmail.com> wrote on 06/30/2005 12:02:15 AM:
> >
> > > :0fw
> > > | /usr/bin/spamc
> > > No i dont see any X_Spam_headers
> > >
> > >
> >
> > Please respond to the list so others can assist.
> >
> > I don't use procmail, so I can't help you there. I assume you have spamd
> > running? Run spamassassin --lint does it produce any errors?
> >
> >
> > Andy
> >
> >
> >
> > > On 6/29/05, Andy Jezierski <aj...@stepan.com> wrote:
> > > >
> > > > liyas_m m <li...@gmail.com> wrote on 06/29/2005 09:19:50 AM:
> > > >
> > > > > I just installed SpamAssassin, but it does not catcht any
spam..
> > > > > Does SA need to be trained? If it does, how do u do that?
> > > >
> > > > How are you invoking SA? Are you seeing any X_Spam_ headers in any
of
> > your
> > > > messages?
> > > > More info is required to help you.
> > > >
> > > > Andy
> >