You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Marc Perkel <ma...@perkel.com> on 2006/06/20 05:55:58 UTC

How to install iXhash

I found this plugin iXhash in the Wiki but I don't know how to use it. 
What do I do to install it?

RE: How to install iXhash

Posted by Benny Pedersen <me...@junc.org>.
> /lib/Mail/SpamAssassin/Plugin

/etc/mail/spamassassin so it beeing there after next upgrade of sa ?




Re: How to install iXhash

Posted by Marc Perkel <ma...@perkel.com>.
OK - I updated the Wiki - but - how about writing up a good overview of 
what the plugin does and why people would want to use it.

Re: How to install iXhash

Posted by Marc Perkel <ma...@perkel.com>.
I suppose I did. I used the files posed in the Wiki.

Dirk Bonengel wrote:
> Nice to hear! But: Don't blame me if you get a FP due to iXhash.
> Did you set up all three lists, btw? (i.e. manitu.net, 
> login-solutions.de and login-solutions.ag ??)
>
>

Re: How to install iXhash

Posted by Dirk Bonengel <di...@bonengel.de>.
Nice to hear! But: Don't blame me if you get a FP due to iXhash.
Did you set up all three lists, btw? (i.e. manitu.net, 
login-solutions.de and login-solutions.ag ??)

Dirk

Marc Perkel schrieb:
> So far so good. This is as you say very accurate. I increased the 
> score to 4.5. No FPs so far. In fact it's catching spam that would 
> have slipped through. For what it's worth this should definitely be 
> part of the default package rather than a third party plugin.
>


Re: How to install iXhash

Posted by Marc Perkel <ma...@perkel.com>.
So far so good. This is as you say very accurate. I increased the score 
to 4.5. No FPs so far. In fact it's catching spam that would have 
slipped through. For what it's worth this should definitely be part of 
the default package rather than a third party plugin.


Re: How to install iXhash

Posted by Marc Perkel <ma...@perkel.com>.

Dirk Bonengel wrote:
> Hi all,
>
> just a few explanations to the iXhash stuff:
> First of all, sorry there were no installation instructions - I'll 
> work on that (Marc already added a few lines - thanks)
> What the plugin does is the following:
> - It works solely on the body of an email.
> - Given a few minimum requirements are met a copy of the body is 
> stripped of superfluous information and a MD5 hash computed from the 
> rest. There are basically two differnet stripping algorithms 
> (resulting in two hashes), if none of them can be computed a simple 
> hash of the complete body will computed instead.
> - The hashes are then checked via DNS . Normally there will be two 
> hashes, so you will have two seperate DNS requests. If you get a 
> result (127.0.0.2)  this hash is identical to a know spam's hash and 
> the mail being tested is spam (for the plugin at least)
>
> Obviously, Net::DNS  and Digest::MD5 are required (and 
> Mail::SpamAssassin...)
>
> The plugin is modeled after a procmail-based anti-spam project called 
> NiXSpam, published by the German IT magazine iX some while ago.The 
> hashes available in the manitu.net zone  come from that source. The 
> two nospam.login-solutions.(de|ag)-zones are maintained by 
> me.Especially the .de zone has grown quite large and should give some 
> results.
>
> In the end you get another sort of fuzzy checksum-like network test 
> along the lines of razor, pyzor and DCC. The feedback I got so far is 
> that it actually helps detecting spam that would slip thru, esp. 
> image-only spam and the like.
>
> There is no automatic (or semi-automatic) reporting of hashes atm. 
> Presumably never will...this is foremost a question of 
> computing/network/Gehirnschmalz ressources
> Also, there is no 'confidence level'. one could add it using the 
> returned IP from the DNS to make the number of reported hashes somehow 
> visible, but I see little need to - there are close to now FPs, and 
> the one I did see were due to problems in the implementation on my 
> side. In other words, if you get a 127.0.0.1 returned, the plugin is 
> 100% sure it's spam.
>
> I registered to project @ Sourceforge to offer CVS and the like, but 
> as I live in Munich, I don't see me uploading content as long as the 
> World Cup is on. Saturday I witnessed a Saudi-Arabian/Brazilian 
> drumming session at the Marienplatz .... - no, I'd rather not spend 
> much time on my PC!!
>
> Dirk
If there are no FPs then the default score should be higher.

Re: How to install iXhash

Posted by Dirk Bonengel <di...@bonengel.de>.
Hi all,

just a few explanations to the iXhash stuff:
First of all, sorry there were no installation instructions - I'll work 
on that (Marc already added a few lines - thanks)
What the plugin does is the following:
- It works solely on the body of an email.
- Given a few minimum requirements are met a copy of the body is 
stripped of superfluous information and a MD5 hash computed from the 
rest. There are basically two differnet stripping algorithms (resulting 
in two hashes), if none of them can be computed a simple hash of the 
complete body will computed instead.
- The hashes are then checked via DNS . Normally there will be two 
hashes, so you will have two seperate DNS requests. If you get a result 
(127.0.0.2)  this hash is identical to a know spam's hash and the mail 
being tested is spam (for the plugin at least)

Obviously, Net::DNS  and Digest::MD5 are required (and 
Mail::SpamAssassin...)

The plugin is modeled after a procmail-based anti-spam project called 
NiXSpam, published by the German IT magazine iX some while ago.The 
hashes available in the manitu.net zone  come from that source. The two 
nospam.login-solutions.(de|ag)-zones are maintained by me.Especially the 
.de zone has grown quite large and should give some results.

In the end you get another sort of fuzzy checksum-like network test 
along the lines of razor, pyzor and DCC. The feedback I got so far is 
that it actually helps detecting spam that would slip thru, esp. 
image-only spam and the like.

There is no automatic (or semi-automatic) reporting of hashes atm. 
Presumably never will...this is foremost a question of 
computing/network/Gehirnschmalz ressources
Also, there is no 'confidence level'. one could add it using the 
returned IP from the DNS to make the number of reported hashes somehow 
visible, but I see little need to - there are close to now FPs, and the 
one I did see were due to problems in the implementation on my side. In 
other words, if you get a 127.0.0.1 returned, the plugin is 100% sure 
it's spam.

I registered to project @ Sourceforge to offer CVS and the like, but as 
I live in Munich, I don't see me uploading content as long as the World 
Cup is on. Saturday I witnessed a Saudi-Arabian/Brazilian drumming 
session at the Marienplatz .... - no, I'd rather not spend much time on 
my PC!!

Dirk




Re: How to install iXhash

Posted by David Goldsmith <dg...@sans.org>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

David Goldsmith wrote:
> Dirk Bonengel wrote:
>>> Marc,
>>>
>>> just drop both files (.cf and .pm) into the directory where your
>>> local.cf is.
>>> One important piece of (missing) info: You must be running SA v 3.1.0 or
>>> higher (not 3.0 as stated). If this is a problem I can easily post a
>>> version working with 3.0.x
> 
> - From the iXhash.cf file:
> 
>   body          IXHASH eval:ixhashtest('ix.dnsbl.manitu.net')
>   body          LOGINHASH1 eval:ixhashtest('nospam.login-solutions.de')
>   body          LOGINHASH2 eval:ixhashtest('nospam.login-solutions.ag')
> 
> I'm not getting an A records for the 2nd and 3rd hosts.  Should I be?
> 
> I can resolve the manitu.net host.
> 
> Dave

Never mind, I think.  Just ran spamassassin -D on a message.  It looks
like iXhash is calculating 2 hashes for each message and then trying to
do a DNS lookup where it prepends the hash to the domain values in the
'body' declarations.

Dave
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.3rc2 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFEmHoU417vU8/9QfkRAlVHAKCL7tKzf/uVoVhefTuosN0ABYNhhACgrWVa
a8jBQf6knjT0gm960rpeFVU=
=x6OD
-----END PGP SIGNATURE-----

Re: How to install iXhash

Posted by David Goldsmith <dg...@sans.org>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Dirk Bonengel wrote:
> Marc,
> 
> just drop both files (.cf and .pm) into the directory where your
> local.cf is.
> One important piece of (missing) info: You must be running SA v 3.1.0 or
> higher (not 3.0 as stated). If this is a problem I can easily post a
> version working with 3.0.x

- From the iXhash.cf file:

  body          IXHASH eval:ixhashtest('ix.dnsbl.manitu.net')
  body          LOGINHASH1 eval:ixhashtest('nospam.login-solutions.de')
  body          LOGINHASH2 eval:ixhashtest('nospam.login-solutions.ag')

I'm not getting an A records for the 2nd and 3rd hosts.  Should I be?

I can resolve the manitu.net host.

Dave
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.3rc2 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFEmHg8417vU8/9QfkRAmFNAJ4mXCguIe/s1HRvY5fN0eptKwLGmQCbBYMy
EZk2U06y5ec3sRGPk6nbvsk=
=+miL
-----END PGP SIGNATURE-----

Re: How to install iXhash

Posted by Marc Perkel <ma...@perkel.com>.
OK - so far so good. It seems to be detecting spam. I have a few 
questions though.

If SA determines that it is spam and ixhash doesn't detect it, will SA 
sort of report it to ixhash to the ixhash will learn it? If not - 
shouldn't it?

Is there any confidence levels that can be returned. If possible I'd 
rather get some sort of a number that gives me an idea how sure ixhash 
is and score it relative to confidence.


Re: How to install iXhash

Posted by Dirk Bonengel <di...@bonengel.de>.
Marc,

just drop both files (.cf and .pm) into the directory where your 
local.cf is.
One important piece of (missing) info: You must be running SA v 3.1.0 or 
higher (not 3.0 as stated). If this is a problem I can easily post a 
version working with 3.0.x

Dirk

Marc Perkel schrieb:
>
>
> Matt Kettler wrote:
>> Marc Perkel wrote:
>>   
>>> Here's the link to the wiki, but I don't know what to do with it.
>>>
>>> http://wiki.apache.org/spamassassin/iXhash
>>>
>>>     
>> Disclaimer: I've never tried this. However, the following is a fairly
>> well educated guess at how to install it.
>>
>> 1) copy paste the bottom half into a file called iXhash.pm
>> 2) copy-paste the top half into a file called "ixhash.cf"
>> 3) place iXhash.pm somewhere that is global r/x
>> 4) edit the ixhash.cf to reflect where iXhash.pm is.
>> 5) copy ixhash.cf into /etc/mail/spamassasssin
>> 6) run spamassassin --lint
>> 7) if it passes, restart spamd or any other persistent daemons that use
>> the spamassassin perl API.
>>
>>
>>   
>
> Thanks Matt - what directory would you put iXhash.pm in? If I get this 
> to work I'll update the wiki.


Re: How to install iXhash

Posted by Vincent Li <vi...@gmail.com>.
On 20-Jun-06, at 7:29 AM, Marc Perkel wrote:

>
>
>  Matt Kettler wrote:
> Marc Perkel wrote:
>
> Here's the link to the wiki, but I don't know what to do with it.
>
>  http://wiki.apache.org/spamassassin/iXhash
>
>
> Disclaimer: I've never tried this. However, the following is a fairly
> well educated guess at how to install it.
>
> 1) copy paste the bottom half into a file called iXhash.pm
> 2) copy-paste the top half into a file called "ixhash.cf"
> 3) place iXhash.pm somewhere that is global r/x
> 4) edit the ixhash.cf to reflect where iXhash.pm is.
> 5) copy ixhash.cf into /etc/mail/spamassasssin
> 6) run spamassassin --lint
> 7) if it passes, restart spamd or any other persistent daemons that use
> the spamassassin perl API.
>
>
>
>
>  Thanks Matt - what directory would you put iXhash.pm in? If I get 
> this to work I'll update the wiki.
>

Should be under /Whatever/Mail/SpamAssassin/Plugin/ I think.


Vincent Li
System Administrator
The Biomedical Research Centre
University of British Columbia
Phone:      604-822-7830
Fax:         604-822-7815

RE: How to install iXhash

Posted by Bret Miller <br...@wcg.org>.
/lib/Mail/SpamAssassin/Plugin


  _____  

From: Marc Perkel [mailto:marc@perkel.com] 
Sent: Tuesday, June 20, 2006 7:29 AM
To: Matt Kettler
Cc: users@spamassassin.apache.org
Subject: Re: How to install iXhash




Matt Kettler wrote: 

Marc Perkel wrote:

  

Here's the link to the wiki, but I don't know what to do with it.



http://wiki.apache.org/spamassassin/iXhash



    

Disclaimer: I've never tried this. However, the following is a fairly

well educated guess at how to install it.



1) copy paste the bottom half into a file called iXhash.pm

2) copy-paste the top half into a file called "ixhash.cf"

3) place iXhash.pm somewhere that is global r/x

4) edit the ixhash.cf to reflect where iXhash.pm is.

5) copy ixhash.cf into /etc/mail/spamassasssin

6) run spamassassin --lint

7) if it passes, restart spamd or any other persistent daemons that use

the spamassassin perl API.





  


Thanks Matt - what directory would you put iXhash.pm in? If I get this
to work I'll update the wiki.





Re: How to install iXhash

Posted by Marc Perkel <ma...@perkel.com>.

Matt Kettler wrote:
> Marc Perkel wrote:
>   
>> Here's the link to the wiki, but I don't know what to do with it.
>>
>> http://wiki.apache.org/spamassassin/iXhash
>>
>>     
> Disclaimer: I've never tried this. However, the following is a fairly
> well educated guess at how to install it.
>
> 1) copy paste the bottom half into a file called iXhash.pm
> 2) copy-paste the top half into a file called "ixhash.cf"
> 3) place iXhash.pm somewhere that is global r/x
> 4) edit the ixhash.cf to reflect where iXhash.pm is.
> 5) copy ixhash.cf into /etc/mail/spamassasssin
> 6) run spamassassin --lint
> 7) if it passes, restart spamd or any other persistent daemons that use
> the spamassassin perl API.
>
>
>   

Thanks Matt - what directory would you put iXhash.pm in? If I get this 
to work I'll update the wiki.

Re: How to install iXhash

Posted by Matt Kettler <mk...@comcast.net>.
Marc Perkel wrote:
> Here's the link to the wiki, but I don't know what to do with it.
>
> http://wiki.apache.org/spamassassin/iXhash
>
Disclaimer: I've never tried this. However, the following is a fairly
well educated guess at how to install it.

1) copy paste the bottom half into a file called iXhash.pm
2) copy-paste the top half into a file called "ixhash.cf"
3) place iXhash.pm somewhere that is global r/x
4) edit the ixhash.cf to reflect where iXhash.pm is.
5) copy ixhash.cf into /etc/mail/spamassasssin
6) run spamassassin --lint
7) if it passes, restart spamd or any other persistent daemons that use
the spamassassin perl API.




Re: How to install iXhash

Posted by Marc Perkel <ma...@perkel.com>.
Here's the link to the wiki, but I don't know what to do with it.

http://wiki.apache.org/spamassassin/iXhash