You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Matt <mh...@gmail.com> on 2005/01/15 02:07:38 UTC

Odd hanging on mail servers

Hello,
I am running SpamAssassin version 2.64... yes I know it's a little old
but it serves well and I've been a bit scared to upgrade to 3.0...
will be doing that soon now that things seem to be running well for
people...

My issue is that spamd seems to be hanging on me.. I can't quite tell
where or why.. and am looking for direction..

All of a sudden my qmail queue will go up to 100/100 and mail
throughput will become sluggish.   I thought it might have been a
blacklist.. so I removed all of them.. still issues... I removed virus
scanning.. same issues.. then I removed spamassassin... AAHHH mail now
flows.... put blacklists and virus scanning back in.... everything is
good again.

I have spamassassin doing some rules (nothing new has been added)..
from rules emporium.. and also running surbl on

uri       SPAMCOP_URI_RBL 
eval:check_spamcop_uri_rbl('sc.surbl.org','127.0.0.2')
describe  SPAMCOP_URI_RBL  URI's domain appears in SpamCop data at
http://www.surbl.org/lists.html
tflags    SPAMCOP_URI_RBL  net
score     SPAMCOP_URI_RBL  900.0

uri       WS_URI_RBL  eval:check_spamcop_uri_rbl('ws.surbl.org','127.0.0.2')
describe  WS_URI_RBL  URI's domain appears in sa-blacklist at
http://www.surbl.org/lists.html
tflags    WS_URI_RBL  net
score     WS_URI_RBL  500.0

uri       OB_URI_RBL  eval:check_spamcop_uri_rbl('ob.surbl.org','127.0.0.2')
describe  OB_URI_RBL  URI's domain appears in OB at
http://www.surbl.org/lists.html
tflags    OB_URI_RBL  net
score     OB_URI_RBL  300.0

uri       AB_URI_RBL  eval:check_spamcop_uri_rbl('ab.surbl.org','127.0.0.2')
describe  AB_URI_RBL  URI's domain appears in AB at
http://www.surbl.org/lists.html
tflags    AB_URI_RBL  net
score     AB_URI_RBL  200.0

uri       PH_URI_RBL 
eval:check_spamcop_uri_rbl('multi.surbl.org','127.0.0.0+8')
describe  PH_URI_RBL  URI's domain appears in PH at
http://www.surbl.org/lists.html
tflags    PH_URI_RBL  net
score     PH_URI_RBL  600.0



Any ideas?

Re: Odd hanging on mail servers

Posted by "Chr. von Stuckrad" <st...@mi.fu-berlin.de>.
On Thu, Jan 20, 2005 at 02:37:12PM -0500, Matt wrote:
> Ok that works great if you KNOW the domain.. but what do you do when
> this happens once every 3 or 4 days to random domains?

Oops!   No idea, had something like this by network glitches,
which made random DNS-Servers unavailable.  But we could do
simply nothing, because it were different places all the time.
The only thing was to set the timeouts in spamassassin very low.

Stucki

-- 
Christoph von Stuckrad     * * |nickname |<st...@math.fu-berlin.de>\
Freie Universitaet Berlin  |/_*|'stucki' |Tel(days):+49 30 838-75 459|
Fachbereich Mathematik, EDV|\ *|if online|Tel(else):+49 30 77 39 6600|
Arnimallee 2-6/14195 Berlin* * |on IRCnet|Fax(alle):+49 30 838-75454/

Re: Odd hanging on mail servers

Posted by Matt <mh...@gmail.com>.
Ok that works great if you KNOW the domain.. but what do you do when
this happens once every 3 or 4 days to random domains?


On Thu, 20 Jan 2005 20:30:18 +0100, Chr. von Stuckrad
<st...@mi.fu-berlin.de> wrote:
> On Thu, Jan 20, 2005 at 01:47:12PM -0500, Matt wrote:
> > Ahh ha! Got it.. it seems to be domains that either the name servers
> > are not responding.. or the domain doesn't exist yet.. for instance:
> >
> > debug: DNS MX records found: 0
> >
> > Is there anyway to get around this?  It seems to hang and do this
> > twice for long enough to delay the system... any thoughts?
> 
> Two things.  You can change the timeout in spamassassin's configs,
> but some spammers did something which made the situation worse.
> 
> They created lots of subdomains and redirected all
> mail for them to MTAs of (what we saw) 'saveinternet.net'
> 
> They defined correct DNS entries and MX Records,
> but then filtered completely all IP-Traffic to /dev/null.
> 
> So *every* try to *really* access them goes into
> timeouts and bogs down the mailserver.
> 
> I Assume they do it to get rid of MTAs which
> try to confirm their sender addresses.
> 
> So IF you get mail from such spammers you either
> get slowed down by the timeouting confirmation-tests,
> or you get your queues 'bloated' by bounces.
> 
> The only thing we could do, was to create a fake
> DNS-Table in our local DNS-Server (locally for
> the MTA-Host) and let the MTA believe the whole
> Domain is completely empty.
> 
> So the MTA assumes there is nobody to reach and
> drops the Mail instantaneously.
> (20% less load on the MTA since then)
> 
> Yours    Stucki
> 
> --
> Christoph von Stuckrad     * * |nickname |<st...@math.fu-berlin.de>\
> Freie Universitaet Berlin  |/_*|'stucki' |Tel(days):+49 30 838-75 459|
> Fachbereich Mathematik, EDV|\ *|if online|Tel(else):+49 30 77 39 6600|
> Arnimallee 2-6/14195 Berlin* * |on IRCnet|Fax(alle):+49 30 838-75454/
>

Re: Odd hanging on mail servers

Posted by "Chr. von Stuckrad" <st...@mi.fu-berlin.de>.
On Thu, Jan 20, 2005 at 01:47:12PM -0500, Matt wrote:
> Ahh ha! Got it.. it seems to be domains that either the name servers
> are not responding.. or the domain doesn't exist yet.. for instance:
> 
> debug: DNS MX records found: 0
> 
> Is there anyway to get around this?  It seems to hang and do this
> twice for long enough to delay the system... any thoughts?

Two things.  You can change the timeout in spamassassin's configs,
but some spammers did something which made the situation worse.

They created lots of subdomains and redirected all
mail for them to MTAs of (what we saw) 'saveinternet.net'

They defined correct DNS entries and MX Records,
but then filtered completely all IP-Traffic to /dev/null.

So *every* try to *really* access them goes into
timeouts and bogs down the mailserver.

I Assume they do it to get rid of MTAs which
try to confirm their sender addresses.

So IF you get mail from such spammers you either
get slowed down by the timeouting confirmation-tests,
or you get your queues 'bloated' by bounces.

The only thing we could do, was to create a fake
DNS-Table in our local DNS-Server (locally for
the MTA-Host) and let the MTA believe the whole
Domain is completely empty.

So the MTA assumes there is nobody to reach and
drops the Mail instantaneously.
(20% less load on the MTA since then)

Yours    Stucki

-- 
Christoph von Stuckrad     * * |nickname |<st...@math.fu-berlin.de>\
Freie Universitaet Berlin  |/_*|'stucki' |Tel(days):+49 30 838-75 459|
Fachbereich Mathematik, EDV|\ *|if online|Tel(else):+49 30 77 39 6600|
Arnimallee 2-6/14195 Berlin* * |on IRCnet|Fax(alle):+49 30 838-75454/

Re: Odd hanging on mail servers

Posted by Matt <mh...@gmail.com>.
Ahh ha! Got it.. it seems to be domains that either the name servers
are not responding.. or the domain doesn't exist yet.. for instance:

debug: DNS MX records found: 0

Is there anyway to get around this?  It seems to hang and do this
twice for long enough to delay the system... any thoughts?

Re: Odd hanging on mail servers

Posted by Matt <mh...@gmail.com>.
Seems to chug on through it...... doesn't hesitate at all.. yet if I
turn spamassassin scanning on.. the mail server starts lagging so bad
it's not even funny..


On Fri, 14 Jan 2005 21:35:50 -0600, Keith Whyte
<ke...@media-solutions.ie> wrote:
> Hi Matt, maybe you could try running some mail manually through
> spamassassin, or spamc - to see what's causing delay.
> I've never used spamc/spamd, so I'm not sure what to do there, but
> save a message as /tmp/mailmsg and
> cat /tmp/mailmsg | spamassassin -t -D should allow you to see the
> spamassassin process and maybe see if it's getting hung up on a network
> test or something.
> 
> Keith.
> 
> Matt wrote:
> 
> >All of a sudden my qmail queue will go up to 100/100 and mail
> >throughput will become sluggish.   I thought it might have been a
> >
> >
> 
>

Re: Odd hanging on mail servers

Posted by Keith Whyte <ke...@media-solutions.ie>.
Hi Matt, maybe you could try running some mail manually through 
spamassassin, or spamc - to see what's causing delay.
I've never used spamc/spamd, so I'm not sure what to do there, but
save a message as /tmp/mailmsg and
cat /tmp/mailmsg | spamassassin -t -D should allow you to see the 
spamassassin process and maybe see if it's getting hung up on a network 
test or something.

Keith.

Matt wrote:

>All of a sudden my qmail queue will go up to 100/100 and mail
>throughput will become sluggish.   I thought it might have been a
>  
>