You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by bu...@bugzilla.spamassassin.org on 2007/11/08 00:57:12 UTC
[Bug 5715] New: eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
Summary: eliminate sa-update single point of failure (single uri
for MIRRORED.BY file)
Product: Spamassassin
Version: SVN Trunk (Latest Devel Version)
Platform: Other
OS/Version: other
Status: NEW
Severity: normal
Priority: P5
Component: sa-update
AssignedTo: dev@spamassassin.apache.org
ReportedBy: spamassassin@dostech.ca
I'd like to eliminate the only single point of failure in sa-update... only
supporting one uri in the "mirrors" TXT record. If that single host goes down,
new clients cannot retrieve the MIRRORED.BY file.
For instance, last night "the" ASF web server was down for 4 hours and downloads
for the updates.spamassassin.org channel went from several hundred/hr to 0/hr
(on my mirror) instantly.
There's room in the text record for a second URI to the MIRRORED.BY file and
using/supporting it is backwards compatible with currently released versions of
sa-update. I'd say we should do it.
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
------- Additional Comments From spamassassin@dostech.ca 2007-11-07 15:58 -------
Created an attachment (id=4184)
--> (http://issues.apache.org/SpamAssassin/attachment.cgi?id=4184&action=view)
patch
Shout if you object!
I'd like to commit this to 3.2 too.
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
spamassassin@dostech.ca changed:
What |Removed |Added
----------------------------------------------------------------------------
Target Milestone|3.3.0 |3.2.4
------- Additional Comments From spamassassin@dostech.ca 2007-12-26 00:20 -------
I'd like to fix this for 3.2.4, but with a different patch. Will provide ASAP.
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] [review] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
spamassassin@dostech.ca changed:
What |Removed |Added
----------------------------------------------------------------------------
Summary|eliminate sa-update single |[review] eliminate sa-update
|point of failure (single uri|single point of failure
|for MIRRORED.BY file) |(single uri for MIRRORED.BY
| |file)
Status Whiteboard| |needs 2 votes for 3.2
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
spamassassin@dostech.ca changed:
What |Removed |Added
----------------------------------------------------------------------------
Attachment #4184 is|0 |1
obsolete| |
------- Additional Comments From spamassassin@dostech.ca 2007-12-27 17:56 -------
Created an attachment (id=4217)
--> (http://issues.apache.org/SpamAssassin/attachment.cgi?id=4217&action=view)
way better patch
This allows sa-update to try more than a single host to get the MIRRORED.BY
file, eliminating sa-update's only single point of failure.
Publishing more than a single MIRRORED.BY file location in DNS is backwards
compatible with previous versions of sa-update (which will attempt to use just
one of the published locations).
Please review for inclusion in 3.2.4.
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] [review] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
jm@jmason.org changed:
What |Removed |Added
----------------------------------------------------------------------------
Status Whiteboard|needs 2 votes for 3.2 |needs 1 votes for 3.2
------- Additional Comments From jm@jmason.org 2007-12-28 04:07 -------
+1
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
------- Additional Comments From spamassassin@dostech.ca 2007-12-27 17:49 -------
[dos@cyan trunk]$ svn ci -m "bug 5715: allow for more than one sa-update
MIRRORED.BY file host in DNS for redundancy"
Sending sa-update.raw
Transmitting file data .
Committed revision 607156.
[dos@cyan trunk]$
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] [review] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
sidney@sidney.com changed:
What |Removed |Added
----------------------------------------------------------------------------
Status Whiteboard|needs 1 votes for 3.2 |ready for commit
------- Additional Comments From sidney@sidney.com 2007-12-29 03:14 -------
+1
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
------- Additional Comments From spamassassin@dostech.ca 2007-11-07 17:51 -------
(In reply to comment #2)
> I would split on multiple whitespace instead of a single space.
That's fine with me, although I don't think changing the delimiter will make any
difference. HTTP::Request->url($url) doesn't support URLs with spaces in them
(which is why adding a second URL to DNS would be backwards compatible).
I was just going to publish two separate TXT records and rely on the current
single space concat that we do, but I suppose we could just use one record with
whatever delimiter.
I'd rather use the two TXT records though, we get free load
balancing/randomizing that way.
> I also think that we should just use the MIRRORED.BY that we already have if a
> new one can't be downloaded.
We do but only if the channel has been used before (of course). People who have
never used sa-update before (or are adding a new channel or upgrading SA) are
SOL if they can't get the MIRRORED.BY file. Looking at my logs, at least a few
thousand hosts had no MIRRORED.BY file available during the 4 hour period last
night and I've had issues severing it for my channels in the past too (when one
of my providers ACLs my port when it hits 20 mbps claiming my host is virus
infected) where having a second host serving the MIRRORED.BY file would have
prevented a channel outage.
I really want to avoid the scenario of us pushing a major release and then
having the ASF server going down and people figuring that sa-update just doesn't
work.
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] [review] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
jm@jmason.org changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |RESOLVED
Resolution| |FIXED
------- Additional Comments From jm@jmason.org 2007-12-30 13:04 -------
I applied the patch to 3.2.x; hope you don't mind, Daryl ;)
: jm 134...; svn commit -m "bug 5715: allow for more than one sa-update
MIRRORED.BY file host in DNS, for redundancy"
Sending sa-update.raw
Transmitting file data .
Committed revision 607589.
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
spamassassin@dostech.ca changed:
What |Removed |Added
----------------------------------------------------------------------------
Target Milestone|Undefined |3.3.0
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
[Bug 5715] eliminate sa-update single point of failure (single uri for MIRRORED.BY file)
Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5715
------- Additional Comments From felicity@apache.org 2007-11-07 17:32 -------
I would split on multiple whitespace instead of a single space.
I also think that we should just use the MIRRORED.BY that we already have if a
new one can't be downloaded.
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.