You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by bu...@bugzilla.spamassassin.org on 2015/04/06 21:53:57 UTC

[Bug 7165] New: Automated the release of new TLDs through the TLD update added in 3.4.1

https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7165

            Bug ID: 7165
           Summary: Automated the release of new TLDs through the TLD
                    update added in 3.4.1
           Product: Spamassassin
           Version: SVN Trunk (Latest Devel Version)
          Hardware: PC
                OS: Windows 7
            Status: NEW
          Severity: normal
          Priority: P2
         Component: sa-update
          Assignee: dev@spamassassin.apache.org
          Reporter: kmcgrail@pccc.com

>From Bug 6782, right now, as of 3.4.1, the list of TLDs must be updated
manually and committed at which point sa-update will be run in a day or so to
get the new TLD live

The manual commands are documented in rules/20_aux_tldscf

There are two commands to run to update first the #1st level TLD list & then
the # Standard List 

This bug is to automate that process to see if

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7165] Automated the release of new TLDs through the TLD update added in 3.4.1

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7165

Henrik Krohns <ap...@hege.li> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |apache@hege.li

--- Comment #3 from Henrik Krohns <ap...@hege.li> ---
- Evaluate if https://publicsuffix.org/list/public_suffix_list.dat is useful

- Note that adding any 2tld will prevent querying the "tld" itself (Bug 6102) -
so we shouldn't just blindly add all sorts of vanity 2tlds? We need to atleast
know what kind of domain splitting our default URIBLs do.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7165] Automated the release of new TLDs through the TLD update added in 3.4.1

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7165

Henrik Krohns <ap...@hege.li> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |jdimeabuse@gmail.com

--- Comment #2 from Henrik Krohns <ap...@hege.li> ---
*** Bug 7582 has been marked as a duplicate of this bug. ***

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7165] Automated the release of new TLDs through the TLD update added in 3.4.1

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7165

Henrik Krohns <ap...@hege.li> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |berni@birkenwald.de

--- Comment #4 from Henrik Krohns <ap...@hege.li> ---
*** Bug 7761 has been marked as a duplicate of this bug. ***

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7165] Automated the release of new TLDs through the TLD update added in 3.4.1

Posted by bu...@bugzilla.spamassassin.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7165

AXB <ax...@gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 OS|Windows 7                   |All
           Hardware|PC                          |All

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7165] Automated the release of new TLDs through the TLD update added in 3.4.1

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7165

Henrik Krohns <ap...@hege.li> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |guenther@rudersport.de

--- Comment #1 from Henrik Krohns <ap...@hege.li> ---
*** Bug 6102 has been marked as a duplicate of this bug. ***

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7165] Automated the release of new TLDs through the TLD update added in 3.4.1

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7165

Dallas Engelken <da...@uribl.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |dallase@uribl.com

--- Comment #6 from Dallas Engelken <da...@uribl.com> ---
URIBL uses a custom RegistrarBoundaries.pm that includes domains that host
subdomains which may be prone to abuse.   The list of domains we add to
RegistarBoundaries.pm are available at http://rss.uribl.com/hosters/hosters.txt

Otherwise its got the basics.  We have a cron job that updates
http://data.iana.org/TLD/tlds-alpha-by-domain.txt which is read into
$VALID_TLDS
and the other sources that were always used for RegistrarBoundaries.pm for
$TWO_LEVEL_DOMAINS and $US_STATES

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7165] Automated the release of new TLDs through the TLD update added in 3.4.1

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7165

--- Comment #5 from Henrik Krohns <ap...@hege.li> ---
I sent email to URIBL if they can comment on how they split domains internally.

For spamhaus DBL, I believe they do wildcard listing, so even full hostnames
can be queried as is. In that case, it should be fine to use the widest
possible tld list (whole PSL including privates for example). But it really
depends on URIBL and perhaps SURBL what should be done.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7165] Automated the release of new TLDs through the TLD update added in 3.4.1

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7165

--- Comment #7 from Henrik Krohns <ap...@hege.li> ---
Dallas, have you considered supporting wildcarded / full host queries? As per
Bug 7835, trunk / SpamAssassin 4.0 has "notrim" flag which is already used with
DBL and SURBL.

-- 
You are receiving this mail because:
You are the assignee for the bug.