You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by L A Walsh <sa...@tlinx.org> on 2020/10/17 21:55:54 UTC

no rules found: failures in accessing all online sources

Update available for channel updates.spamassassin.org: -1 -> 895075
http: (curl) GET http://sa-update.verein-clean.net/895075.tar.gz, 
FAILED, status: 1792
http: (curl) GET http://sa-update.spamassassin.org/895075.tar.gz, 
FAILED, status: 1792
http: (curl) GET http://www.sa-update.pccc.com/895075.tar.gz, FAILED, 
status: 1792
http: (curl) GET http://sa-update.ena.com/895075.tar.gz, FAILED, status: 
1792
http: (curl) GET http://sa-update.razx.cloud/895075.tar.gz, FAILED, 
status: 1792
http: (curl) GET http://sa-update.fossies.org/895075.tar.gz, FAILED, 
status: 1792
http: (curl) GET http://sa-update.dnswl.org/895075.tar.gz, FAILED, 
status: 1792
http: (curl) GET http://sa-update.space-pro.be/895075.tar.gz, FAILED, 
status: 1792
channel: could not find working mirror, channel failed
 at /usr/bin/sa-update line 1213.
        main::channel_failed("channel: could not find working mirror") 
called at /usr/bin/sa-update line 771
Update failed, exiting with code 4
------

I tried the 1st with my browser, and it finds the file.

So why would curl fail to download them?

I mean, they ARE there...so ???


Thanks!


Re: no rules found: failures in accessing all online sources

Posted by "Kevin A. McGrail" <km...@apache.org>.
What does running curl on the same box for
http://www.sa-update.pccc.com/895075.tar.gz get you?

On Sat, Oct 17, 2020, 17:56 L A Walsh <sa...@tlinx.org> wrote:

> Update available for channel updates.spamassassin.org: -1 -> 895075
> http: (curl) GET http://sa-update.verein-clean.net/895075.tar.gz,
> FAILED, status: 1792
> http: (curl) GET http://sa-update.spamassassin.org/895075.tar.gz,
> FAILED, status: 1792
> http: (curl) GET , FAILED,
> status: 1792
> http: (curl) GET http://sa-update.ena.com/895075.tar.gz, FAILED, status:
> 1792
> http: (curl) GET http://sa-update.razx.cloud/895075.tar.gz, FAILED,
> status: 1792
> http: (curl) GET http://sa-update.fossies.org/895075.tar.gz, FAILED,
> status: 1792
> http: (curl) GET http://sa-update.dnswl.org/895075.tar.gz, FAILED,
> status: 1792
> http: (curl) GET http://sa-update.space-pro.be/895075.tar.gz, FAILED,
> status: 1792
> channel: could not find working mirror, channel failed
>  at /usr/bin/sa-update line 1213.
>         main::channel_failed("channel: could not find working mirror")
> called at /usr/bin/sa-update line 771
> Update failed, exiting with code 4
> ------
>
> I tried the 1st with my browser, and it finds the file.
>
> So why would curl fail to download them?
>
> I mean, they ARE there...so ???
>
>
> Thanks!
>
>

Re: curl, MIRRORED.BY, and paths.

Posted by "Kevin A. McGrail" <km...@apache.org>.
Here are my notes for disabling it if it helps.  You might also be able to
uninstall something like perl-local-lib too.


DONE - #DISABLE Local::Lib to stop installations of perl modules from ONLY
working for one user.  We want them on the whole box
  unset PERL5LIB PERL_MB_OPT PERL_LOCAL_LIB_ROOT PERL_MM_OPT ## set at
login by default
  rm -r ~/perl5  ## Created at login if it doesn't exist
  echo PERL_HOMEDIR=0 > ~/.perl-homedir ## To prevent the next login from
imposing it

Hth, KAM

On Sun, Oct 25, 2020, 19:03 L A Walsh <sa...@tlinx.org> wrote:

> On 2020/10/25 13:00, Bill Cole wrote:
> > A common source of such problems is widespread adoption of the
> > local::lib module which creates a per-user Perl library tree for each
> > user of CPAN, even root. If that's not disabled, it can result in
> > independent module trees with different versions of the same modules,
> > one of which is used by the system (e.g. by cron) and the others by
> > individual users in interactive sessions.
> >
> ---
>     Thanks for the heads up.  I see evidence of it having been a
> probably cause
> of problems in the past, but as part of debugging this problem, I had
> reinstall
> CPAN and reran its config script.  It asked me about the local-storage
> and I
> disabled it.  However, the local-lib (~/.local/Share) had been in use
> before
> that -- I have a feeling that some distro package migrated prefs from
> the original
> to the local (grrr..).
>
>     That said, it was due to something similar that I need to figure out
> a solution for. I've fixed it for now, but it's a timebomb waiting to
> happen
> again. -- separating it out since it seems "surprising" -- i.e. not what
> one might expect... (split installation)....
>

Re: curl, MIRRORED.BY, and paths.

Posted by L A Walsh <sa...@tlinx.org>.
On 2020/10/25 13:00, Bill Cole wrote:
> A common source of such problems is widespread adoption of the
> local::lib module which creates a per-user Perl library tree for each 
> user of CPAN, even root. If that's not disabled, it can result in 
> independent module trees with different versions of the same modules, 
> one of which is used by the system (e.g. by cron) and the others by 
> individual users in interactive sessions.
>   
---
    Thanks for the heads up.  I see evidence of it having been a 
probably cause
of problems in the past, but as part of debugging this problem, I had 
reinstall
CPAN and reran its config script.  It asked me about the local-storage 
and I
disabled it.  However, the local-lib (~/.local/Share) had been in use before
that -- I have a feeling that some distro package migrated prefs from 
the original
to the local (grrr..).

    That said, it was due to something similar that I need to figure out
a solution for. I've fixed it for now, but it's a timebomb waiting to happen
again. -- separating it out since it seems "surprising" -- i.e. not what
one might expect... (split installation)....

Re: curl get fails; MIRRORED.BY claimed empty. But neither is really true

Posted by Bill Cole <sa...@billmail.scconsult.com>.
On 25 Oct 2020, at 12:06, RW wrote:

> On Sat, 24 Oct 2020 21:12:39 -0700
> L A Walsh wrote:
>
>> On 2020/10/18 09:22, L A Walsh wrote:
>>> On 2020/10/17 15:58, RW wrote:
>>>
>>>> Probably a networking problem at the time sa-update ran.
>>>> status: 1792 decodes to a curl error code of 7 "Failed to connect
>>>> to host".
>>>> I suspect it's a bug that 1792 wasn't decoded.
>> ----
>> Reinstalled from CPAN...
>
> It not something I know much about, but some people on the list have
> advised against installing from CPAN. These installs do seem to create 
> a
> disproportionate amount of problems compared with package installs.

A common source of such problems is widespread adoption of the 
local::lib module which creates a per-user Perl library tree for each 
user of CPAN, even root. If that's not disabled, it can result in 
independent module trees with different versions of the same modules, 
one of which is used by the system (e.g. by cron) and the others by 
individual users in interactive sessions.


--
Bill Cole
bill@scconsult.com or billcole@apache.org
(AKA @grumpybozo and many *@billmail.scconsult.com addresses)
Not Currently Available For Hire

Re: curl get fails; MIRRORED.BY claimed empty. But neither is really true

Posted by RW <rw...@googlemail.com>.
On Sat, 24 Oct 2020 21:12:39 -0700
L A Walsh wrote:

> On 2020/10/18 09:22, L A Walsh wrote:
> > On 2020/10/17 15:58, RW wrote:
> >     
> >> Probably a networking problem at the time sa-update ran.
> >> status: 1792 decodes to a curl error code of 7 "Failed to connect
> >> to host".
> >> I suspect it's a bug that 1792 wasn't decoded.  
> ----
> Reinstalled from CPAN...

It not something I know much about, but some people on the list have
advised against installing from CPAN. These installs do seem to create a
disproportionate amount of problems compared with package installs.

Re: curl get fails; MIRRORED.BY claimed empty. But neither is really true

Posted by "Linda A. Walsh" <sa...@tlinx.org>.

On 2020/10/25 07:58, Kevin A. McGrail wrote:
> This sounds like a path issue and you have two versions of SA 
> installed.  
----
	Yeah, sorta.

> One perhaps from a package manager like yum or apt and 
> another from cpan.
----
	Both by me, but I didn't know the "sa-<binaries>" ignored
where they were installed/invoked from.


>  Your root installation likely has a different path, 
> hence the discrepancy.  
---
	Oddly enough, not -- mostly to prevent probs like this.


> And sa-update rights to /var/lib/spamassassdin 
> by default so likely a non-privileged user can't overwrite the 
> MIRRORED.BY <http://MIRRORED.BY> file.
---

	My normal login has the correct access rights.  It's in
the spamd group.


> Hope this helps.
---

	Indeed!  Before I could tell you there was no possibility of that, 
I had to check & used locate to find all copies of 'sa-update' and weeded out
the backups. Then found the prob -- sorta...In order not to hve
to duplicate explain, will put that in a different note.

Thanks again!

Re: curl get fails; MIRRORED.BY claimed empty. But neither is really true

Posted by "Kevin A. McGrail" <km...@apache.org>.
This sounds like a path issue and you have two versions of SA installed.
One perhaps from a package manager like yum or apt and another from cpan.
Your root installation likely has a different path, hence the discrepancy.
And sa-update rights to /var/lib/spamassassdin by default so likely a
non-privileged user can't overwrite the MIRRORED.BY file.

Hope this helps.

Regards,
KAM
--
Kevin A. McGrail
Member, Apache Software Foundation
Chair Emeritus Apache SpamAssassin Project
https://www.linkedin.com/in/kmcgrail - 703.798.0171


On Sun, Oct 25, 2020 at 12:13 AM L A Walsh <sa...@tlinx.org> wrote:

> On 2020/10/18 09:22, L A Walsh wrote:
> > On 2020/10/17 15:58, RW wrote:
> >
> >> Probably a networking problem at the time sa-update ran.
> >> status: 1792 decodes to a curl error code of 7 "Failed to connect to
> >> host".
> >> I suspect it's a bug that 1792 wasn't decoded.
> ----
> Reinstalled from CPAN...getting same  _verbiage_  but isn't true.
>
>
> dbg info (slightly trimmed) vs. "reality":
> 3:06:28 [77] dbg: channel: protocol family available: inet; force inet
> 3:06:28 [77] dbg: channel: --refreshmirrors used, forcing mirrors file
> refresh on channel updates.spamassassin.org
> 3:06:28 [77] dbg: channel: DNS lookup on mirrors.updates.spamassassin.org
> 3:06:29 [77] dbg: http: url:
> http://spamassassin.apache.org/updates/MIRRORED.BY
> 3:06:29 [77] dbg: http: downloading to:
> /var/lib/spamassassin/3.004004/updates_spamassassin_org/MIRRORED.BY,
> replace
> 3:06:29 [77] dbg: util: executable for curl was found at /usr/bin/curl
> 3:06:29 [77] dbg: http: /usr/bin/curl -s -L -O --remote-time -g
> --max-redirs 2 --connect-timeout 30 --max-time 300 --fail -o MIRRORED.BY
> -4 -- http://spamassassin.apache.org/updates/MIRRORED.BY
> 3:06:29 [77] dbg: channel: no mirror data available for channel
> updates.spamassassin.org from
> http://spamassassin.apache.org/updates/MIRRORED.BY
> error: unable to refresh mirrors file for channel
> updates.spamassassin.org, using old file
>
> error: no mirror data available for channel updates.spamassassin.org
> channel: MIRRORED.BY file contents were missing, channel failed
>
> ------
> Looking in the download dir:
> /var/lib/spamassassin/3.004004/updates_spamassassin_org, I see MIRRORED.BY
> with 1401 bytes in it (not empty).
>
> There i tried d/l w/wget -- worked fine -- actually said file on server was
> not newer than local copy, so it didn't d/l it (FWIW, I'm not going
> through a
> proxy).
>
> Then I tried curl.  It worked as well (exit status of 0).  Just to ensure
> it
> really was downloading the file, I tried same command but in a tmp dir and
> it downloaded the same file (1401 bytes), status=0.
>
> *cough*...just tried it again now rerunning sa-update as root
> curl is working but am getting a version mismatch:
>
> ===================
> Oct 24 20:54:45.081 [97694] dbg: plugin: did not register
> Mail::SpamAssassin::Plugin::VBounce, already registered
> Oct 24 20:54:45.082 [97694] dbg: plugin: did not register
> Mail::SpamAssassin::Plugin::ImageInfo, already registered
> Oct 24 20:54:45.082 [97694] dbg: plugin: did not register
> Mail::SpamAssassin::Plugin::Rule2XSBody, already registered
> Oct 24 20:54:45.082 [97694] dbg: plugin: loading
> Mail::SpamAssassin::Plugin::AskDNS from @INC
> config: configuration file
> "/tmp/.spamassassin97694UzqVBBtmp/20_advance_fee.cf" requires version
> 3.004000 of SpamAssassin, but this is code version 3.004004. Maybe you
> need to use the -C switch, or remove the old config files? Skipping this
> file at /usr/lib/perl5/site_perl/5.16/Mail/SpamAssassin/Conf/Parser.pm
> line 408.
> config: configuration file
> "/tmp/.spamassassin97694UzqVBBtmp/20_advance_fee.cf" requires version
> 3.004000 of SpamAssassin, but this is code version 3.004004. Maybe you
> need to use the -C switch, or remove the old config files? Skipping this
> file
> Oct 24 20:54:45.097 [97694] dbg: config: cleared tld lists
> -----------------
>
> The current version on CPAN seems to be 3.4.4 -- where in my config
> would it be saying to use the 3.4.0 ruleset?
>
>
> Thanks again *sigh*....
>
>
>
>
>
>
>
>
>

curl get fails; MIRRORED.BY claimed empty. But neither is really true

Posted by L A Walsh <sa...@tlinx.org>.
On 2020/10/18 09:22, L A Walsh wrote:
> On 2020/10/17 15:58, RW wrote:
>   
>> Probably a networking problem at the time sa-update ran.
>> status: 1792 decodes to a curl error code of 7 "Failed to connect to
>> host".
>> I suspect it's a bug that 1792 wasn't decoded.
----
Reinstalled from CPAN...getting same  _verbiage_  but isn't true.

 
dbg info (slightly trimmed) vs. "reality":
3:06:28 [77] dbg: channel: protocol family available: inet; force inet
3:06:28 [77] dbg: channel: --refreshmirrors used, forcing mirrors file 
refresh on channel updates.spamassassin.org
3:06:28 [77] dbg: channel: DNS lookup on mirrors.updates.spamassassin.org
3:06:29 [77] dbg: http: url: 
http://spamassassin.apache.org/updates/MIRRORED.BY
3:06:29 [77] dbg: http: downloading to: 
/var/lib/spamassassin/3.004004/updates_spamassassin_org/MIRRORED.BY, replace
3:06:29 [77] dbg: util: executable for curl was found at /usr/bin/curl
3:06:29 [77] dbg: http: /usr/bin/curl -s -L -O --remote-time -g 
--max-redirs 2 --connect-timeout 30 --max-time 300 --fail -o MIRRORED.BY 
-4 -- http://spamassassin.apache.org/updates/MIRRORED.BY
3:06:29 [77] dbg: channel: no mirror data available for channel 
updates.spamassassin.org from 
http://spamassassin.apache.org/updates/MIRRORED.BY
error: unable to refresh mirrors file for channel 
updates.spamassassin.org, using old file

error: no mirror data available for channel updates.spamassassin.org
channel: MIRRORED.BY file contents were missing, channel failed

------
Looking in the download dir:
/var/lib/spamassassin/3.004004/updates_spamassassin_org, I see MIRRORED.BY
with 1401 bytes in it (not empty).

There i tried d/l w/wget -- worked fine -- actually said file on server was
not newer than local copy, so it didn't d/l it (FWIW, I'm not going 
through a
proxy).

Then I tried curl.  It worked as well (exit status of 0).  Just to ensure it
really was downloading the file, I tried same command but in a tmp dir and
it downloaded the same file (1401 bytes), status=0.

*cough*...just tried it again now rerunning sa-update as root
curl is working but am getting a version mismatch:

===================
Oct 24 20:54:45.081 [97694] dbg: plugin: did not register 
Mail::SpamAssassin::Plugin::VBounce, already registered
Oct 24 20:54:45.082 [97694] dbg: plugin: did not register 
Mail::SpamAssassin::Plugin::ImageInfo, already registered
Oct 24 20:54:45.082 [97694] dbg: plugin: did not register 
Mail::SpamAssassin::Plugin::Rule2XSBody, already registered
Oct 24 20:54:45.082 [97694] dbg: plugin: loading 
Mail::SpamAssassin::Plugin::AskDNS from @INC
config: configuration file 
"/tmp/.spamassassin97694UzqVBBtmp/20_advance_fee.cf" requires version 
3.004000 of SpamAssassin, but this is code version 3.004004. Maybe you 
need to use the -C switch, or remove the old config files? Skipping this 
file at /usr/lib/perl5/site_perl/5.16/Mail/SpamAssassin/Conf/Parser.pm 
line 408.
config: configuration file 
"/tmp/.spamassassin97694UzqVBBtmp/20_advance_fee.cf" requires version 
3.004000 of SpamAssassin, but this is code version 3.004004. Maybe you 
need to use the -C switch, or remove the old config files? Skipping this 
file
Oct 24 20:54:45.097 [97694] dbg: config: cleared tld lists
-----------------

The current version on CPAN seems to be 3.4.4 -- where in my config
would it be saying to use the 3.4.0 ruleset?


Thanks again *sigh*....









(curl proxy misconfig)...re: no rules found: failures in accessing all online sources

Posted by L A Walsh <sa...@tlinx.org>.
On 2020/10/17 15:58, RW wrote:
> Probably a networking problem at the time sa-update ran.
> status: 1792 decodes to a curl error code of 7 "Failed to connect to
> host".
>
> I suspect it's a bug that 1792 wasn't decoded.
>   
----
Dug down a bit...seems it has something to do with curl expecting
a proxy when I'm temporarily routing around it in other S/W.

Even though my .curlrc says no proxy, some config, somewhere
is picking it back up and trying to use it.  Thought a re-install
might help, via CPAN, but cpan uses curl as well, so still
digging, & sorry for the noise on this list.



Re: no rules found: failures in accessing all online sources

Posted by RW <rw...@googlemail.com>.
On Sat, 17 Oct 2020 14:55:54 -0700
L A Walsh wrote:

> Update available for channel updates.spamassassin.org: -1 -> 895075
> http: (curl) GET http://sa-update.verein-clean.net/895075.tar.gz, 
> FAILED, status: 1792
> http: (curl) GET http://sa-update.spamassassin.org/895075.tar.gz, 
> FAILED, status: 1792
> http: (curl) GET http://www.sa-update.pccc.com/895075.tar.gz, FAILED, 
> status: 1792
> http: (curl) GET http://sa-update.ena.com/895075.tar.gz, FAILED,
> status: 1792
> http: (curl) GET http://sa-update.razx.cloud/895075.tar.gz, FAILED, 
> status: 1792
> http: (curl) GET http://sa-update.fossies.org/895075.tar.gz, FAILED, 
> status: 1792
> http: (curl) GET http://sa-update.dnswl.org/895075.tar.gz, FAILED, 
> status: 1792
> http: (curl) GET http://sa-update.space-pro.be/895075.tar.gz, FAILED, 
> status: 1792
> channel: could not find working mirror, channel failed
>  at /usr/bin/sa-update line 1213.
>         main::channel_failed("channel: could not find working
> mirror") called at /usr/bin/sa-update line 771
> Update failed, exiting with code 4
> ------ 
> I tried the 1st with my browser, and it finds the file.

Probably a networking problem at the time sa-update ran. 

status: 1792 decodes to a curl error code of 7 "Failed to connect to
host".

I suspect it's a bug that 1792 wasn't decoded.