mvn auto-downloading on fresh clone

[Bruce Robbins <be...@gmail.com>]

Is it just me, or does the auto-download of maven on a fresh Spark clone no
longer work? It looks like
https://www.apache.org/dyn/closer.lua?action=download&filename= is not
functioning anymore (or for the moment) for any piece of Apache software.

I noted this in https://issues.apache.org/jira/browse/SPARK-35178.

I tried on two unrelated networks, so I don't think I am being rate limited.

When I changed the mirror in build/mvn to the direct download page (https://
https://downloads.apache.org), the build worked. I assume there is a good
reason build/mvn doesn't use that url (I suppose the current url chooses a
mirror, maybe?).

Re: mvn auto-downloading on fresh clone

[Sean Owen <sr...@gmail.com>]

I agree, it looks like the automatic redirector has changed behavior. It
still sends you to an HTML page for the mirror, but previously that link
would cause it to redirect straight to the download.
While the script can fallback to archive.apache.org, it doesn't because the
HTML downloads successfully -- just is not the distribution!
Either we detect this or have to hack this more to get the mirror URL from
the redirector, then attach it to the path.

On Wed, Apr 21, 2021 at 12:51 PM Bruce Robbins <be...@gmail.com>
wrote:

> Is it just me, or does the auto-download of maven on a fresh Spark clone
> no longer work? It looks like
> https://www.apache.org/dyn/closer.lua?action=download&filename= is not
> functioning anymore (or for the moment) for any piece of Apache software.
>
> I noted this in https://issues.apache.org/jira/browse/SPARK-35178.
>
> I tried on two unrelated networks, so I don't think I am being rate
> limited.
>
> When I changed the mirror in build/mvn to the direct download page
> (https://https://downloads.apache.org), the build worked. I assume there
> is a good reason build/mvn doesn't use that url (I suppose the current url
> chooses a mirror, maybe?).
>