[jira] [Commented] (SPARK-35178) maven autodownload failing

["Sean R. Owen (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326770#comment-17326770 ] 

Sean R. Owen commented on SPARK-35178:
--------------------------------------

I agree, it looks like the automatic redirector has changed behavior. It still sends you to an HTML page for the mirror, but previously that link would cause it to redirect straight to the download.While the script can fallback to archive.apache.org, it doesn't because the HTML downloads successfully -- just is not the distribution!Either we detect this or have to hack this more to get the mirror URL from the redirector, then attach it to the path.

> maven autodownload failing
> --------------------------
>
>                 Key: SPARK-35178
>                 URL: https://issues.apache.org/jira/browse/SPARK-35178
>             Project: Spark
>          Issue Type: Bug
>          Components: Build
>    Affects Versions: 3.2.0
>            Reporter: Bruce Robbins
>            Priority: Major
>
> I attempted to build a fresh clone of Spark using mvn (on two different networks) and got this error:
> {noformat}
> exec: curl --silent --show-error -L https://www.apache.org/dyn/closer.lua?action=download&filename=/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz
> tar: Unrecognized archive format
> tar: Error exit delayed from previous errors.
> Using `mvn` from path: /tmp/testmvn/spark-mvn-download/build/apache-maven-3.6.3/bin/mvn
> build/mvn: line 126: /tmp/testmvn/spark-mvn-download/build/apache-maven-3.6.3/bin/mvn: No such file or directory
> {noformat}
> if I change the mirror as below, the issue goes away:
> {noformat}
> -    local APACHE_MIRROR=${APACHE_MIRROR:-'https://www.apache.org/dyn/closer.lua?action=download&filename='}
> +    local APACHE_MIRROR=${APACHE_MIRROR:-'https://https://downloads.apache.org'}
> {noformat}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org