You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Vishal John (JIRA)" <ji...@apache.org> on 2015/07/25 13:57:04 UTC
[jira] [Updated] (SPARK-9341) The curl command in
sbt-launch-lib.bash doesn't download sbt-launch jar
[ https://issues.apache.org/jira/browse/SPARK-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vishal John updated SPARK-9341:
-------------------------------
Description:
I try to build spark by using the command ./build/sbt
I get the following error -
Attempting to fetch sbt
Launching sbt from build/sbt-launch-0.13.7.jar
Error: Invalid or corrupt jarfile build/sbt-launch-0.13.7.jar
I debugged and found out that URL1 repo is outdated. So it's giving 404. The problem I found with the curl script is that it didn't tried the URL2
Also the ULR2 is now being redirected. So the curl command should have -L option to follow redirect.
Once I changed like this - (curl --silent -L ${URL2} > "${JAR_DL}, it worked for me.
To fix:
1. curl should try URL2 if URL1 is not working
2. use -L option in curl to follow rediect
was:
I try to build spark by using the command ./build/sbt
I get the following error -
Attempting to fetch sbt
Launching sbt from build/sbt-launch-0.13.7.jar
Error: Invalid or corrupt jarfile build/sbt-launch-0.13.7.jar
I debugged and found out that URL1 repo is outdated. So it's giving 404. The problem I found with the curl script is that it didn't tried the URL2
Also the ULR2 is now being redirected. So the curl command should have -L option to follow redirect.
Once I changed like this - (curl --silent -L ${URL2} > "${JAR_DL}" || curl --silent ${URL1} , it worked for me.
To fix:
1. curl should try URL2 if URL1 is not working
2. use -L option in curl to follow rediect
> The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar
> -----------------------------------------------------------------------
>
> Key: SPARK-9341
> URL: https://issues.apache.org/jira/browse/SPARK-9341
> Project: Spark
> Issue Type: Improvement
> Components: Build
> Affects Versions: 1.4.1
> Environment: Ubuntu 13.10
> Reporter: Vishal John
> Priority: Minor
>
> I try to build spark by using the command ./build/sbt
> I get the following error -
> Attempting to fetch sbt
> Launching sbt from build/sbt-launch-0.13.7.jar
> Error: Invalid or corrupt jarfile build/sbt-launch-0.13.7.jar
> I debugged and found out that URL1 repo is outdated. So it's giving 404. The problem I found with the curl script is that it didn't tried the URL2
> Also the ULR2 is now being redirected. So the curl command should have -L option to follow redirect.
> Once I changed like this - (curl --silent -L ${URL2} > "${JAR_DL}, it worked for me.
> To fix:
> 1. curl should try URL2 if URL1 is not working
> 2. use -L option in curl to follow rediect
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org