[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

["Felix Cheung (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736161#comment-15736161 ] 

Felix Cheung commented on SPARK-18810:
--------------------------------------

I've found the same issue while testing as well, and was going to propose a change to support this.

Essentially for snapshot and RC build, since the jar is not on the Apache mirror, install.spark is unable to download it. We need to have a way to override the url (details: as it is constructing the url from a base url and a version path, it is expecting the source as a certain directory structure - currently this structure does not match how the snapshot and RC build are published, so we need a way to override the entire url)

I propose we have an environment variable instead of a parameter since we want to be able to run everything the same way without having to make code changes.


> SparkR install.spark does not work for RCs, snapshots
> -----------------------------------------------------
>
>                 Key: SPARK-18810
>                 URL: https://issues.apache.org/jira/browse/SPARK-18810
>             Project: Spark
>          Issue Type: Bug
>          Components: SparkR
>    Affects Versions: 2.0.2, 2.1.0
>            Reporter: Shivaram Venkataraman
>
> We publish source archives of the SparkR package now in RCs and in nightly snapshot builds. One of the problems that still remains is that `install.spark` does not work for these as it looks for the final Spark version to be present in the apache download mirrors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org