You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by mj <jo...@gmail.com> on 2015/04/27 22:49:31 UTC

Change ivy cache for spark on Windows

Hi,

I'm having trouble using the --packages option for spark-shell.cmd - I have
to use Windows at work and have been issued a username with a space in it
that means when I use the --packages option it fails with this message:

"Exception in thread "main" java.net.URISyntaxException: Illegal character
in path at index 13: C:/Users/My Name/.ivy2/jars/spark-csv_2.10.jar"

The command I'm trying to run is:
.\spark-shell.cmd --packages com.databricks:spark-csv_2.10:1.0.3

I've tried creating an ivysettings.xml file with the content below in my
.ivy2 directory, but spark doesn't seem to pick it up. Does anyone have any
ideas of how to get around this issue?

<ivysettings>
    <caches defaultCacheDir="c:\ivy_cache"/>
</ivysettings>




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Change-ivy-cache-for-spark-on-Windows-tp22675.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Fwd: Change ivy cache for spark on Windows

Posted by Burak Yavuz <br...@gmail.com>.
+user

---------- Forwarded message ----------
From: Burak Yavuz <br...@gmail.com>
Date: Mon, Apr 27, 2015 at 1:59 PM
Subject: Re: Change ivy cache for spark on Windows
To: mj <jo...@gmail.com>


Hi,

In your conf file (SPARK_HOME\conf\spark-defaults.conf) you can set:

`spark.jars.ivy \your\path`


Best,
Burak

On Mon, Apr 27, 2015 at 1:49 PM, mj <jo...@gmail.com> wrote:

> Hi,
>
> I'm having trouble using the --packages option for spark-shell.cmd - I have
> to use Windows at work and have been issued a username with a space in it
> that means when I use the --packages option it fails with this message:
>
> "Exception in thread "main" java.net.URISyntaxException: Illegal character
> in path at index 13: C:/Users/My Name/.ivy2/jars/spark-csv_2.10.jar"
>
> The command I'm trying to run is:
> .\spark-shell.cmd --packages com.databricks:spark-csv_2.10:1.0.3
>
> I've tried creating an ivysettings.xml file with the content below in my
> .ivy2 directory, but spark doesn't seem to pick it up. Does anyone have any
> ideas of how to get around this issue?
>
> <ivysettings>
>     <caches defaultCacheDir="c:\ivy_cache"/>
> </ivysettings>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Change-ivy-cache-for-spark-on-Windows-tp22675.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>