How to install a Spark Package?

[jeff saremi <je...@hotmail.com>]

So that it is available even in offline mode? I can't seem to be able to find any notes on thatthanksjeff 		 	   		  

RE: How to install a Spark Package?

[jeff saremi <je...@hotmail.com>]

yes those.Here's for example Avro's:
spark-shell --packages com.databricks:spark-avro_2.10:2.0.1The way i read this is that this line would instruct Spark to go and get the package.
But does that mean installation? Is this permament? do I need to specify it one? or each time? Will this be downloaded each time?
What if the environment that i'm running my Spark in does no allow such connection?
If i have downloaded these packages ist there a way to install them permanently?

Subject: Re: How to install a Spark Package?
From: yuzhihong@gmail.com
Date: Sun, 4 Oct 2015 21:05:44 -0700
CC: user@spark.apache.org
To: jeffsaremi@hotmail.com

Are you talking about package which is listed onhttp://spark-packages.org
The package should come with installation instructions, right ?
On Oct 4, 2015, at 8:55 PM, jeff saremi <je...@hotmail.com> wrote:




So that it is available even in offline mode? I can't seem to be able to find any notes on thatthanksjeff 		 	   		  
 		 	   		  

Re: How to install a Spark Package?

[Ted Yu <yu...@gmail.com>]

Are you talking about package which is listed on
http://spark-packages.org

The package should come with installation instructions, right ?

> On Oct 4, 2015, at 8:55 PM, jeff saremi <je...@hotmail.com> wrote:
> 
> So that it is available even in offline mode? I can't seem to be able to find any notes on that
> thanks
> jeff