spark.jars option for Zeppelin over Livy

[Chen Song <ch...@gmail.com>]

When using Zeppelin over Livy, how would I set the *spark.jars* option?

I try to set it in my spark-defaults.conf and Livy doesn't respect it at
all. Other properties in spark-default.conf seem to be picked up propertly.

Chen

Re: spark.jars option for Zeppelin over Livy

[Chen Song <ch...@gmail.com>]

I tried setting livy.spark.jars and it works but only with HDFS. I cannot
get it configured to pull jars from local.

On Tue, Aug 2, 2016 at 6:15 PM Felix Cheung <fe...@hotmail.com>
wrote:

> Probably livy.spark.jars then as Spark Packages is a different list?
>
>
> http://spark.apache.org/docs/latest/submitting-applications.html#advanced-dependency-management
>
>
> _____________________________
> From: Vinay Shukla <vi...@gmail.com>
> Sent: Tuesday, August 2, 2016 1:51 PM
> Subject: Re: spark.jars option for Zeppelin over Livy
> To: <us...@zeppelin.apache.org>
>
>
>
> In recent Zeppelin builds with Livy interpreter you can set spark-packages
> (e.g Databricks csv)
>
> as value of property "livy.spark.jars.packages" on Livy interpreter
> properties.
>
> Please see the attached screenshot
>
> On Tue, Aug 2, 2016 at 1:43 PM, Felix Cheung <fe...@hotmail.com>
> wrote:
>
>> Have you tried setting it in the Interpreter menu under Livy?
>>
>>
>>
>>
>>
>> On Tue, Aug 2, 2016 at 11:04 AM -0700, "Chen Song" <
>> chen.song.82@gmail.com> wrote:
>>
>> When using Zeppelin over Livy, how would I set the *spark.jars* option?
>>
>> I try to set it in my spark-defaults.conf and Livy doesn't respect it at
>> all. Other properties in spark-default.conf seem to be picked up propertly.
>>
>> Chen
>>
>
>
>
>

Re: spark.jars option for Zeppelin over Livy

[Felix Cheung <fe...@hotmail.com>]

Probably livy.spark.jars then as Spark Packages is a different list?

http://spark.apache.org/docs/latest/submitting-applications.html#advanced-dependency-management


_____________________________
From: Vinay Shukla <vi...@gmail.com>>
Sent: Tuesday, August 2, 2016 1:51 PM
Subject: Re: spark.jars option for Zeppelin over Livy
To: <us...@zeppelin.apache.org>>


In recent Zeppelin builds with Livy interpreter you can set spark-packages (e.g Databricks csv)

as value of property "livy.spark.jars.packages" on Livy interpreter properties.

Please see the attached screenshot

On Tue, Aug 2, 2016 at 1:43 PM, Felix Cheung <fe...@hotmail.com>> wrote:
Have you tried setting it in the Interpreter menu under Livy?





On Tue, Aug 2, 2016 at 11:04 AM -0700, "Chen Song" <ch...@gmail.com>> wrote:

When using Zeppelin over Livy, how would I set the spark.jars option?

I try to set it in my spark-defaults.conf and Livy doesn't respect it at all. Other properties in spark-default.conf seem to be picked up propertly.

Chen

Re: spark.jars option for Zeppelin over Livy

[Vinay Shukla <vi...@gmail.com>]

In recent Zeppelin builds with Livy interpreter you can set spark-packages
(e.g Databricks csv)

as value of property "livy.spark.jars.packages" on Livy interpreter
properties.

Please see the attached screenshot

On Tue, Aug 2, 2016 at 1:43 PM, Felix Cheung <fe...@hotmail.com>
wrote:

> Have you tried setting it in the Interpreter menu under Livy?
>
>
>
>
>
> On Tue, Aug 2, 2016 at 11:04 AM -0700, "Chen Song" <chen.song.82@gmail.com
> > wrote:
>
> When using Zeppelin over Livy, how would I set the *spark.jars* option?
>
> I try to set it in my spark-defaults.conf and Livy doesn't respect it at
> all. Other properties in spark-default.conf seem to be picked up propertly.
>
> Chen
>

Re: spark.jars option for Zeppelin over Livy

[Felix Cheung <fe...@hotmail.com>]

Have you tried setting it in the Interpreter menu under Livy?





On Tue, Aug 2, 2016 at 11:04 AM -0700, "Chen Song" <ch...@gmail.com>> wrote:

When using Zeppelin over Livy, how would I set the spark.jars option?

I try to set it in my spark-defaults.conf and Livy doesn't respect it at all. Other properties in spark-default.conf seem to be picked up propertly.

Chen