You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Ming Han Teh <te...@gmail.com> on 2015/08/03 23:38:35 UTC

Add jar file for spark interpreter use

Hi,

I am trying to add a jar file which contains a UDF to be used in the
zeppelin spark interpreter.

Is there a difference between the below two approaches:

*Approach 1)*

%dep
z.load("somefile")

*Approach 2)*

sc.addJar("somejar")



The first approach appears to load the jar file, but %sql fails to work
after that.
The second approach doesn't work for me.


Any tips would be appreciated.

Thanks,
Ming Han

Re: Add jar file for spark interpreter use

Posted by Alex <ab...@nflabs.com>.
Hi,

first approach supposed to work, right now there is an open issue to track the progress of fixing it https://issues.apache.org/jira/browse/ZEPPELIN-194



--
Kind regards,
Alexander

> On 04 Aug 2015, at 06:38, Ming Han Teh <te...@gmail.com> wrote:
> 
> Hi,
> 
> I am trying to add a jar file which contains a UDF to be used in the zeppelin spark interpreter.
> 
> Is there a difference between the below two approaches:
> 
> Approach 1)
> 
> %dep
> z.load("somefile")
> 
> Approach 2)
> 
> sc.addJar("somejar")
> 
> 
> 
> The first approach appears to load the jar file, but %sql fails to work after that.
> The second approach doesn't work for me.
> 
> 
> Any tips would be appreciated.
> 
> Thanks,
> Ming Han
> 
>

Re: Add jar file for spark interpreter use

Posted by Ming Han Teh <te...@gmail.com>.
I am using Spark in standalone mode. I am not using YARN. Thanks.

On Mon, Aug 3, 2015 at 2:43 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:

> How about setting spark.yarn.jar from Spark interpreter from UI
>
> spark.yarn.jar a.jar:b.jar:c.jar
>
> On Mon, Aug 3, 2015 at 2:38 PM, Ming Han Teh <te...@gmail.com> wrote:
>
>> Hi,
>>
>> I am trying to add a jar file which contains a UDF to be used in the
>> zeppelin spark interpreter.
>>
>> Is there a difference between the below two approaches:
>>
>> *Approach 1)*
>>
>> %dep
>> z.load("somefile")
>>
>> *Approach 2)*
>>
>> sc.addJar("somejar")
>>
>>
>>
>> The first approach appears to load the jar file, but %sql fails to work
>> after that.
>> The second approach doesn't work for me.
>>
>>
>> Any tips would be appreciated.
>>
>> Thanks,
>> Ming Han
>>
>>
>>
>
>
> --
> Deepak
>
>

Re: Add jar file for spark interpreter use

Posted by ๏̯͡๏ <ÐΞ€ρ@Ҝ>, de...@gmail.com.
How about setting spark.yarn.jar from Spark interpreter from UI

spark.yarn.jar a.jar:b.jar:c.jar

On Mon, Aug 3, 2015 at 2:38 PM, Ming Han Teh <te...@gmail.com> wrote:

> Hi,
>
> I am trying to add a jar file which contains a UDF to be used in the
> zeppelin spark interpreter.
>
> Is there a difference between the below two approaches:
>
> *Approach 1)*
>
> %dep
> z.load("somefile")
>
> *Approach 2)*
>
> sc.addJar("somejar")
>
>
>
> The first approach appears to load the jar file, but %sql fails to work
> after that.
> The second approach doesn't work for me.
>
>
> Any tips would be appreciated.
>
> Thanks,
> Ming Han
>
>
>


-- 
Deepak