You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by "Dai, Kevin" <yu...@ebay.com> on 2015/04/27 12:55:37 UTC
Can't load jars and files
Hi, All
When I use the use spark-submit to launch the zeppelin. I found it couldn't load the jar and files specified by -jars and -files.
Can anyone tell me what's wrong with it?
Best Regards,
Kevin.
Re: Can't load jars and files
Posted by moon soo Lee <le...@gmail.com>.
Zeppelin has 'Interpreter' menu on GUI, you can configure spark's
configuration parameters.
Or you can set them in using ZEPPELIN_JAVA_OPTS. (eg.
ZEPPELIN_JAVA_OPTS="-Dspark.executor.memory=1g").
the value you can save in conf/zeppelin-env.sh
Best,
moon
On Tue, Apr 28, 2015 at 3:23 PM Dai, Kevin <yu...@ebay.com> wrote:
> Hi, Moon
>
>
>
> For your question, I can specify a lot parameters such as number of
> executors and so on by spark submit.
>
>
>
> How can I do this in zeppelin.sh?
>
>
>
> Best Regards,
>
> Kevin.
>
>
>
> *From:* moon soo Lee [mailto:moon@apache.org]
> *Sent:* Tuesday, April 28, 2015 7:17 AM
> *To:* users@zeppelin.incubator.apache.org
> *Subject:* Re: Can't load jars and files
>
>
>
> Hi Kevin,
>
>
>
> May i ask you why are you using spark-submit instead of zeppelin.sh or
> zeppelin-daemon.sh ? just curious.
>
>
>
> Zeppelin has %dep interpreter to load dependency library. see
> http://zeppelin.incubator.apache.org/docs/interpreter/spark.html#dependencyloading.
> sc.addFile will help adding a files.
>
>
>
> If dependency loader and addFile can not help you, could you create an
> issue for it?
>
>
>
> Thanks,
>
> moon
>
>
>
> On Mon, Apr 27, 2015 at 7:56 PM Dai, Kevin <yu...@ebay.com> wrote:
>
> Hi, All
>
>
>
> When I use the use spark-submit to launch the zeppelin. I found it
> couldn’t load the jar and files specified by –jars and –files.
>
>
>
> Can anyone tell me what’s wrong with it?
>
>
>
> Best Regards,
>
> Kevin.
>
RE: Can't load jars and files
Posted by "Dai, Kevin" <yu...@ebay.com>.
Hi, Moon
For your question, I can specify a lot parameters such as number of executors and so on by spark submit.
How can I do this in zeppelin.sh?
Best Regards,
Kevin.
From: moon soo Lee [mailto:moon@apache.org]
Sent: Tuesday, April 28, 2015 7:17 AM
To: users@zeppelin.incubator.apache.org
Subject: Re: Can't load jars and files
Hi Kevin,
May i ask you why are you using spark-submit instead of zeppelin.sh or zeppelin-daemon.sh ? just curious.
Zeppelin has %dep interpreter to load dependency library. see http://zeppelin.incubator.apache.org/docs/interpreter/spark.html#dependencyloading. sc.addFile will help adding a files.
If dependency loader and addFile can not help you, could you create an issue for it?
Thanks,
moon
On Mon, Apr 27, 2015 at 7:56 PM Dai, Kevin <yu...@ebay.com>> wrote:
Hi, All
When I use the use spark-submit to launch the zeppelin. I found it couldn’t load the jar and files specified by –jars and –files.
Can anyone tell me what’s wrong with it?
Best Regards,
Kevin.
Re: Can't load jars and files
Posted by moon soo Lee <mo...@apache.org>.
Hi Kevin,
May i ask you why are you using spark-submit instead of zeppelin.sh or
zeppelin-daemon.sh ? just curious.
Zeppelin has %dep interpreter to load dependency library. see
http://zeppelin.incubator.apache.org/docs/interpreter/spark.html#dependencyloading.
sc.addFile will help adding a files.
If dependency loader and addFile can not help you, could you create an
issue for it?
Thanks,
moon
On Mon, Apr 27, 2015 at 7:56 PM Dai, Kevin <yu...@ebay.com> wrote:
> Hi, All
>
>
>
> When I use the use spark-submit to launch the zeppelin. I found it
> couldn’t load the jar and files specified by –jars and –files.
>
>
>
> Can anyone tell me what’s wrong with it?
>
>
>
> Best Regards,
>
> Kevin.
>