You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Ashwin Shankar <as...@gmail.com> on 2015/08/08 00:24:42 UTC
How to increase spark driver memory and ship jars on zeppelin ?
Hi,
When we run spark-shell on apache spark, we can increase driver memory by
passing
"--driver-memory" option. We can also ship jars to the cluster using
"--jars"
option.
How do we pass these spark options to zeppelin(yarn-client mode)?
--
Thanks,
Ashwin
Re: How to increase spark driver memory and ship jars on zeppelin ?
Posted by Ashwin Shankar <as...@gmail.com>.
Hi Anand , I dont see your reply, can you pls send it again ?
On Sun, Aug 9, 2015 at 6:56 PM, Anand Raghavan <An...@infosys.com>
wrote:
> R
>
> *From*: Ashwin Shankar [mailto:ashwinshankar77@gmail.com]
> *Sent*: Saturday, August 08, 2015 03:54 AM
> *To*: users@zeppelin.incubator.apache.org <
> users@zeppelin.incubator.apache.org>
> *Subject*: How to increase spark driver memory and ship jars on zeppelin
> ?
>
> Hi,
> When we run spark-shell on apache spark, we can increase driver memory by
> passing
> "--driver-memory" option. We can also ship jars to the cluster using
> "--jars"
> option.
> How do we pass these spark options to zeppelin(yarn-client mode)?
>
> --
> Thanks,
> Ashwin
>
>
> **************** CAUTION - Disclaimer *****************
> This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
> for the use of the addressee(s). If you are not the intended recipient, please
> notify the sender by e-mail and delete the original message. Further, you are not
> to copy, disclose, or distribute this e-mail or its contents to any other person and
> any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
> every reasonable precaution to minimize this risk, but is not liable for any damage
> you may sustain as a result of any virus in this e-mail. You should carry out your
> own virus checks before opening the e-mail or attachment. Infosys reserves the
> right to monitor and review the content of all messages sent to or from this e-mail
> address. Messages sent to or from this e-mail address may be stored on the
> Infosys e-mail system.
> ***INFOSYS******** End of Disclaimer ********INFOSYS***
>
>
--
Thanks,
Ashwin
Re: How to increase spark driver memory and ship jars on zeppelin ?
Posted by Anand Raghavan <An...@infosys.com>.
R
From: Ashwin Shankar [mailto:ashwinshankar77@gmail.com]
Sent: Saturday, August 08, 2015 03:54 AM
To: users@zeppelin.incubator.apache.org <us...@zeppelin.incubator.apache.org>
Subject: How to increase spark driver memory and ship jars on zeppelin ?
Hi,
When we run spark-shell on apache spark, we can increase driver memory by passing
"--driver-memory" option. We can also ship jars to the cluster using "--jars"
option.
How do we pass these spark options to zeppelin(yarn-client mode)?
--
Thanks,
Ashwin
**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***