SPARK_SUBMIT_OPTIONS variable didin't applied!

[Soheil Pourbafrani <so...@gmail.com>]

I use SPARK_SUBMIT_OPTIONS variable in zeppeline-env.sh file to set some
options for spark applications that runs for zeppelin.

export SPARK_SUBMIT_OPTIONS="--executor-memory 512m --driver-memory
512m --executor-cores 2 --queue onlineQ"

But running spark on the Yarn cluster, it didn't applied. When I set some
options like

executor-memory

in interpreter setting, it will be applied, but I want to use some options
like

queue

and I don't know if it's possible to set such option in interpreter
settings?

Unsubscribe

["Richard A. Bross" <rb...@oaktreepeak.com>]

----- Original Message -----
From: "Soheil Pourbafrani" <so...@gmail.com>
To: users@zeppelin.apache.org
Sent: Thursday, April 12, 2018 5:59:28 AM
Subject: SPARK_SUBMIT_OPTIONS variable didin't applied!


I use SPARK_SUBMIT_OPTIONS variable in zeppeline-env.sh file to set some options for spark applications that runs for zeppelin. 
export SPARK_SUBMIT_OPTIONS="--executor-memory 512m --driver-memory 512m --executor-cores 2 --queue onlineQ" But running spark on the Yarn cluster, it didn't applied. When I set some options like 
executor-memory in interpreter setting, it will be applied, but I want to use some options like 


queue and I don't know if it's possible to set such option in interpreter settings? 

Re: SPARK_SUBMIT_OPTIONS variable didin't applied!

[Jeff Zhang <zj...@gmail.com>]

you can set spark.yarn.queue in interpreter setting



Soheil Pourbafrani <so...@gmail.com>于2018年4月12日周四 下午6:00写道：

> I use SPARK_SUBMIT_OPTIONS variable in zeppeline-env.sh file to set some
> options for spark applications that runs for zeppelin.
>
> export SPARK_SUBMIT_OPTIONS="--executor-memory 512m --driver-memory 512m --executor-cores 2 --queue onlineQ"
>
> But running spark on the Yarn cluster, it didn't applied. When I set some
> options like
>
> executor-memory
>
> in interpreter setting, it will be applied, but I want to use some options
> like
>
> queue
>
> and I don't know if it's possible to set such option in interpreter
> settings?
>
>