My Zeppelin Spark Job is getting only 2 executors

[Gilad Landau <Gi...@clicktale.com>]

Hi,

My Zeppelin  spark job is getting only 2 executors on Yarn even though the interpreter is set to use 10.
Also, when I look at history server I see that the job was intiated with the right number of exeuctors (10) but only 2 are actually being used.
Any idea what could cause this behavior and how to fix it?

Thanks,

Gilad

RE: My Zeppelin Spark Job is getting only 2 executors

[Gilad Landau <Gi...@clicktale.com>]

In spark-shell I get just as many executors as I want, unlike Zeppelin.



From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Monday, February 27, 2017 12:45 PM
To: users@zeppelin.apache.org
Subject: Re: My Zeppelin Spark Job is getting only 2 executors

What is the behavior if you do it in spark-shell ?


Gilad Landau <Gi...@clicktale.com>>于2017年2月27日周一 下午6:31写道：
Hi,

My Zeppelin  spark job is getting only 2 executors on Yarn even though the interpreter is set to use 10.
Also, when I look at history server I see that the job was intiated with the right number of exeuctors (10) but only 2 are actually being used.
Any idea what could cause this behavior and how to fix it?

Thanks,

Gilad

Re: My Zeppelin Spark Job is getting only 2 executors

[Jeff Zhang <zj...@gmail.com>]

What is the behavior if you do it in spark-shell ?


Gilad Landau <Gi...@clicktale.com>于2017年2月27日周一 下午6:31写道：

> Hi,
>
>
>
> My Zeppelin  spark job is getting only 2 executors on Yarn even though the
> interpreter is set to use 10.
>
> Also, when I look at history server I see that the job was intiated with
> the right number of exeuctors (10) but only 2 are actually being used.
>
> Any idea what could cause this behavior and how to fix it?
>
>
>
> Thanks,
>
>
>
> Gilad
>
>
>