You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by yuemeng1 <yu...@huawei.com> on 2014/12/07 04:29:22 UTC

"vcores used" in cluster metrics(yarn resource manager ui) when running spark on yarn

Hi, all
     When i running an app with this cmd:  ./bin/spark-sql --master 
yarn-client --num-executors 2 --executor-cores 3, i noticed that yarn 
resource manager ui  shows the `vcores used` in cluster metrics is 3. It 
seems `vcores used` show wrong num (should be 7?)? Or i miss something?

Thanks

Re: "vcores used" in cluster metrics(yarn resource manager ui) when running spark on yarn

Posted by Sandy Ryza <sa...@cloudera.com>.

Hi yuemeng,

Are you possibly running the Capacity Scheduler with the default resource
calculator?

-Sandy

On Sat, Dec 6, 2014 at 7:29 PM, yuemeng1 <yu...@huawei.com> wrote:

>  Hi, all
>     When i running an app with this cmd:  ./bin/spark-sql --master
> yarn-client --num-executors 2 --executor-cores 3, i noticed that yarn
> resource manager ui  shows the `vcores used` in cluster metrics is 3. It
> seems `vcores used` show wrong num (should be 7?)? Or i miss something?
>
> Thanks
>
>