You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Xi Shen <da...@gmail.com> on 2015/03/16 12:46:49 UTC

Can I start multiple executors in local mode?

Hi,

In YARN mode you can specify the number of executors. I wonder if we can
also start multiple executors at local, just to make the test run faster.

Thanks,
David

Re: Can I start multiple executors in local mode?

Posted by Xi Shen <da...@gmail.com>.

No, I didn't mean local cluster. I mean run in local, like in IDE.

On Mon, 16 Mar 2015 23:12 xu Peng <hs...@gmail.com> wrote:

> Hi David,
>
> You can try the local-cluster.
>
> the number in local-cluster[2,2,1024] represents that there are 2 worker,
> 2 cores and 1024M
>
> Best Regards
>
> Peng Xu
>
> 2015-03-16 19:46 GMT+08:00 Xi Shen <da...@gmail.com>:
>
>> Hi,
>>
>> In YARN mode you can specify the number of executors. I wonder if we can
>> also start multiple executors at local, just to make the test run faster.
>>
>> Thanks,
>> David
>>
>
>

Re: Can I start multiple executors in local mode?

Posted by xu Peng <hs...@gmail.com>.

Hi David,

You can try the local-cluster.

the number in local-cluster[2,2,1024] represents that there are 2 worker, 2
cores and 1024M

Best Regards

Peng Xu

2015-03-16 19:46 GMT+08:00 Xi Shen <da...@gmail.com>:

> Hi,
>
> In YARN mode you can specify the number of executors. I wonder if we can
> also start multiple executors at local, just to make the test run faster.
>
> Thanks,
> David
>