You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by guxiaobo1982 <gu...@qq.com> on 2013/12/31 14:18:55 UTC

Any best practice for hardware configuration for the master server in standalone cluster mode?

Him


I read the following article regarding to hardware configurations for the worker servers in the standalone cluster mode, but what about the master server?


http://spark.incubator.apache.org/docs/latest/hardware-provisioning.html




Regards,


Xiaobo Gu

Re: Any best practice for hardware configuration for the master server in standalone cluster mode?

Posted by Mayur Rustagi <ma...@gmail.com>.

Master server needs to be a little beefy as the driver runs on it. We ran
into some issues around scaling due to master servers. You can offload the
drivers to workers or other machines then the master server can be smaller.
Regards
Mayur

Mayur Rustagi
Ph: +919632149971
h <https://twitter.com/mayur_rustagi>ttp://www.sigmoidanalytics.com
https://twitter.com/mayur_rustagi

On Tue, Dec 31, 2013 at 6:48 PM, guxiaobo1982 <gu...@qq.com> wrote:

> Him
>
> I read the following article regarding to hardware configurations for the
> worker servers in the standalone cluster mode, but what about the master
> server?
>
> http://spark.incubator.apache.org/docs/latest/hardware-provisioning.html
>
>
> Regards,
>
> Xiaobo Gu
>
>