You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ofer Eliassaf <of...@gmail.com> on 2016/09/27 13:38:16 UTC
pyspark cluster mode on standalone deployment
Is there any plan to support python spark running in "cluster mode" on a
standalone deployment?
There is this famous survey mentioning that more than 50% of the users are
using the standalone configuration.
Making pyspark work in cluster mode with standalone will help a lot for
high availabilty in python spark.
Cuurently only Yarn deployment supports it. Bringing the huge Yarn
installation just for this feature is not fun at all....
Does someone have time estimation for this?
--
Regards,
Ofer Eliassaf
Re: pyspark cluster mode on standalone deployment
Posted by Ofer Eliassaf <of...@gmail.com>.
anyone? please? is this getting any priority?
On Tue, Sep 27, 2016 at 3:38 PM, Ofer Eliassaf <of...@gmail.com>
wrote:
> Is there any plan to support python spark running in "cluster mode" on a
> standalone deployment?
>
> There is this famous survey mentioning that more than 50% of the users are
> using the standalone configuration.
> Making pyspark work in cluster mode with standalone will help a lot for
> high availabilty in python spark.
>
> Cuurently only Yarn deployment supports it. Bringing the huge Yarn
> installation just for this feature is not fun at all....
>
> Does someone have time estimation for this?
>
>
>
> --
> Regards,
> Ofer Eliassaf
>
--
Regards,
Ofer Eliassaf