You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Mahmoud Elgamal (JIRA)" <ji...@apache.org> on 2016/08/30 17:26:22 UTC

[jira] [Reopened] (SPARK-17313) Support spark-shell on cluster mode

     [ https://issues.apache.org/jira/browse/SPARK-17313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahmoud Elgamal reopened SPARK-17313:
-------------------------------------

> Support spark-shell on cluster mode
> -----------------------------------
>
>                 Key: SPARK-17313
>                 URL: https://issues.apache.org/jira/browse/SPARK-17313
>             Project: Spark
>          Issue Type: New Feature
>            Reporter: Mahmoud Elgamal
>
> The main issue with the current spark shell is that the driver is running on the user machine. If the driver resource requirement is beyond user machine capacity, then spark shell will be useless. If we are to add the cluster mode(Yarn or Mesos ) for spark shell via some sort of proxy where user machine only hosts a rest client to the running driver at the cluster, the shell will be more powerful



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org