[jira] [Commented] (SPARK-17313) Support spark-shell on cluster mode

["Sean Owen (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-17313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449684#comment-15449684 ] 

Sean Owen commented on SPARK-17313:
-----------------------------------

The problem is: how are you going to interact with a shell on your local machine when the driver is somewhere else? It's not impossible but not clear it's worthwhile. The driver is in general not doing much work, or shouldn't be; the shell is more for exploration that production.

> Support spark-shell on cluster mode
> -----------------------------------
>
>                 Key: SPARK-17313
>                 URL: https://issues.apache.org/jira/browse/SPARK-17313
>             Project: Spark
>          Issue Type: New Feature
>            Reporter: Mahmoud Elgamal
>
> The main issue with the current spark shell is that the driver is running on the user machine. If the driver resource requirement is beyond user machine capacity, then spark shell will be useless. If we are to add the cluster mode(Yarn or Mesos ) for spark shell via some sort of proxy where user machine only hosts a rest client to the running driver at the cluster, the shell will be more powerful



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org