[jira] [Created] (SPARK-1896) MASTER masks spark.master in spark-shell

["Andrew Or (JIRA)" <ji...@apache.org>]

Andrew Or created SPARK-1896:
--------------------------------

             Summary: MASTER masks spark.master in spark-shell
                 Key: SPARK-1896
                 URL: https://issues.apache.org/jira/browse/SPARK-1896
             Project: Spark
          Issue Type: Bug
            Reporter: Andrew Or


For bin/spark-shell, the priority hierarchy is
{code}
MASTER > --master > spark.master (spark-defaults.conf)
{code}

Not sure if this was the intended behavior, but it was surprising to me when I tried to run the shell on local mode, and it didn't take effect. Note that this is inconsistent with running applications, where the hierarchy is

{code}
--master > spark.master (spark-defaults.conf) > MASTER
{code}

I think the MASTER is a good cluster default, but if the user explicitly specifies a master we should obey it, like we do in normal applications.



--
This message was sent by Atlassian JIRA
(v6.2#6252)