[jira] [Created] (ZEPPELIN-1263) Should specify zeppelin's spark configuration through --conf arguments of spark-submit

["Jeff Zhang (JIRA)" <ji...@apache.org>]

Jeff Zhang created ZEPPELIN-1263:
------------------------------------

             Summary: Should specify zeppelin's spark configuration through --conf arguments of spark-submit
                 Key: ZEPPELIN-1263
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1263
             Project: Zeppelin
          Issue Type: Bug
    Affects Versions: 0.6.0
            Reporter: Jeff Zhang
            Assignee: Jeff Zhang


For now, we load zeppelin's spark configuration at runtime in the RemoteInterpreter Process rather than loading them before starting the process (through --conf of spark-submit). It is fine for most of spark configuration, but for some configuration, it would introduce some weird issues.  Like ZEPPELIN-1242, and if you specify spark.master as yarn-client in spark-defaults.conf but specify spark.master as local in zeppelin side, you will see the spark interpreter fail to start due to this inconsistency. 
So I propose to specify zeppelin's spark configuration through --conf arguments of spark-submit



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)