You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@bigtop.apache.org by "Kevin W Monroe (JIRA)" <ji...@apache.org> on 2017/07/14 17:36:00 UTC

[jira] [Created] (BIGTOP-2844) zeppelin charm: spark config should match zeppelin spark config

Kevin W Monroe created BIGTOP-2844:
--------------------------------------

             Summary: zeppelin charm: spark config should match zeppelin spark config
                 Key: BIGTOP-2844
                 URL: https://issues.apache.org/jira/browse/BIGTOP-2844
             Project: Bigtop
          Issue Type: Bug
          Components: deployment
    Affects Versions: 1.2.0, 1.2.1
            Reporter: Kevin W Monroe
            Assignee: Kevin W Monroe
            Priority: Minor
             Fix For: 1.3.0


The Zeppelin charm deploys spark-client and zeppelin-server roles.

When zeppelin-server spark config is updated (e.g. we configure it in 'yarn' mode), the spark-client config is not updated.  This is fine for jobs submitted through Zeppelin, but if a user attempted to spark-submit on the deployed machine, they may send their job to the wrong master.

Also, the zeppelin-spark test might stomp on top of a pre-deployed spark charm.  Fix this by deploying a test-only copy of the spark charm, run the test, then remove the charm.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)