You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yui Hirasawa (JIRA)" <ji...@apache.org> on 2019/01/02 08:00:00 UTC

[jira] [Created] (SPARK-26516) zeppelin with spark on mesos: environment variable setting

Yui Hirasawa created SPARK-26516:
------------------------------------

             Summary: zeppelin with spark on mesos: environment variable setting
                 Key: SPARK-26516
                 URL: https://issues.apache.org/jira/browse/SPARK-26516
             Project: Spark
          Issue Type: IT Help
          Components: Mesos, Spark Core
    Affects Versions: 2.4.0
            Reporter: Yui Hirasawa


I am trying to use zeppelin with spark on mesos mode following [Apache Zeppelin on Spark Cluster Mode|https://zeppelin.apache.org/docs/0.8.0/setup/deployment/spark_cluster_mode.html#4-configure-spark-interpreter-in-zeppelin-1].

In the instruction, we should set these environment variables:
{code:java}
export MASTER=mesos://127.0.1.1:5050
export MESOS_NATIVE_JAVA_LIBRARY=[PATH OF libmesos.so]
export SPARK_HOME=[PATH OF SPARK HOME]
{code}
As far as I know, these environment variables are used by zeppelin, so it should be set in localhost rather than in docker container(if i am wrong please correct me).

But mesos and spark is running inside docker container, so do we need to set these environment variables so that they are pointing to the path inside the docker container? If so, how should one achieve that?

Thanks in advance.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org