You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yui Hirasawa (JIRA)" <ji...@apache.org> on 2019/01/02 08:03:00 UTC
[jira] [Updated] (SPARK-26516) zeppelin with spark on mesos:
environment variable setting
[ https://issues.apache.org/jira/browse/SPARK-26516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yui Hirasawa updated SPARK-26516:
---------------------------------
Issue Type: Question (was: IT Help)
> zeppelin with spark on mesos: environment variable setting
> ----------------------------------------------------------
>
> Key: SPARK-26516
> URL: https://issues.apache.org/jira/browse/SPARK-26516
> Project: Spark
> Issue Type: Question
> Components: Mesos, Spark Core
> Affects Versions: 2.4.0
> Reporter: Yui Hirasawa
> Priority: Major
>
> I am trying to use zeppelin with spark on mesos mode following [Apache Zeppelin on Spark Cluster Mode|https://zeppelin.apache.org/docs/0.8.0/setup/deployment/spark_cluster_mode.html#4-configure-spark-interpreter-in-zeppelin-1].
> In the instruction, we should set these environment variables:
> {code:java}
> export MASTER=mesos://127.0.1.1:5050
> export MESOS_NATIVE_JAVA_LIBRARY=[PATH OF libmesos.so]
> export SPARK_HOME=[PATH OF SPARK HOME]
> {code}
> As far as I know, these environment variables are used by zeppelin, so it should be set in localhost rather than in docker container(if i am wrong please correct me).
> But mesos and spark is running inside docker container, so do we need to set these environment variables so that they are pointing to the path inside the docker container? If so, how should one achieve that?
> Thanks in advance.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org