You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by elyast <lu...@gmail.com> on 2014/07/01 06:09:38 UTC

Re: little confused about SPARK_JAVA_OPTS alternatives

Hi Andrew,

I'm actually using spark-submit, and I tried using
spark.executor.extraJavaOpts to configure tachyon client to connect to
Tachyon HA master, however the configuration settings were not picked up.

On the other hand when I set the same tachyon configuration parameters
through SPARK_JAVA_OPTS or /conf/java_opts it actually worked.

IMHO tachyon client classes are loaded into jvm and since they are mostly
singletons system properties are not being refreshed.

Let me know if you need more info. I have logs from both runs and I can try
different settings on my spark cluster (I am running spark on mesos in fine
grained mode)

Best regards
Lukasz



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/little-confused-about-SPARK-JAVA-OPTS-alternatives-tp5798p8551.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.