[jira] [Created] (ZEPPELIN-5760) properties are not propagated correctly to spark in k8s

["Michal Vince (Jira)" <ji...@apache.org>]

Michal Vince created ZEPPELIN-5760:
--------------------------------------

             Summary: properties are not propagated correctly to spark in k8s
                 Key: ZEPPELIN-5760
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5760
             Project: Zeppelin
          Issue Type: Bug
            Reporter: Michal Vince


As stated in [spark configuration|https://spark.apache.org/docs/latest/configuration.html#dynamically-loading-spark-properties]
{noformat}
Spark properties mainly can be divided into two kinds: one is related to deploy, like “spark.driver.memory”, “spark.executor.instances”, this kind of properties may not be affected when setting programmatically through SparkConf in runtime, or the behavior is depending on which cluster manager and deploy mode you choose, so it would be suggested to set through configuration file or spark-submit command line options...
{noformat}
some configurations are ignored when set via SparkConf including {{{}spark.jars.packages{}}}, {{spark.driver.extraJavaOptions}} and others when running spark in K8s



--
This message was sent by Atlassian Jira
(v8.20.10#820010)