[jira] [Created] (SPARK-39363) fix spark.kubernetes.memoryOverheadFactor deprecation warning

["Thomas Graves (Jira)" <ji...@apache.org>]

Thomas Graves created SPARK-39363:
-------------------------------------

             Summary: fix spark.kubernetes.memoryOverheadFactor deprecation warning
                 Key: SPARK-39363
                 URL: https://issues.apache.org/jira/browse/SPARK-39363
             Project: Spark
          Issue Type: Bug
          Components: Kubernetes
    Affects Versions: 3.4.0
            Reporter: Thomas Graves


see [https://github.com/apache/spark/pull/36744] for details.

 

It looks like we deprecated {{spark.kubernetes.memoryOverheadFactor, but it has a default value which leads it to printing warnings all the time.}}

{{}}
{code:java}
22/06/01 23:53:49 WARN SparkConf: The configuration key 'spark.kubernetes.memoryOverheadFactor' has been deprecated as of Spark 3.3.0 and may be removed in the future. Please use spark.driver.memoryOverheadFactor and spark.executor.memoryOverheadFactor{code}
{{}}

{{We should remove the default value if possible. It should only be used as fallback but we should be able to use the default from }}

spark.driver.memoryOverheadFactor.

{{{}{}}}{{{}{}}}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org