You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "huangtengfei (JIRA)" <ji...@apache.org> on 2018/08/28 08:31:00 UTC
[jira] [Created] (SPARK-25261) Update configuration.md, correct the
default units of spark.driver|executor.memory
huangtengfei created SPARK-25261:
------------------------------------
Summary: Update configuration.md, correct the default units of spark.driver|executor.memory
Key: SPARK-25261
URL: https://issues.apache.org/jira/browse/SPARK-25261
Project: Spark
Issue Type: Improvement
Components: Documentation
Affects Versions: 2.3.0
Reporter: huangtengfei
From [SparkContext|https://github.com/ivoson/spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala#L464] and [SparkSubmitCommandBuilder|https://github.com/ivoson/spark/blob/master/launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCommandBuilder.java#L265],we can see that spark.driver.memory and spark.executor.memory are parsed as bytes if no units specified. But in the doc, they are described as mb in default, which may lead to some misunderstanding.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org