You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2016/11/27 10:06:58 UTC

[jira] [Resolved] (SPARK-18503) Pre 2.0 spark driver/executor memory default unit is bytes, post 2.0 default unit is MB

     [ https://issues.apache.org/jira/browse/SPARK-18503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved SPARK-18503.
-------------------------------
    Resolution: Not A Problem

> Pre 2.0 spark driver/executor memory default unit is bytes, post 2.0 default unit is MB
> ---------------------------------------------------------------------------------------
>
>                 Key: SPARK-18503
>                 URL: https://issues.apache.org/jira/browse/SPARK-18503
>             Project: Spark
>          Issue Type: Bug
>          Components: Deploy
>    Affects Versions: 2.0.0, 2.0.1, 2.0.2
>            Reporter: Chris McCubbin
>            Priority: Minor
>
> Prior to v2.0, Spark's executor memory default unit was in bytes. i.e. if one set "spark.executor.memory" to "1000000" this was interpreted as 1,000,000 bytes if no unit was supplied (like "1m"). This is consistent with the JVM.
> Changes introduced by SPARK-12343 in 2.0 made this default unit MB, so "1000000" is interpreted as 1,000,000 MB.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org