You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2016/01/18 15:02:39 UTC

[jira] [Resolved] (SPARK-2653) Heap size should be the sum of driver.memory and executor.memory in local mode

     [ https://issues.apache.org/jira/browse/SPARK-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved SPARK-2653.
------------------------------
    Resolution: Not A Problem

Although I don't feel so strongly about this either way, it would be a behavior change and I've seen no activity on this. There is really no executor in local mode; execution happens in the driver. I think it's sensible to use the driver memory as the heap size.

> Heap size should be the sum of driver.memory and executor.memory in local mode
> ------------------------------------------------------------------------------
>
>                 Key: SPARK-2653
>                 URL: https://issues.apache.org/jira/browse/SPARK-2653
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: Davies Liu
>            Priority: Minor
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> In local mode, the driver and executor run in the same JVM, so the heap size of JVM should be the sum of spark.driver.memory and spark.executor.memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org