You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2020/07/02 00:44:00 UTC

[jira] [Commented] (SPARK-30794) Stage Level scheduling: Add ability to set off heap memory

    [ https://issues.apache.org/jira/browse/SPARK-30794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149759#comment-17149759 ] 

Apache Spark commented on SPARK-30794:
--------------------------------------

User 'warrenzhu25' has created a pull request for this issue:
https://github.com/apache/spark/pull/28972

> Stage Level scheduling: Add ability to set off heap memory
> ----------------------------------------------------------
>
>                 Key: SPARK-30794
>                 URL: https://issues.apache.org/jira/browse/SPARK-30794
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.1.0
>            Reporter: Thomas Graves
>            Priority: Major
>
> For stage level scheduling in ExecutorResourceRequests we support setting heap memory, pyspark memory, and memory overhead. We have no split out off heap memory as its own configuration so we should add it as an option.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org