You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Chris Cope (JIRA)" <ji...@apache.org> on 2014/08/12 17:49:11 UTC
[jira] [Commented] (SPARK-2140) yarn stable client doesn't properly
handle MEMORY_OVERHEAD for AM
[ https://issues.apache.org/jira/browse/SPARK-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094191#comment-14094191 ]
Chris Cope commented on SPARK-2140:
-----------------------------------
>From Client and ClientBase, it looks like the commented-out code already makes the proper memory overhead arithmetic. Could you clarify the description? If that's right, then the simple PR would should suffice.
> yarn stable client doesn't properly handle MEMORY_OVERHEAD for AM
> -----------------------------------------------------------------
>
> Key: SPARK-2140
> URL: https://issues.apache.org/jira/browse/SPARK-2140
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.0.0
> Reporter: Thomas Graves
> Fix For: 1.0.1, 1.1.0
>
>
> The yarn stable client doesn't properly remove the MEMORY_OVERHEAD amount from the java heap size, the code to handle that is commented out (see function calculateAMMemory). We should fix this.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org