You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2014/09/10 22:14:33 UTC
[jira] [Commented] (SPARK-3476) Yarn ClientBase.validateArgs memory
checks wrong
[ https://issues.apache.org/jira/browse/SPARK-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129026#comment-14129026 ]
Thomas Graves commented on SPARK-3476:
--------------------------------------
note https://github.com/apache/spark/pull/2253 fixes up the am memory calculations.
> Yarn ClientBase.validateArgs memory checks wrong
> ------------------------------------------------
>
> Key: SPARK-3476
> URL: https://issues.apache.org/jira/browse/SPARK-3476
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.2.0
> Reporter: Thomas Graves
>
> The yarn ClientBase.validateArgs memory checks are no longer valid. It used to be that the overhead was taken out of what the user specified, now we add it on top of what the user specifies. We can probably just remove these.
> (args.amMemory <= memoryOverhead) -> ("Error: AM memory size must be" +
> "greater than: " + memoryOverhead),
> (args.executorMemory <= memoryOverhead) -> ("Error: Executor memory size" +
> "must be greater than: " + memoryOverhead.toString)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org