You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/10/13 10:41:06 UTC

[jira] [Commented] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

    [ https://issues.apache.org/jira/browse/SPARK-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954629#comment-14954629 ] 

Apache Spark commented on SPARK-11082:
--------------------------------------

User 'jerryshao' has created a pull request for this issue:
https://github.com/apache/spark/pull/9095

> Cores per executor is wrong when response vcore number is less than requested number
> ------------------------------------------------------------------------------------
>
>                 Key: SPARK-11082
>                 URL: https://issues.apache.org/jira/browse/SPARK-11082
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.6.0
>            Reporter: Saisai Shao
>
> When DefaultResourceCalculator is set (by default) for Yarn capacity scheduler, the response container resource vcore number is always 1, which may be less than the requested vcore number, ExecutorRunnable should honor this returned vcore number (not the requested number) to pass to each executor. Otherwise, actual allocated vcore number is different from Spark's managed CPU cores per executor.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org