You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/04/17 09:09:58 UTC

[jira] [Commented] (SPARK-6975) Argument checking conflict in Yarn when dynamic allocation is enabled

    [ https://issues.apache.org/jira/browse/SPARK-6975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499373#comment-14499373 ] 

Apache Spark commented on SPARK-6975:
-------------------------------------

User 'jerryshao' has created a pull request for this issue:
https://github.com/apache/spark/pull/5551

> Argument checking conflict in Yarn when dynamic allocation is enabled
> ---------------------------------------------------------------------
>
>                 Key: SPARK-6975
>                 URL: https://issues.apache.org/jira/browse/SPARK-6975
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.3.0
>            Reporter: Saisai Shao
>
> When dynamic allocation is enabled in yarn with default parameter, {{numExecutors}} will be set to 0, but this will be failed in the following {{valideArgs()}}, here {{numExecutors}} must > 0, but for dynamic allocation, this executor number can be 0 (with default setting). The exception is shown as below:
> Exception in thread "main" java.lang.IllegalArgumentException: You must specify at least 1 executor!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org