You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/04/17 09:09:58 UTC
[jira] [Commented] (SPARK-6975) Argument checking conflict in Yarn
when dynamic allocation is enabled
[ https://issues.apache.org/jira/browse/SPARK-6975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499373#comment-14499373 ]
Apache Spark commented on SPARK-6975:
-------------------------------------
User 'jerryshao' has created a pull request for this issue:
https://github.com/apache/spark/pull/5551
> Argument checking conflict in Yarn when dynamic allocation is enabled
> ---------------------------------------------------------------------
>
> Key: SPARK-6975
> URL: https://issues.apache.org/jira/browse/SPARK-6975
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.3.0
> Reporter: Saisai Shao
>
> When dynamic allocation is enabled in yarn with default parameter, {{numExecutors}} will be set to 0, but this will be failed in the following {{valideArgs()}}, here {{numExecutors}} must > 0, but for dynamic allocation, this executor number can be 0 (with default setting). The exception is shown as below:
> Exception in thread "main" java.lang.IllegalArgumentException: You must specify at least 1 executor!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org