You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xiangyu Li (JIRA)" <ji...@apache.org> on 2015/11/19 03:01:10 UTC

[jira] [Created] (SPARK-11841) None of start-all.sh, start-master.sh or start-slaves.sh takes -m, -c or -d configuration options as per the document

Xiangyu Li created SPARK-11841:
----------------------------------

             Summary: None of start-all.sh, start-master.sh or start-slaves.sh takes -m, -c or -d configuration options as per the document
                 Key: SPARK-11841
                 URL: https://issues.apache.org/jira/browse/SPARK-11841
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 1.5.2
            Reporter: Xiangyu Li


I was trying to set up Spark Standalone Mode following the tutorial at http://spark.apache.org/docs/latest/spark-standalone.html.

The tutorial says that we can pass "-c CORES" to the worker to set the total number of CPU cores allowed. But none of the start-all.sh, start-master.sh or start-slaves.sh would take those options as arguments.

The start-all.sh and start-slaves.sh will just skip the options while start-master.sh can only take -h, -i, -p, --properties-file according to https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/master/MasterArguments.scala

So the only way I can limit the number of cores of an application at the moment is set the SPARK_WORKER_CORES in ${SPARK_HOME}/conf/spark_env.sh and then run start-all.sh

So I think it is either an error in the document or the program.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org