You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Wei Da <xw...@qq.com> on 2014/12/30 03:55:11 UTC

Number of cores is 0 in WebUI when use bin/spark-submit

Hi all,

I’m trying to use bin/spark-submit in Spark 1.1.0 to run my applications. The applications finished successfully, but I saw the column for “Cores” is always 0. 

I have tried the following two scripts, but got the same result. 
./spark-submit --master spark://masterIP:7077 --class SparkPi ~/app/sparktest.jar 10

./spark-submit --master spark://masterIP:7077 --total-executor-cores 16 --class SparkPi ~/app/sparktest.jar 10

Following is what I see in the WebUI. Does anyone know the reasons? Thanks a lot!




Wei Da
xwd0520@qq.com

Re: Number of cores is 0 in WebUI when use bin/spark-submit

Posted by Josh Rosen <ro...@gmail.com>.

I believe that this is showing the number of cores currently assigned to the application, so a completed application will show zero cores.  I’ve filed https://issues.apache.org/jira/browse/SPARK-5076 to remove these columns for completed applications. 

On December 29, 2014 at 6:56:13 PM, Wei Da (xwd0520@qq.com) wrote:

Hi all,

I’m trying to use bin/spark-submit in Spark 1.1.0 to run my applications. The applications finished successfully, but I saw the column for “Cores” is always 0. 

I have tried the following two scripts, but got the same result. 
./spark-submit --master spark://masterIP:7077 --class SparkPi ~/app/sparktest.jar 10

./spark-submit --master spark://masterIP:7077 --total-executor-cores 16 --class SparkPi ~/app/sparktest.jar 10

Following is what I see in the WebUI. Does anyone know the reasons? Thanks a lot!




Wei Da
xwd0520@qq.com