You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Romi Kuntsman <ro...@totango.com> on 2015/12/01 14:49:59 UTC

diff between apps and waitingApps?

Hello,

I'm collecting metrics of master.apps and master.waitingApps, and I see the
values always match.

ref:
https://github.com/apache/spark/blob/branch-1.5/core/src/main/scala/org/apache/spark/deploy/master/Master.scala
https://github.com/apache/spark/blob/branch-1.5/core/src/main/scala/org/apache/spark/deploy/master/MasterSource.scala

What is the meaning of "waitingApps"?
And if the only place it's used is in "startExecutorsOnWorkers" where they
are filtered as "app.coresLeft > 0", shouldn't that also be filtered in the
reported metric?

*Romi Kuntsman*, *Big Data Engineer*
http://www.totango.com