You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by satishl <sa...@gmail.com> on 2017/02/17 23:00:17 UTC
Executor tab values in Spark Application UI
I would like to understand spark Application UI's executor tab values better.
Are the values for Input, Shuffle Rad and Shuffle Write for sum of values
for all tasks across all stages?
If yes, then it appears that value isnt much of help while debugging?
Or am I missing the point of these values?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Executor-tab-values-in-Spark-Application-UI-tp28402.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Executor tab values in Spark Application UI
Posted by Jacek Laskowski <ja...@japila.pl>.
Hi,
Yes, it's the "sum of values for all tasks" (it's based on TaskMetrics
which are accumulators behind the scenes).
Why "it appears that value isnt much of help while debugging?" ?
Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2.0 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski
On Sat, Feb 18, 2017 at 12:00 AM, satishl <sa...@gmail.com> wrote:
> I would like to understand spark Application UI's executor tab values better.
> Are the values for Input, Shuffle Rad and Shuffle Write for sum of values
> for all tasks across all stages?
> If yes, then it appears that value isnt much of help while debugging?
> Or am I missing the point of these values?
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Executor-tab-values-in-Spark-Application-UI-tp28402.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org