How to interpret executorRunTime?

["Saraswat, Sandeep" <sa...@hpe.com>]

Hi,

I'm using Spark 1.5.1 and if I look at the JSON data for a running application, every Stage has an "executorRunTime" field associated with it which is typically a 7-digit number for the PageRank application running on a large (1.1 GB) input. Does this represent the execution-time for the stage in milliseconds? It doesn't seem so because it doesn't match with what the SparkUI shows (the "Duration" field for a stage). So what does it represent? How do I get the duration of a stage?

Regards,
Sandeep Saraswat

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org