You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2017/06/29 09:27:00 UTC
[jira] [Commented] (SPARK-21252) The duration times showed by spark
web UI are inaccurate
[ https://issues.apache.org/jira/browse/SPARK-21252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068069#comment-16068069 ]
Sean Owen commented on SPARK-21252:
-----------------------------------
They are rounded, and '3 seconds' is unlikely to be exactly 3 seconds, but maybe "3.49 seconds". This could explain the rounding you see, but, it's on purpose. The output is for humans and it's not worth cluttering the display with the extra digits. I don't think this is a problem.
> The duration times showed by spark web UI are inaccurate
> --------------------------------------------------------
>
> Key: SPARK-21252
> URL: https://issues.apache.org/jira/browse/SPARK-21252
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.0.0, 2.0.1, 2.1.0, 2.1.1
> Reporter: igor mazor
>
> The duration times showed by spark UI are inaccurate and seems to be rounded.
> For example when a job had 2 stages, first stage executed in 47 ms and second stage in 3 seconds, the total execution time showed by the UI is 4 seconds.
> Another example, first stage was executed in 20 ms and second stage in 4 seconds, the total execution time showed by the UI would be in that case also 4 seconds.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org