You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Bharati Jadhav (Jira)" <ji...@apache.org> on 2019/10/24 21:17:00 UTC

[jira] [Created] (SPARK-29596) Task duration not updating for running tasks

Bharati Jadhav created SPARK-29596:
--------------------------------------

             Summary: Task duration not updating for running tasks
                 Key: SPARK-29596
                 URL: https://issues.apache.org/jira/browse/SPARK-29596
             Project: Spark
          Issue Type: Bug
          Components: Web UI
    Affects Versions: 2.4.2
            Reporter: Bharati Jadhav


When looking at the task metrics for running tasks in the task table for the related stage, the duration column is not updated until the task has succeeded. The duration values are reported empty or 0 ms until the task has completed. This is a change in behavior, from earlier versions, when the task duration was continuously updated while the task was running. The missing duration values can be observed for both short and long running tasks and for multiple applications.

 

To reproduce this, one can run any code from the spark-shell and observe the missing duration values for any running task. Only when the task succeeds is the duration value populated in the UI.

!image-2019-10-24-14-16-16-986.png!

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org