You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2017/08/30 08:36:00 UTC
[jira] [Resolved] (SPARK-21872) Is job duration value of Spark Jobs
page on Web UI correct?
[ https://issues.apache.org/jira/browse/SPARK-21872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-21872.
-------------------------------
Resolution: Not A Problem
(Questions belong on the mailing list to start.)
Yes, because in general an app is frequently waiting on resources throughout its execution, like for example waiting for executor slots to free up. This should be counted as part of its execution time.
> Is job duration value of Spark Jobs page on Web UI correct?
> ------------------------------------------------------------
>
> Key: SPARK-21872
> URL: https://issues.apache.org/jira/browse/SPARK-21872
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.3.0
> Reporter: iamhumanbeing
> Priority: Minor
>
> I have submitted 2 spark jobs at the same time. but only one get running, the other is waiting for resources. but the Web UI display that both of the jobs is running. the job waiting for resources have the duration values increase.
> So, Job 7 only runing 14s, but duration value is 29s.
> Active Jobs (2)
> Job Id â–¾Description Submitted Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
> 7 (kill)count at <console>:30 2017/08/30 11:33:46 7 s 0/1 0/100
> 6 (kill)count at <console>:30 2017/08/30 11:33:46 8 s 0/2 15/127 (2 running)
> after job finished
> 7 count at <console>:30 2017/08/30 11:33:46 29 s 1/1 100/100
> 6 count at <console>:30 2017/08/30 11:33:46 16 s 1/1 (1 skipped) 27/27 (100 skipped)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org