You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Chen He (JIRA)" <ji...@apache.org> on 2013/11/06 21:53:18 UTC

[jira] [Commented] (MAPREDUCE-5052) Job History UI and web services confusing job start time and job submit time

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815279#comment-13815279 ] 

Chen He commented on MAPREDUCE-5052:
------------------------------------

When a job is submitted to the system, RM will record the submit time. However, this job will be initialized till it is allowed to create a ApplicationMaster. This time point is recorded in JobImpl calss when the MRAppMaster starts. It is called "launchTime". In my opinion, 
a job's queuing time equals "launchTime - submitTime"; The "startTime" is ambiguous because it may refer to the startTime of the AM or the startTime of the first map task. If there is no objection, I suggest we put the "launchTime" there instead of "startTime".  
 

> Job History UI and web services confusing job start time and job submit time
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5052
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5052
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver, webapps
>    Affects Versions: 0.23.6
>            Reporter: Kendall Thrapp
>            Assignee: Chen He
>            Priority: Critical
>
> The "Start Time" column shown on Job History server's main webpage (http://<host>:<port>/jobhistory) is actually showing the *submit* time for jobs.  However, when you drill down to an individual job's page, there the "Start Time" really does refer to when the job actually started.  
> This also true for the web services REST API, where the Jobs listing returns the submit times as "startTime", but the single Job API returns the start time as "startTime".
> The two different times being referred to by the same name is confusing.  However, it is useful to have both times, as the difference between the submit time and start time can show how long a job was stuck waiting in a queue.  The column on the main job history page should be changed to "Submit Time" and the individual job's page should show both the submit time and start time.  The web services REST API should be updated with these changes as well.



--
This message was sent by Atlassian JIRA
(v6.1#6144)