You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Hemanth Yamijala (JIRA)" <ji...@apache.org> on 2008/10/01 12:53:44 UTC
[jira] Created: (HADOOP-4323) Start times for some tasks are
missing from task reports after job tracker restart
Start times for some tasks are missing from task reports after job tracker restart
----------------------------------------------------------------------------------
Key: HADOOP-4323
URL: https://issues.apache.org/jira/browse/HADOOP-4323
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.19.0
Reporter: Hemanth Yamijala
When a JobTracker with the {{mapred.jobtracker.restart.recover}} option turned on, restarts, it recovers task statuses from all tasks recorded in the history for running jobs. Task trackers rejoin the restarted JobTracker and report the statuses of the tasks they had last run. These tasks' start time is set to 0 in the task reports on the restarted JobTracker. This is as seen in the web UI, or from the value of {{TaskReport.startTime}} retrieved from the job client.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4323) Start times for some tasks are
missing from task reports after job tracker restart
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12635997#action_12635997 ]
Amar Kamat commented on HADOOP-4323:
------------------------------------
I think a tip's start time will be missing. Tip's start time is different from attempt's start time. Tip-start-time is the time when the jobtracker schedules the first attempt from the tip while attempt-start-time is the time when the tracker start executing the attempt. I dont think we can recover the exact tip-start-time but the best we can do is approximate it to the first/oldest attempt's start time. Thoughts?
> Start times for some tasks are missing from task reports after job tracker restart
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-4323
> URL: https://issues.apache.org/jira/browse/HADOOP-4323
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Hemanth Yamijala
>
> When a JobTracker with the {{mapred.jobtracker.restart.recover}} option turned on, restarts, it recovers task statuses from all tasks recorded in the history for running jobs. Task trackers rejoin the restarted JobTracker and report the statuses of the tasks they had last run. These tasks' start time is set to 0 in the task reports on the restarted JobTracker. This is as seen in the web UI, or from the value of {{TaskReport.startTime}} retrieved from the job client.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-4323) Start times for some tasks are
missing from task reports after job tracker restart
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat reassigned HADOOP-4323:
----------------------------------
Assignee: Amar Kamat
> Start times for some tasks are missing from task reports after job tracker restart
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-4323
> URL: https://issues.apache.org/jira/browse/HADOOP-4323
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Hemanth Yamijala
> Assignee: Amar Kamat
> Attachments: HADOOP-4323-v1.patch
>
>
> When a JobTracker with the {{mapred.jobtracker.restart.recover}} option turned on, restarts, it recovers task statuses from all tasks recorded in the history for running jobs. Task trackers rejoin the restarted JobTracker and report the statuses of the tasks they had last run. These tasks' start time is set to 0 in the task reports on the restarted JobTracker. This is as seen in the web UI, or from the value of {{TaskReport.startTime}} retrieved from the job client.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4323) Start times for some tasks are
missing from task reports after job tracker restart
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-4323:
-------------------------------
Attachment: HADOOP-4323-v1.patch
A straight forward fix. Testing in progress.
> Start times for some tasks are missing from task reports after job tracker restart
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-4323
> URL: https://issues.apache.org/jira/browse/HADOOP-4323
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Hemanth Yamijala
> Attachments: HADOOP-4323-v1.patch
>
>
> When a JobTracker with the {{mapred.jobtracker.restart.recover}} option turned on, restarts, it recovers task statuses from all tasks recorded in the history for running jobs. Task trackers rejoin the restarted JobTracker and report the statuses of the tasks they had last run. These tasks' start time is set to 0 in the task reports on the restarted JobTracker. This is as seen in the web UI, or from the value of {{TaskReport.startTime}} retrieved from the job client.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.