You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Arun C Murthy (JIRA)" <ji...@apache.org> on 2009/07/28 00:54:14 UTC
[jira] Created: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Job summary logs show status of completed jobs as RUNNING
----------------------------------------------------------
Key: MAPREDUCE-809
URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: jobtracker
Affects Versions: 0.21.0
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Fix For: 0.21.0
MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-809:
------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this.
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-809_0_20090728.patch, MAPREDUCE-809_0_20090728_yhadoop20.patch
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12737281#action_12737281 ]
Hudson commented on MAPREDUCE-809:
----------------------------------
Integrated in Hadoop-Mapreduce-trunk #33 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/33/])
. Fix job-summary logs to correctly record status of FAILED and KILLED jobs.
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-809_0_20090728.patch, MAPREDUCE-809_0_20090728_yhadoop20.patch
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12737227#action_12737227 ]
Tsz Wo (Nicholas), SZE commented on MAPREDUCE-809:
--------------------------------------------------
Arun, added your name in CHANGES.txt.
{noformat}
- and KILLED jobs.
+ and KILLED jobs. (acmurthy)
{noformat}
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-809_0_20090728.patch, MAPREDUCE-809_0_20090728_yhadoop20.patch
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12736909#action_12736909 ]
Arun C Murthy commented on MAPREDUCE-809:
-----------------------------------------
All test cases pass, 'ant test-patch' does too and I've not included any new testcases since it's essentially the same fix as MAPREDUCE-740 and I can't add more tests for the reasons elaborated there.
Also, this patch only fixes logging for FAILED/KILLED tasks and Suman hasn't been able to reproduce the error for SUCCEEDED ones, I'll commit this patch and we can open a different jira if she can reproduce it later.
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-809_0_20090728.patch, MAPREDUCE-809_0_20090728_yhadoop20.patch
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-809:
------------------------------------
Release Note: Fix job-summary logs to correctly record final status of FAILED and KILLED jobs.
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-809_0_20090728.patch, MAPREDUCE-809_0_20090728_yhadoop20.patch
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Suman Sehgal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735956#action_12735956 ]
Suman Sehgal commented on MAPREDUCE-809:
----------------------------------------
Though I saw the issue with successful jobs but couldn't reproduce it. The issue is quite consistent for "failed" and "killed" jobs. Jobtracker log shows the status "RUNNING" for these jobs.
Log Message:
==========
2009-07-27 05:46:14,276 INFO org.apache.hadoop.mapred.JobInProgress$JobSummary: jobId=job_200907270543_0003,submitTime=1248673540705,launchTime=1248673544024,finishTime=0,numMaps=2,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoopqa,queue=default,status=RUNNING,mapSlotSeconds=38,reduceSlotsSeconds=0,clusterMapCapacity=102,clusterReduceCapacity=34
2009-07-27 05:46:14,277 INFO org.apache.hadoop.mapred.JobHistory: Moving completed job from file:<log dir path>/mapred/history/<hostname>_1248673437715_job_200907270543_0003_hadoopqa_streamjob5894288556860737357.jar to file:<log dir path>/mapred/history/done/<hostname>_1248673437715_job_200907270543_0003_hadoopqa_streamjob5894288556860737357.jar
2009-07-27 05:46:14,278 INFO org.apache.hadoop.mapred.JobHistory: Moving configuration of completed job from file:<log dir path>/<hostname>_1248673437715_job_200907270543_0003_conf.xml to file:<log dir path>/mapred/history/done/<hostname>_1248673437715_job_200907270543_0003_conf.xml
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735830#action_12735830 ]
Arun C Murthy commented on MAPREDUCE-809:
-----------------------------------------
Suman tells me that she saw SUCCEEDED jobs show up in the logs with status as RUNNING, which given our code structure of JobInProgress.jobCompleted being the only entry point to mark jobs as SUCCEDED is probably indicative of a race-condition.
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Hong Tang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12736420#action_12736420 ]
Hong Tang commented on MAPREDUCE-809:
-------------------------------------
Patch looks good. +1
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-809_0_20090728.patch, MAPREDUCE-809_0_20090728_yhadoop20.patch
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-809:
------------------------------------
Status: Patch Available (was: Open)
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-809_0_20090728.patch, MAPREDUCE-809_0_20090728_yhadoop20.patch
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-809:
------------------------------------
Attachment: MAPREDUCE-809_0_20090728_yhadoop20.patch
MAPREDUCE-809_0_20090728.patch
Doh! Looks like the final patch I uploaded to MAPREDUCE-740 was slighlty older which missed the current changes in these patches to correctly log the job-summary for failed jobs. The attached patches fixes my snafu... my bad.
Suman - I still don't see how SUCCEEDED jobs can be logged as RUNNING - but for a race condition I can't see yet. I'd appreciate if you could try to reproduce it and provide me the JobTracker logs. Thanks!
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-809_0_20090728.patch, MAPREDUCE-809_0_20090728_yhadoop20.patch
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-809) Job summary logs show status of
completed jobs as RUNNING
Posted by "Suman Sehgal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suman Sehgal updated MAPREDUCE-809:
-----------------------------------
Tags: ygridqa
> Job summary logs show status of completed jobs as RUNNING
> ----------------------------------------------------------
>
> Key: MAPREDUCE-809
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-809
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-809_0_20090728.patch, MAPREDUCE-809_0_20090728_yhadoop20.patch
>
>
> MAPREDUCE-740 added job summary logs. During testing our QA folks noticed that completed jobs show up as RUNNING in the logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.