You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Karthik Kambatla (JIRA)" <ji...@apache.org> on 2012/10/04 23:57:47 UTC
[jira] [Created] (MAPREDUCE-4706) FairScheduler#dump(): Computing
of # running maps and reduces is commented out
Karthik Kambatla created MAPREDUCE-4706:
-------------------------------------------
Summary: FairScheduler#dump(): Computing of # running maps and reduces is commented out
Key: MAPREDUCE-4706
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4706
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/fair-share
Affects Versions: 1.0.3
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
Priority: Critical
In FairScheduler#dump(), we conveniently comment the updating of number of running maps and reduces. It needs to be fixed for the dump to throw out meaningful information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4706) FairScheduler#dump(): Computing
of # running maps and reduces is commented out
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated MAPREDUCE-4706:
---------------------------------
Resolution: Fixed
Fix Version/s: 1.2.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
+1 I just committed this. Thanks Karthik!
> FairScheduler#dump(): Computing of # running maps and reduces is commented out
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4706
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4706
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/fair-share
> Affects Versions: 1.0.3
> Reporter: Karthik Kambatla
> Assignee: Karthik Kambatla
> Priority: Critical
> Fix For: 1.2.0
>
> Attachments: MR-4706.patch
>
>
> In FairScheduler#dump(), we conveniently comment the updating of number of running maps and reduces. It needs to be fixed for the dump to throw out meaningful information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4706) FairScheduler#dump(): Computing
of # running maps and reduces is commented out
Posted by "Karthik Kambatla (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karthik Kambatla updated MAPREDUCE-4706:
----------------------------------------
Status: Patch Available (was: Open)
> FairScheduler#dump(): Computing of # running maps and reduces is commented out
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4706
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4706
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/fair-share
> Affects Versions: 1.0.3
> Reporter: Karthik Kambatla
> Assignee: Karthik Kambatla
> Priority: Critical
> Attachments: MR-4706.patch
>
>
> In FairScheduler#dump(), we conveniently comment the updating of number of running maps and reduces. It needs to be fixed for the dump to throw out meaningful information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4706) FairScheduler#dump(): Computing
of # running maps and reduces is commented out
Posted by "Karthik Kambatla (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470743#comment-13470743 ]
Karthik Kambatla commented on MAPREDUCE-4706:
---------------------------------------------
Verified on a pseudo-distributed cluster that the running maps and running reduces are being reported. Without this patch, they were zero. The patch uses {{#getMapSchedulable()}}, {{#getReduceSchedulable()}}, and {{#getRunningTasks()}} methods - existing tests use this methods and thereby validate their behavior.
> FairScheduler#dump(): Computing of # running maps and reduces is commented out
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4706
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4706
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/fair-share
> Affects Versions: 1.0.3
> Reporter: Karthik Kambatla
> Assignee: Karthik Kambatla
> Priority: Critical
> Attachments: MR-4706.patch
>
>
> In FairScheduler#dump(), we conveniently comment the updating of number of running maps and reduces. It needs to be fixed for the dump to throw out meaningful information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4706) FairScheduler#dump(): Computing
of # running maps and reduces is commented out
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470793#comment-13470793 ]
Hadoop QA commented on MAPREDUCE-4706:
--------------------------------------
{color:red}-1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12547884/MR-4706.patch
against trunk revision .
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2912//console
This message is automatically generated.
> FairScheduler#dump(): Computing of # running maps and reduces is commented out
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4706
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4706
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/fair-share
> Affects Versions: 1.0.3
> Reporter: Karthik Kambatla
> Assignee: Karthik Kambatla
> Priority: Critical
> Attachments: MR-4706.patch
>
>
> In FairScheduler#dump(), we conveniently comment the updating of number of running maps and reduces. It needs to be fixed for the dump to throw out meaningful information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4706) FairScheduler#dump(): Computing
of # running maps and reduces is commented out
Posted by "Karthik Kambatla (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karthik Kambatla updated MAPREDUCE-4706:
----------------------------------------
Attachment: MR-4706.patch
Uploading a patch that calculates runningMaps and runningReduces before logging them.
Will run a cluster manually and report.
> FairScheduler#dump(): Computing of # running maps and reduces is commented out
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4706
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4706
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/fair-share
> Affects Versions: 1.0.3
> Reporter: Karthik Kambatla
> Assignee: Karthik Kambatla
> Priority: Critical
> Attachments: MR-4706.patch
>
>
> In FairScheduler#dump(), we conveniently comment the updating of number of running maps and reduces. It needs to be fixed for the dump to throw out meaningful information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira