You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (Created) (JIRA)" <ji...@apache.org> on 2011/09/30 00:29:46 UTC
[jira] [Created] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
---------------------------------------------------------------------------------------------------------------
Key: MAPREDUCE-3125
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Thomas Graves
Priority: Critical
Fix For: 0.23.0
ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-3125:
-------------------------------------
Attachment: Screen shot 2011-09-29 at 5.20.59 PM.png
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hitesh Shah (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hitesh Shah reassigned MAPREDUCE-3125:
--------------------------------------
Assignee: Hitesh Shah
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-3125:
-------------------------------------
Attachment: Screen shot 2011-09-29 at 5.21.18 PM.png
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3125:
-----------------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I just committed this to trunk and branch-0.23. Thanks Hitesh!
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125764#comment-13125764 ]
Hudson commented on MAPREDUCE-3125:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #828 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/828/])
MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182230
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestTaskImpl.java
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125631#comment-13125631 ]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3125:
----------------------------------------------------
Good catch Thomas!
Looked at the patch, it looks good to me, Hitesh. I think we can have better names for some of the methods in the test, but I'll pass.
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125391#comment-13125391 ]
Hadoop QA commented on MAPREDUCE-3125:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12498664/MR-3125.1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 2 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/991//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/991//console
This message is automatically generated.
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125816#comment-13125816 ]
Hudson commented on MAPREDUCE-3125:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #46 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/46/])
MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
svn merge -c r1182230 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182231
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestTaskImpl.java
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125800#comment-13125800 ]
Hudson commented on MAPREDUCE-3125:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #37 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/37/])
MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
svn merge -c r1182230 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182231
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestTaskImpl.java
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-3125:
-------------------------------------
Attachment: Screen shot 2011-09-29 at 5.20.27 PM.png
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125729#comment-13125729 ]
Hudson commented on MAPREDUCE-3125:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1139 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1139/])
MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182230
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestTaskImpl.java
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hitesh Shah updated MAPREDUCE-3125:
-----------------------------------
Status: Patch Available (was: Open)
Verified fix locally by running the same command as mentioned in the description.
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125735#comment-13125735 ]
Hudson commented on MAPREDUCE-3125:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1061 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1061/])
MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182230
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestTaskImpl.java
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125743#comment-13125743 ]
Hudson commented on MAPREDUCE-3125:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1081 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1081/])
MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182230
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestTaskImpl.java
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hitesh Shah updated MAPREDUCE-3125:
-----------------------------------
Attachment: MR-3125.1.patch
Minor change to check only non-failed/non-killed attempts when selecting the best attempt.
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3125) app master web UI shows reduce
task progress 100% even though reducers not complete and state
running/scheduled
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125830#comment-13125830 ]
Hudson commented on MAPREDUCE-3125:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #858 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/858/])
MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182230
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestTaskImpl.java
> app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled
> ---------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3125
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3125
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: MR-3125.1.patch, Screen shot 2011-09-29 at 5.20.27 PM.png, Screen shot 2011-09-29 at 5.20.59 PM.png, Screen shot 2011-09-29 at 5.21.18 PM.png
>
>
> ran same command as MAPREDUCE-3124. The app master web ui was displaying the reduce task progress as 100% even though the states were still running/scheduled. Each of those reduce tasks had attempts that failed or killed and another one unassigned. Attaching screenshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira