You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org> on 2009/05/19 07:24:46 UTC
[jira] Created: (HADOOP-5869) TestQueueCapacities timeout in trunk.
TestQueueCapacities timeout in trunk.
-------------------------------------
Key: HADOOP-5869
URL: https://issues.apache.org/jira/browse/HADOOP-5869
Project: Hadoop Core
Issue Type: Bug
Components: contrib/capacity-sched
Reporter: Sreekanth Ramakrishnan
TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
{noformat}
2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715373#action_12715373 ]
Sreekanth Ramakrishnan commented on HADOOP-5869:
------------------------------------------------
Currently, the TestQueueCapacities and MiniMRCluster tests in Capacity scheduler are broken because of Class not found exception, of Commons cli.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Sreekanth Ramakrishnan
> Attachments: thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-5869:
-------------------------------------------
Status: Open (was: Patch Available)
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716176#action_12716176 ]
Sreekanth Ramakrishnan commented on HADOOP-5869:
------------------------------------------------
Output from ant test-patch:
{noformat}
[exec]
[exec] -1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] -1 tests included. The patch doesn't appear to include any new or modified tests.
[exec] Please justify why no tests are needed for this patch.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
{noformat}
The patch fixes a test case failure and the test actually tests the bug.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-5869:
-------------------------------------------
Assignee: Sreekanth Ramakrishnan
Status: Patch Available (was: Open)
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Attachments: HADOOP-5869-1.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "gary murry (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
gary murry reopened HADOOP-5869:
--------------------------------
This was duped in Hadoop-5909 because it was failing again on Hudson (http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/868/).
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.20.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717844#action_12717844 ]
Hadoop QA commented on HADOOP-5869:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12410207/HADOOP-5869-3.patch
against trunk revision 783059.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/486/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/486/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/486/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/486/console
This message is automatically generated.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717589#action_12717589 ]
Hemanth Yamijala commented on HADOOP-5869:
------------------------------------------
I had a chat with Sreekanth on this one. We think the change in MiniMRCluster to remove waitTaskTrackers is an improvement that is not required for this bug fix. At the same time it is a useful improvement to consider (though the fix is possibly wrong and needs change). We will move this change to a separate JIRA to discuss further on the MiniMRCluster changes.
Also, I don't see this patch on Hudson's queue, though its been a while since it was submitted. I would recommend that tests be run locally on the new patch to verify it is working and then I can commit it. The bug has been open for a way too long time.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-5869:
-------------------------------------------
Status: Open (was: Patch Available)
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717883#action_12717883 ]
Sreekanth Ramakrishnan commented on HADOOP-5869:
------------------------------------------------
The failure in HDFS proxy is not related to the changes made in this patch. The test case fails with IOException in Configuration.config, whereas patch does not change anything related to configuration.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716159#action_12716159 ]
Amareshwari Sriramadasu commented on HADOOP-5869:
-------------------------------------------------
+1 for the patch. The issue was due to HADOOP-5850. Thanks Sreekanth for finding out.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Attachments: HADOOP-5869-1.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated HADOOP-5869:
---------------------------------------
Attachment: hadoop-5869.patch
this patch adds commons-cli-1.2 to the capacity scheduler's classpath
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Sreekanth Ramakrishnan
> Attachments: hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala resolved HADOOP-5869.
--------------------------------------
Resolution: Duplicate
HADOOP-6064 is the duplicate. I am resolving this issue because rather than fixing a different problem that shows up every time, I think it is better to just simplify this testcase drastically. That's the focus on HADOOP-6064. The other reason is that HADOOP-5869 is still a valid fix, and solves a problem correctly - just that now new symptoms are showing up. Please watch HADOOP-6064 if you are interested.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.20.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran updated HADOOP-5869:
-----------------------------------
Attachment: thread-dump.txt
I see this too. Here's a thread dump of the junit process while it appears to be waiting for something to finish.
At the very least the wait operation could do some timeouts so we'd get a better output in the log
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Sreekanth Ramakrishnan
> Attachments: thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-5869:
-------------------------------------------
Status: Patch Available (was: Open)
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-5869:
----------------------------------
Description:
TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
{noformat}
2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
{noformat}
was:
TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
{noformat}
2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
{noformat}
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Sreekanth Ramakrishnan
> Attachments: thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-5869:
-------------------------------------------
Status: Patch Available (was: Open)
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HADOOP-5869) TestQueueCapacities
timeout in trunk.
Posted by "gary murry (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720771#action_12720771 ]
gary murry edited comment on HADOOP-5869 at 6/17/09 1:41 PM:
-------------------------------------------------------------
TestQueueCapacities timed out again. (http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/868/).
was (Author: garymurry):
This was duped in HADOOP-5909 because it was failing again on Hudson (http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/868/).
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.20.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716240#action_12716240 ]
Sreekanth Ramakrishnan commented on HADOOP-5869:
------------------------------------------------
Ant test passed on my local box.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HADOOP-5869) TestQueueCapacities
timeout in trunk.
Posted by "gary murry (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720771#action_12720771 ]
gary murry edited comment on HADOOP-5869 at 6/17/09 10:27 AM:
--------------------------------------------------------------
This was duped in HADOOP-5909 because it was failing again on Hudson (http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/868/).
was (Author: garymurry):
This was duped in Hadoop-5909 because it was failing again on Hudson (http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/868/).
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.20.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-5869:
-------------------------------------------
Attachment: HADOOP-5869-3.patch
Attaching patch incorporating Hemanths Comments.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716204#action_12716204 ]
Sreekanth Ramakrishnan commented on HADOOP-5869:
------------------------------------------------
Same patch applies for branch 20.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-5869:
-------------------------------------------
Attachment: HADOOP-5869-1.patch
Attaching patch to fix this issue. Without this patch the test case does not pass, and with it it passes. Currently in {{TaskInProgress}} we check if the task is map task or reduce task and if the task is Setup or cleanup we assign appropriate split class and split bytes.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Sreekanth Ramakrishnan
> Attachments: HADOOP-5869-1.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713813#action_12713813 ]
Chris Douglas commented on HADOOP-5869:
---------------------------------------
Two issues are responsible for this. The first is HADOOP-5792, which caused TestQueueCapacities to fail. Once reverted, HADOOP-4981 evidently introduces a second regression, which was ignored because it was assumed that trunk remained the sole cause of the failure. Note that TestQueueCapacities is also failing in the 0.20 branch.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Sreekanth Ramakrishnan
> Attachments: thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated HADOOP-5869:
--------------------------------------------
Affects Version/s: 0.20.1
Fix Version/s: 0.20.1
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala updated HADOOP-5869:
-------------------------------------
Attachment: HADOOP-5869-3.20.patch
Patch file for Hadoop 0.20. Only changes path to the test directory.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.20.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala updated HADOOP-5869:
-------------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I committed this to trunk and the 0.20 branch. Thanks, Sreekanth !
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, HADOOP-5869-3.20.patch, HADOOP-5869-3.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716927#action_12716927 ]
Hadoop QA commented on HADOOP-5869:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12409841/HADOOP-5869-1.patch
against trunk revision 782083.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/474/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/474/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/474/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/474/console
This message is automatically generated.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716410#action_12716410 ]
Chris Douglas commented on HADOOP-5869:
---------------------------------------
My original comments were based on the results of a git-bisect from the last successful Hudson revision to HEAD (w/ 10 min timeout), identifying HADOOP-5792 as the first point where TestQueueCapacities started failing; dropping HADOOP-5792 from the tree identified HADOOP-4981 as a point where a failure resurfaced. I confirmed manually within the bisect branch before reopening the prenominate issues, but fresh subversion checkouts of the relevant revisions _do not_ exhibit the behavior I reported previously. I must be mistaken. Thanks for doing the real work on this, Sreekanth.
After applying the patch to a fresh checkout, the test still times out on my machine...
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5869) TestQueueCapacities timeout in
trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715883#action_12715883 ]
Sreekanth Ramakrishnan commented on HADOOP-5869:
------------------------------------------------
The reason why the test case is currently timing out in the trunk is because, currently frame work returns setup and cleanup tasks always as a map task no matter which slot is free on task tracker. Causing setup and cleanup tasks to block. This causes the {{ControlledMapReduceJob}} to wait forever.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Sreekanth Ramakrishnan
> Attachments: hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5869) TestQueueCapacities timeout in trunk.
Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sreekanth Ramakrishnan updated HADOOP-5869:
-------------------------------------------
Attachment: HADOOP-5869-2.patch
Attaching new patch correcting few issues:
* The tests were failing randomly because of a timing issue with regards to speculative tasks being launched. The speculative execution is currently disabled in this patch.
* The tests were timing out instead of assertion failing because, in {{MiniMRCluster.shutdown()}} we do a {{waitTaskTrackers()}}. In case of controlled jobs the trackers never get idle until we finish tasks, but then assertion has failed and we would have wait for test to time out.
> TestQueueCapacities timeout in trunk.
> -------------------------------------
>
> Key: HADOOP-5869
> URL: https://issues.apache.org/jira/browse/HADOOP-5869
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.1
> Reporter: Sreekanth Ramakrishnan
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.20.1
>
> Attachments: HADOOP-5869-1.patch, HADOOP-5869-2.patch, hadoop-5869.patch, thread-dump.txt
>
>
> TestQueueCapacities in trunk currently times out with message failed to fetch map-outputs. Stack trace is:
> {noformat}
> 2009-05-19 10:54:01,162 WARN org.apache.hadoop.mapred.ReduceTask: \
> attempt_200905191053_0001_r_000011_0 copy failed: attempt_200905191053_0001_m_000000_0 from localhost
> 2009-05-19 10:54:01,163 WARN org.apache.hadoop.mapred.ReduceTask: java.io.FileNotFoundException: \
> http://localhost:54203/mapOutput?job=job_200905191053_0001&map=attempt_200905191053_0001_m_000000_0&reduce=11
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1436)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1353)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1267)
> at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1199)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.