You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2010/03/05 08:03:27 UTC
[jira] Created: (MAPREDUCE-1562) TestBadRecords fails sometimes
TestBadRecords fails sometimes
------------------------------
Key: MAPREDUCE-1562
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1562
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: test
Reporter: Vinod K V
Fix For: 0.22.0
TestBadRecords.testMapRed fails sometimes. One instance of this was seen by Hudson while testing MAPREDUCE-890: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/342/testReport/.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1562) TestBadRecords fails sometimes
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841760#action_12841760 ]
Amareshwari Sriramadasu commented on MAPREDUCE-1562:
----------------------------------------------------
bq. I think we should fail any test immediately if MiniMRCluster fails to start even a single TT.
MAPREDUCE-1366 is open for this.
> TestBadRecords fails sometimes
> ------------------------------
>
> Key: MAPREDUCE-1562
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1562
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: consoleText
>
>
> TestBadRecords.testMapRed fails sometimes. One instance of this was seen by Hudson while testing MAPREDUCE-890: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/342/testReport/.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1562) TestBadRecords fails sometimes
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841746#action_12841746 ]
Vinod K V commented on MAPREDUCE-1562:
--------------------------------------
Two things I immediately can identify:
- One TT crashed because of jetty port problem, possibly related to HADOOP-6528
{code}
[exec] [junit] 2010-03-04 09:40:24,493 ERROR mapred.TaskTracker (TaskTracker.java:offerService(1460)) - Caught exception: java.io.IOException: Jetty problem. Jetty didn't bind to a valid port
[exec] [junit] at org.apache.hadoop.mapred.TaskTracker.checkJettyPort(TaskTracker.java:1276)
[exec] [junit] at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:1438)
[exec] [junit] at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:2256)
[exec] [junit] at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:228)
[exec] [junit] at java.lang.Thread.run(Thread.java:619)
{code}
I think we should fail *any* test immediately if MiniMRCluster fails to start even a single TT.
- Two, I see this 15 min wait (!!)
{code}
else if(MAPPER_BAD_RECORDS.get(2).equals(str)) {
try {
LOG.warn("MAP Encountered BAD record");
Thread.sleep(15*60*1000);
} catch (InterruptedException e) {
e.printStackTrace();
}
}
{code}
Not sure why this is not causing the test to fail all the time.
> TestBadRecords fails sometimes
> ------------------------------
>
> Key: MAPREDUCE-1562
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1562
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: consoleText
>
>
> TestBadRecords.testMapRed fails sometimes. One instance of this was seen by Hudson while testing MAPREDUCE-890: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/342/testReport/.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1562) TestBadRecords fails sometimes
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V updated MAPREDUCE-1562:
---------------------------------
Attachment: consoleText
Attaching Hudson's console-output for the test from MAPREDUCE-890.
> TestBadRecords fails sometimes
> ------------------------------
>
> Key: MAPREDUCE-1562
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1562
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: consoleText
>
>
> TestBadRecords.testMapRed fails sometimes. One instance of this was seen by Hudson while testing MAPREDUCE-890: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/342/testReport/.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.