You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2011/05/16 19:19:47 UTC
[jira] [Created] (MAPREDUCE-2498) TestRaidShellFsck failing on
trunk
TestRaidShellFsck failing on trunk
----------------------------------
Key: MAPREDUCE-2498
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2498
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/raid
Affects Versions: 0.23.0
Reporter: Todd Lipcon
Priority: Critical
Fix For: 0.23.0
TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2 has been failing the last several builds:
Error Message: parity file not HARed after 40s
java.io.IOException: parity file not HARed after 40s
at org.apache.hadoop.raid.TestRaidShellFsck.raidTestFiles(TestRaidShellFsck.java:281)
at org.apache.hadoop.raid.TestRaidShellFsck.setUp(TestRaidShellFsck.java:181)
at org.apache.hadoop.raid.TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2(TestRaidShellFsck.java:666)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2498) TestRaidShellFsck failing on
trunk
Posted by "Ramkumar Vadali (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13038091#comment-13038091 ]
Ramkumar Vadali commented on MAPREDUCE-2498:
--------------------------------------------
Another option is to use a MiniMRCluster in the raid test. I can make that change.
> TestRaidShellFsck failing on trunk
> ----------------------------------
>
> Key: MAPREDUCE-2498
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2498
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Assignee: Ramkumar Vadali
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: mapreduce-2498.txt
>
>
> TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2 has been failing the last several builds:
> Error Message: parity file not HARed after 40s
> java.io.IOException: parity file not HARed after 40s
> at org.apache.hadoop.raid.TestRaidShellFsck.raidTestFiles(TestRaidShellFsck.java:281)
> at org.apache.hadoop.raid.TestRaidShellFsck.setUp(TestRaidShellFsck.java:181)
> at org.apache.hadoop.raid.TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2(TestRaidShellFsck.java:666)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2498) TestRaidShellFsck failing on
trunk
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13034481#comment-13034481 ]
Hadoop QA commented on MAPREDUCE-2498:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12479397/mapreduce-2498.txt
against trunk revision 1103921.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/249//console
This message is automatically generated.
> TestRaidShellFsck failing on trunk
> ----------------------------------
>
> Key: MAPREDUCE-2498
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2498
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: mapreduce-2498.txt
>
>
> TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2 has been failing the last several builds:
> Error Message: parity file not HARed after 40s
> java.io.IOException: parity file not HARed after 40s
> at org.apache.hadoop.raid.TestRaidShellFsck.raidTestFiles(TestRaidShellFsck.java:281)
> at org.apache.hadoop.raid.TestRaidShellFsck.setUp(TestRaidShellFsck.java:181)
> at org.apache.hadoop.raid.TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2(TestRaidShellFsck.java:666)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2498) TestRaidShellFsck failing on
trunk
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated MAPREDUCE-2498:
-----------------------------------
Status: Open (was: Patch Available)
doh. looks like MAPREDUCE-2467 already added the maxmemory argument, but it's still failing.
Can someone tell if this is some kind of legitimate memory leak?
> TestRaidShellFsck failing on trunk
> ----------------------------------
>
> Key: MAPREDUCE-2498
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2498
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: mapreduce-2498.txt
>
>
> TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2 has been failing the last several builds:
> Error Message: parity file not HARed after 40s
> java.io.IOException: parity file not HARed after 40s
> at org.apache.hadoop.raid.TestRaidShellFsck.raidTestFiles(TestRaidShellFsck.java:281)
> at org.apache.hadoop.raid.TestRaidShellFsck.setUp(TestRaidShellFsck.java:181)
> at org.apache.hadoop.raid.TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2(TestRaidShellFsck.java:666)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-2498) TestRaidShellFsck failing on
trunk
Posted by "Ramkumar Vadali (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ramkumar Vadali reassigned MAPREDUCE-2498:
------------------------------------------
Assignee: Ramkumar Vadali (was: Todd Lipcon)
> TestRaidShellFsck failing on trunk
> ----------------------------------
>
> Key: MAPREDUCE-2498
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2498
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Assignee: Ramkumar Vadali
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: mapreduce-2498.txt
>
>
> TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2 has been failing the last several builds:
> Error Message: parity file not HARed after 40s
> java.io.IOException: parity file not HARed after 40s
> at org.apache.hadoop.raid.TestRaidShellFsck.raidTestFiles(TestRaidShellFsck.java:281)
> at org.apache.hadoop.raid.TestRaidShellFsck.setUp(TestRaidShellFsck.java:181)
> at org.apache.hadoop.raid.TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2(TestRaidShellFsck.java:666)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2498) TestRaidShellFsck failing on
trunk
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13034121#comment-13034121 ]
Todd Lipcon commented on MAPREDUCE-2498:
----------------------------------------
Looks like this failure is due to an OOME:
11/05/16 15:36:33 WARN mapred.LocalJobRunner: job_local_0003
java.lang.Exception: java.lang.OutOfMemoryError: Java heap space
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:387)
Caused by: java.lang.OutOfMemoryError: Java heap space
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:799)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:381)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:254)
> TestRaidShellFsck failing on trunk
> ----------------------------------
>
> Key: MAPREDUCE-2498
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2498
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Priority: Critical
> Fix For: 0.23.0
>
>
> TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2 has been failing the last several builds:
> Error Message: parity file not HARed after 40s
> java.io.IOException: parity file not HARed after 40s
> at org.apache.hadoop.raid.TestRaidShellFsck.raidTestFiles(TestRaidShellFsck.java:281)
> at org.apache.hadoop.raid.TestRaidShellFsck.setUp(TestRaidShellFsck.java:181)
> at org.apache.hadoop.raid.TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2(TestRaidShellFsck.java:666)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2498) TestRaidShellFsck failing on
trunk
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated MAPREDUCE-2498:
-----------------------------------
Attachment: mapreduce-2498.txt
Simple patch to up the maxmemory argument for the raid contrib to match the rest of the tests.
> TestRaidShellFsck failing on trunk
> ----------------------------------
>
> Key: MAPREDUCE-2498
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2498
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: mapreduce-2498.txt
>
>
> TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2 has been failing the last several builds:
> Error Message: parity file not HARed after 40s
> java.io.IOException: parity file not HARed after 40s
> at org.apache.hadoop.raid.TestRaidShellFsck.raidTestFiles(TestRaidShellFsck.java:281)
> at org.apache.hadoop.raid.TestRaidShellFsck.setUp(TestRaidShellFsck.java:181)
> at org.apache.hadoop.raid.TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2(TestRaidShellFsck.java:666)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-2498) TestRaidShellFsck failing on
trunk
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon reassigned MAPREDUCE-2498:
--------------------------------------
Assignee: Todd Lipcon
> TestRaidShellFsck failing on trunk
> ----------------------------------
>
> Key: MAPREDUCE-2498
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2498
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: mapreduce-2498.txt
>
>
> TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2 has been failing the last several builds:
> Error Message: parity file not HARed after 40s
> java.io.IOException: parity file not HARed after 40s
> at org.apache.hadoop.raid.TestRaidShellFsck.raidTestFiles(TestRaidShellFsck.java:281)
> at org.apache.hadoop.raid.TestRaidShellFsck.setUp(TestRaidShellFsck.java:181)
> at org.apache.hadoop.raid.TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2(TestRaidShellFsck.java:666)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2498) TestRaidShellFsck failing on
trunk
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated MAPREDUCE-2498:
-----------------------------------
Status: Patch Available (was: Open)
> TestRaidShellFsck failing on trunk
> ----------------------------------
>
> Key: MAPREDUCE-2498
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2498
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Priority: Critical
> Fix For: 0.23.0
>
> Attachments: mapreduce-2498.txt
>
>
> TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2 has been failing the last several builds:
> Error Message: parity file not HARed after 40s
> java.io.IOException: parity file not HARed after 40s
> at org.apache.hadoop.raid.TestRaidShellFsck.raidTestFiles(TestRaidShellFsck.java:281)
> at org.apache.hadoop.raid.TestRaidShellFsck.setUp(TestRaidShellFsck.java:181)
> at org.apache.hadoop.raid.TestRaidShellFsck.testFileBlockAndParityBlockMissingHar2(TestRaidShellFsck.java:666)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira