You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2009/12/18 05:26:18 UTC

[jira] Created: (MAPREDUCE-1311) TestStreamingExitStatus fails on hudson patch builds

TestStreamingExitStatus fails on hudson patch builds
----------------------------------------------------

                 Key: MAPREDUCE-1311
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1311
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: test
            Reporter: Amareshwari Sriramadasu


TestStreamingExitStatus fails on hudson patch builds. The logs have the following error :
{noformat}
09/12/16 20:30:58 INFO fs.FSInputChecker: Found checksum error: b[0, 6]=68656c6c6f0a
org.apache.hadoop.fs.ChecksumException: Checksum error: file:/grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h3.grid.sp2.yahoo.net/trunk/build/contrib/streaming/test/data/input.txt at 0
	at org.apache.hadoop.fs.FSInputChecker.verifySum(FSInputChecker.java:278)
	at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:242)
	at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:190)
	at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:158)
	at java.io.DataInputStream.read(DataInputStream.java:83)
	at org.apache.hadoop.util.LineReader.readLine(LineReader.java:134)
	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:180)
	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:45)
	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:206)
	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:191)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
	at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:376)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:257)
09/12/16 20:30:58 INFO streaming.PipeMapRed: MRErrorThread done
{noformat}

The same passes on my local machine.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (MAPREDUCE-1311) TestStreamingExitStatus fails on hudson patch builds

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon resolved MAPREDUCE-1311.
------------------------------------

    Resolution: Duplicate

MAPREDUCE-1155 fixes this, resolving dup

> TestStreamingExitStatus fails on hudson patch builds
> ----------------------------------------------------
>
>                 Key: MAPREDUCE-1311
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1311
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>            Reporter: Amareshwari Sriramadasu
>
> TestStreamingExitStatus fails on hudson patch builds. The logs have the following error :
> {noformat}
> 09/12/16 20:30:58 INFO fs.FSInputChecker: Found checksum error: b[0, 6]=68656c6c6f0a
> org.apache.hadoop.fs.ChecksumException: Checksum error: file:/grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h3.grid.sp2.yahoo.net/trunk/build/contrib/streaming/test/data/input.txt at 0
> 	at org.apache.hadoop.fs.FSInputChecker.verifySum(FSInputChecker.java:278)
> 	at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:242)
> 	at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:190)
> 	at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:158)
> 	at java.io.DataInputStream.read(DataInputStream.java:83)
> 	at org.apache.hadoop.util.LineReader.readLine(LineReader.java:134)
> 	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:180)
> 	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:45)
> 	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:206)
> 	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:191)
> 	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
> 	at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:376)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:257)
> 09/12/16 20:30:58 INFO streaming.PipeMapRed: MRErrorThread done
> {noformat}
> The same passes on my local machine.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1311) TestStreamingExitStatus fails on hudson patch builds

Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792330#action_12792330 ] 

Amareshwari Sriramadasu commented on MAPREDUCE-1311:
----------------------------------------------------

The failure log for one of the builds is @
http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/203/testReport/org.apache.hadoop.streaming/TestStreamingExitStatus/testMapFailOk/

> TestStreamingExitStatus fails on hudson patch builds
> ----------------------------------------------------
>
>                 Key: MAPREDUCE-1311
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1311
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>            Reporter: Amareshwari Sriramadasu
>
> TestStreamingExitStatus fails on hudson patch builds. The logs have the following error :
> {noformat}
> 09/12/16 20:30:58 INFO fs.FSInputChecker: Found checksum error: b[0, 6]=68656c6c6f0a
> org.apache.hadoop.fs.ChecksumException: Checksum error: file:/grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h3.grid.sp2.yahoo.net/trunk/build/contrib/streaming/test/data/input.txt at 0
> 	at org.apache.hadoop.fs.FSInputChecker.verifySum(FSInputChecker.java:278)
> 	at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:242)
> 	at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:190)
> 	at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:158)
> 	at java.io.DataInputStream.read(DataInputStream.java:83)
> 	at org.apache.hadoop.util.LineReader.readLine(LineReader.java:134)
> 	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:180)
> 	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:45)
> 	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:206)
> 	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:191)
> 	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
> 	at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:376)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:257)
> 09/12/16 20:30:58 INFO streaming.PipeMapRed: MRErrorThread done
> {noformat}
> The same passes on my local machine.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1311) TestStreamingExitStatus fails on hudson patch builds

Posted by "Kay Kay (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796314#action_12796314 ] 

Kay Kay commented on MAPREDUCE-1311:
------------------------------------

MAPREDUCE-1346 addresses the same issue but due to invalid test fixtures of contrib/streaming of not deleting files properly. 

> TestStreamingExitStatus fails on hudson patch builds
> ----------------------------------------------------
>
>                 Key: MAPREDUCE-1311
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1311
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>            Reporter: Amareshwari Sriramadasu
>
> TestStreamingExitStatus fails on hudson patch builds. The logs have the following error :
> {noformat}
> 09/12/16 20:30:58 INFO fs.FSInputChecker: Found checksum error: b[0, 6]=68656c6c6f0a
> org.apache.hadoop.fs.ChecksumException: Checksum error: file:/grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h3.grid.sp2.yahoo.net/trunk/build/contrib/streaming/test/data/input.txt at 0
> 	at org.apache.hadoop.fs.FSInputChecker.verifySum(FSInputChecker.java:278)
> 	at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:242)
> 	at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:190)
> 	at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:158)
> 	at java.io.DataInputStream.read(DataInputStream.java:83)
> 	at org.apache.hadoop.util.LineReader.readLine(LineReader.java:134)
> 	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:180)
> 	at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:45)
> 	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:206)
> 	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:191)
> 	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
> 	at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:376)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:257)
> 09/12/16 20:30:58 INFO streaming.PipeMapRed: MRErrorThread done
> {noformat}
> The same passes on my local machine.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.