You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "stack@archive.org (JIRA)" <ji...@apache.org> on 2006/05/15 20:21:06 UTC
[jira] Created: (HADOOP-219) SequenceFile#handleChecksumException
NPE
SequenceFile#handleChecksumException NPE
----------------------------------------
Key: HADOOP-219
URL: http://issues.apache.org/jira/browse/HADOOP-219
Project: Hadoop
Type: Bug
Components: io
Reporter: stack@archive.org
Priority: Trivial
The SequenceFile#handleChecksumException assumes the conf data member has been set. It will not be set if we use the 'Reader(FileSystem fs, Path file, int bufferSize, long start, long length)' constructor. The latter is used by ReduceTask Sorter:
java.lang.NullPointerException
at org.apache.hadoop.io.SequenceFile$Reader.handleChecksumException(SequenceFile.java:407)
at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:400)
at org.apache.hadoop.io.SequenceFile$Sorter$MergeStream.next(SequenceFile.java:837)
at org.apache.hadoop.io.SequenceFile$Sorter$MergeQueue.merge(SequenceFile.java:881)
at org.apache.hadoop.io.SequenceFile$Sorter$MergePass.run(SequenceFile.java:766)
at org.apache.hadoop.io.SequenceFile$Sorter.mergePass(SequenceFile.java:702)
at org.apache.hadoop.io.SequenceFile$Sorter.sort(SequenceFile.java:528)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:253)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:787)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Closed: (HADOOP-219) SequenceFile#handleChecksumException
NPE
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-219?page=all ]
Doug Cutting closed HADOOP-219:
-------------------------------
> SequenceFile#handleChecksumException NPE
> ----------------------------------------
>
> Key: HADOOP-219
> URL: http://issues.apache.org/jira/browse/HADOOP-219
> Project: Hadoop
> Type: Bug
> Components: io
> Reporter: stack@archive.org
> Assignee: Doug Cutting
> Priority: Trivial
> Fix For: 0.3.0
> Attachments: hadoop-219.patch
>
> The SequenceFile#handleChecksumException assumes the conf data member has been set. It will not be set if we use the 'Reader(FileSystem fs, Path file, int bufferSize, long start, long length)' constructor. The latter is used by ReduceTask Sorter:
> java.lang.NullPointerException
> at org.apache.hadoop.io.SequenceFile$Reader.handleChecksumException(SequenceFile.java:407)
> at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:400)
> at org.apache.hadoop.io.SequenceFile$Sorter$MergeStream.next(SequenceFile.java:837)
> at org.apache.hadoop.io.SequenceFile$Sorter$MergeQueue.merge(SequenceFile.java:881)
> at org.apache.hadoop.io.SequenceFile$Sorter$MergePass.run(SequenceFile.java:766)
> at org.apache.hadoop.io.SequenceFile$Sorter.mergePass(SequenceFile.java:702)
> at org.apache.hadoop.io.SequenceFile$Sorter.sort(SequenceFile.java:528)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:253)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:787)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-219) SequenceFile#handleChecksumException
NPE
Posted by "stack@archive.org (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-219?page=all ]
stack@archive.org updated HADOOP-219:
-------------------------------------
Attachment: hadoop-219.patch
If no conf, default to throwing the checksum error.
> SequenceFile#handleChecksumException NPE
> ----------------------------------------
>
> Key: HADOOP-219
> URL: http://issues.apache.org/jira/browse/HADOOP-219
> Project: Hadoop
> Type: Bug
> Components: io
> Reporter: stack@archive.org
> Priority: Trivial
> Attachments: hadoop-219.patch
>
> The SequenceFile#handleChecksumException assumes the conf data member has been set. It will not be set if we use the 'Reader(FileSystem fs, Path file, int bufferSize, long start, long length)' constructor. The latter is used by ReduceTask Sorter:
> java.lang.NullPointerException
> at org.apache.hadoop.io.SequenceFile$Reader.handleChecksumException(SequenceFile.java:407)
> at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:400)
> at org.apache.hadoop.io.SequenceFile$Sorter$MergeStream.next(SequenceFile.java:837)
> at org.apache.hadoop.io.SequenceFile$Sorter$MergeQueue.merge(SequenceFile.java:881)
> at org.apache.hadoop.io.SequenceFile$Sorter$MergePass.run(SequenceFile.java:766)
> at org.apache.hadoop.io.SequenceFile$Sorter.mergePass(SequenceFile.java:702)
> at org.apache.hadoop.io.SequenceFile$Sorter.sort(SequenceFile.java:528)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:253)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:787)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Resolved: (HADOOP-219) SequenceFile#handleChecksumException
NPE
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-219?page=all ]
Doug Cutting resolved HADOOP-219:
---------------------------------
Fix Version: 0.3
Resolution: Fixed
Assign To: Doug Cutting
I just committed a fix for this. Instead of checking for a null configuration, I tried to make sure that a non-null configuration is always available. Thanks, Michael!
> SequenceFile#handleChecksumException NPE
> ----------------------------------------
>
> Key: HADOOP-219
> URL: http://issues.apache.org/jira/browse/HADOOP-219
> Project: Hadoop
> Type: Bug
> Components: io
> Reporter: stack@archive.org
> Assignee: Doug Cutting
> Priority: Trivial
> Fix For: 0.3
> Attachments: hadoop-219.patch
>
> The SequenceFile#handleChecksumException assumes the conf data member has been set. It will not be set if we use the 'Reader(FileSystem fs, Path file, int bufferSize, long start, long length)' constructor. The latter is used by ReduceTask Sorter:
> java.lang.NullPointerException
> at org.apache.hadoop.io.SequenceFile$Reader.handleChecksumException(SequenceFile.java:407)
> at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:400)
> at org.apache.hadoop.io.SequenceFile$Sorter$MergeStream.next(SequenceFile.java:837)
> at org.apache.hadoop.io.SequenceFile$Sorter$MergeQueue.merge(SequenceFile.java:881)
> at org.apache.hadoop.io.SequenceFile$Sorter$MergePass.run(SequenceFile.java:766)
> at org.apache.hadoop.io.SequenceFile$Sorter.mergePass(SequenceFile.java:702)
> at org.apache.hadoop.io.SequenceFile$Sorter.sort(SequenceFile.java:528)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:253)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:787)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira