You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Hairong Kuang (JIRA)" <ji...@apache.org> on 2006/11/08 22:34:51 UTC

[jira] Created: (HADOOP-695) Unexpected NPE from the next method of StreamLineRecordReader fails map/reduce jobs

Unexpected NPE from the next method of StreamLineRecordReader fails map/reduce jobs
-----------------------------------------------------------------------------------

                 Key: HADOOP-695
                 URL: http://issues.apache.org/jira/browse/HADOOP-695
             Project: Hadoop
          Issue Type: Bug
          Components: contrib/streaming
    Affects Versions: 0.8.0
            Reporter: Hairong Kuang
         Assigned To: Hairong Kuang
             Fix For: 0.8.1


For some reason that I do not have much idea, if input of a map/reduce job is gzipped, an unexpected null pointer may be returned from UTF8ByteArrayUtils.readline in the next method of StreamLineRecordReader. However the pointer is read before a null pointer check is performed. Thus a NPE may be thrown and fail the job.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-695) Unexpected NPE from the next method of StreamLineRecordReader fails map/reduce jobs

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-695?page=all ]

Hairong Kuang updated HADOOP-695:
---------------------------------

    Attachment: NPE.patch

This patch avoids a NPE by performing a null pointer check before the pointer is read.

> Unexpected NPE from the next method of StreamLineRecordReader fails map/reduce jobs
> -----------------------------------------------------------------------------------
>
>                 Key: HADOOP-695
>                 URL: http://issues.apache.org/jira/browse/HADOOP-695
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>    Affects Versions: 0.8.0
>            Reporter: Hairong Kuang
>         Assigned To: Hairong Kuang
>             Fix For: 0.8.1
>
>         Attachments: NPE.patch
>
>
> For some reason that I do not have much idea, if input of a map/reduce job is gzipped, an unexpected null pointer may be returned from UTF8ByteArrayUtils.readline in the next method of StreamLineRecordReader. However the pointer is read before a null pointer check is performed. Thus a NPE may be thrown and fail the job.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-695) Unexpected NPE from the next method of StreamLineRecordReader fails map/reduce jobs

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-695?page=all ]

Hairong Kuang updated HADOOP-695:
---------------------------------

    Status: Patch Available  (was: Open)

> Unexpected NPE from the next method of StreamLineRecordReader fails map/reduce jobs
> -----------------------------------------------------------------------------------
>
>                 Key: HADOOP-695
>                 URL: http://issues.apache.org/jira/browse/HADOOP-695
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>    Affects Versions: 0.8.0
>            Reporter: Hairong Kuang
>         Assigned To: Hairong Kuang
>             Fix For: 0.9.0
>
>         Attachments: NPE.patch
>
>
> For some reason that I do not have much idea, if input of a map/reduce job is gzipped, an unexpected null pointer may be returned from UTF8ByteArrayUtils.readline in the next method of StreamLineRecordReader. However the pointer is read before a null pointer check is performed. Thus a NPE may be thrown and fail the job.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-695) Unexpected NPE from the next method of StreamLineRecordReader fails map/reduce jobs

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-695?page=all ]

Doug Cutting updated HADOOP-695:
--------------------------------

        Status: Resolved  (was: Patch Available)
    Resolution: Fixed

I just committed this.  Thanks, Hairong!

> Unexpected NPE from the next method of StreamLineRecordReader fails map/reduce jobs
> -----------------------------------------------------------------------------------
>
>                 Key: HADOOP-695
>                 URL: http://issues.apache.org/jira/browse/HADOOP-695
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>    Affects Versions: 0.8.0
>            Reporter: Hairong Kuang
>         Assigned To: Hairong Kuang
>             Fix For: 0.9.0
>
>         Attachments: NPE.patch
>
>
> For some reason that I do not have much idea, if input of a map/reduce job is gzipped, an unexpected null pointer may be returned from UTF8ByteArrayUtils.readline in the next method of StreamLineRecordReader. However the pointer is read before a null pointer check is performed. Thus a NPE may be thrown and fail the job.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira