You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Nigel Daley (JIRA)" <ji...@apache.org> on 2007/03/14 19:57:09 UTC

[jira] Created: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
--------------------------------------------------------------------------------------------

                 Key: HADOOP-1118
                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.12.0
            Reporter: Nigel Daley


I saw one NullPointerException in the JT log during a large sort run:

2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
        at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
        at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
        at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
        at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
        at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
        at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        at java.io.DataInputStream.readFully(DataInputStream.java:178)
        at java.io.DataInputStream.readFully(DataInputStream.java:152)
        at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
        at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
        at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
        at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HADOOP-1118:
----------------------------------

    Attachment:     (was: NPEReportChecksum.patch)

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Assigned To: Hairong Kuang
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Resolved: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting resolved HADOOP-1118.
----------------------------------

    Resolution: Duplicate

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>            Assignee: Hairong Kuang
>         Attachments: NPEChecksum.patch, NPEChecksum.patch, NPEChecksum1.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HADOOP-1118:
----------------------------------

    Attachment: NPEChecksum.patch

updating the patch...

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Assigned To: Hairong Kuang
>         Attachments: NPEChecksum.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Resolved: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang resolved HADOOP-1118.
-----------------------------------

    Resolution: Fixed

no longer a problem since the crc patch was in.

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>            Assignee: Hairong Kuang
>         Attachments: NPEChecksum.patch, NPEChecksum.patch, NPEChecksum1.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HADOOP-1118:
----------------------------------

    Attachment:     (was: NPEReportChecksum.patch)

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Assigned To: Hairong Kuang
>         Attachments: NPEChecksum.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Gautam Kowshik (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gautam Kowshik updated HADOOP-1118:
-----------------------------------

    Attachment: NPEChecksum.patch

Updated the patch with the right source paths

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Assigned To: Hairong Kuang
>         Attachments: NPEChecksum.patch, NPEChecksum.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Assigned: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang reassigned HADOOP-1118:
-------------------------------------

    Assignee: Hairong Kuang

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Assigned To: Hairong Kuang
>         Attachments: NPEReportChecksum.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nigel Daley updated HADOOP-1118:
--------------------------------

    Component/s:     (was: mapred)
                 dfs

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HADOOP-1118:
----------------------------------

    Attachment: NPEReportChecksum.patch

This is an updated patch for us to pinpoint the problem.

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Assigned To: Hairong Kuang
>         Attachments: NPEReportChecksum.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Reopened: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting reopened HADOOP-1118:
----------------------------------


Fixed elsewhere, so this shouldn't be marked "fixed".

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>            Assignee: Hairong Kuang
>         Attachments: NPEChecksum.patch, NPEChecksum.patch, NPEChecksum1.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HADOOP-1118:
----------------------------------

    Attachment: NPEChecksum1.patch

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>            Assignee: Hairong Kuang
>         Attachments: NPEChecksum.patch, NPEChecksum.patch, NPEChecksum1.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HADOOP-1118:
----------------------------------

    Attachment: NPEReportChecksum.patch

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Attachments: NPEReportChecksum.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HADOOP-1118:
----------------------------------

    Attachment: NPEReportChecksum.patch

This patch is for pinpointing the problem.

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Attachments: NPEReportChecksum.patch
>
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HADOOP-1118:
----------------------------------

    Attachment:     (was: NPEReportChecksum.patch)

> NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1118
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>
> I saw one NullPointerException in the JT log during a large sort run:
> 2007-03-14 08:36:10,210 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0002_m_037315_1: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:326)
>         at org.apache.hadoop.dfs.DistributedFileSystem.reportChecksumFailure(DistributedFileSystem.java:405)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.verifySum(ChecksumFileSystem.java:253)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.readBuffer(ChecksumFileSystem.java:211)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSInputChecker.read(ChecksumFileSystem.java:167)
>         at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:41)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.sync(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:45)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:55)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.