You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Raghu Angadi (JIRA)" <ji...@apache.org> on 2008/03/29 00:30:24 UTC

[jira] Issue Comment Edited: (HADOOP-3118) Namenode NPE while loading fsimage after a cluster upgrade from older disk format

    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583236#action_12583236 ] 

rangadi edited comment on HADOOP-3118 at 3/28/08 4:29 PM:
---------------------------------------------------------------

I applied this patch to the same set up that had the previous NPE and got another one :

{noformat}
2008-03-28 23:28:31,020 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete: failed to remove /user/ran
gadi/10Mb-1 because it does not exist
2008-03-28 23:28:31,021 INFO org.apache.hadoop.dfs.Storage: Upgrading image directory /export/crawlspace/rangadi/hadoop-dir/de
fault/dfs/name.
   old LV = -11; old CTime = 0.
   new LV = -13; new CTime = 1206746911021
2008-03-28 23:28:31,034 ERROR org.apache.hadoop.dfs.NameNode: java.lang.NullPointerException
        at org.apache.hadoop.dfs.FSImage.writeINodeUnderConstruction(FSImage.java:999)
        at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4372)
        at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:791)
        at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:276)
        at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
        at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
        at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
        at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
        at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
        at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
{noformat}
not sure if these are related.


      was (Author: rangadi):
    I applied this patch to the same set up that had the previous NPE and got another one :

{noformat}
2008-03-28 23:28:31,020 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete: failed to remove /user/ran
gadi/10Mb-1 because it does not exist
2008-03-28 23:28:31,021 INFO org.apache.hadoop.dfs.Storage: Upgrading image directory /export/crawlspace/rangadi/hadoop-dir/de
fault/dfs/name.
   old LV = -11; old CTime = 0.
   new LV = -13; new CTime = 1206746911021
2008-03-28 23:28:31,034 ERROR org.apache.hadoop.dfs.NameNode: java.lang.NullPointerException
        at org.apache.hadoop.dfs.FSImage.writeINodeUnderConstruction(FSImage.java:999)
        at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4372)
        at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:791)
        at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:276)
        at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
        at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
        at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
        at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
        at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
        at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
{noformat}
not if these are related.

  
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
>                 Key: HADOOP-3118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3118
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>            Priority: Blocker
>             Fix For: 0.17.0
>
>         Attachments: loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode: 
> java.lang.NullPointerException
>          at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
>          at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
>          at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
>          at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
>          at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
>          at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
>          at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
>          at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
>          at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
>          at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
>          at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
>          at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
>          at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
>          at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
>          at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.