You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "dhruba borthakur (JIRA)" <ji...@apache.org> on 2008/03/28 18:52:28 UTC
[jira] Created: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Namenode NPE while loading fsimage after a cluster upgrade from older disk format
---------------------------------------------------------------------------------
Key: HADOOP-3118
URL: https://issues.apache.org/jira/browse/HADOOP-3118
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Reporter: dhruba borthakur
Assignee: dhruba borthakur
FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
java.lang.NullPointerException
at
org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
at
org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
at
org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
at
org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
at
org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583277#action_12583277 ]
dhruba borthakur commented on HADOOP-3118:
------------------------------------------
This affects version 0.17. However, the drop-down list for "Affects version" does not yet have a 0.17 value.
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler updated HADOOP-3118:
------------------------------------
Priority: Blocker (was: Major)
0.17? Yes!
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3118:
-------------------------------------
Status: Open (was: Patch Available)
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584991#action_12584991 ]
Hadoop QA commented on HADOOP-3118:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12379210/loadImageNPE.patch
against trunk revision 643282.
@author +1. The patch does not contain any @author tags.
tests included -1. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2133/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2133/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2133/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2133/console
This message is automatically generated.
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584446#action_12584446 ]
Hadoop QA commented on HADOOP-3118:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12378879/loadImageNPE.patch
against trunk revision 643282.
@author +1. The patch does not contain any @author tags.
tests included -1. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2120/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2120/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2120/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2120/console
This message is automatically generated.
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch, loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HADOOP-3118) Namenode NPE while
loading fsimage after a cluster upgrade from older disk format
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583236#action_12583236 ]
rangadi edited comment on HADOOP-3118 at 3/28/08 4:29 PM:
---------------------------------------------------------------
I applied this patch to the same set up that had the previous NPE and got another one :
{noformat}
2008-03-28 23:28:31,020 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete: failed to remove /user/ran
gadi/10Mb-1 because it does not exist
2008-03-28 23:28:31,021 INFO org.apache.hadoop.dfs.Storage: Upgrading image directory /export/crawlspace/rangadi/hadoop-dir/de
fault/dfs/name.
old LV = -11; old CTime = 0.
new LV = -13; new CTime = 1206746911021
2008-03-28 23:28:31,034 ERROR org.apache.hadoop.dfs.NameNode: java.lang.NullPointerException
at org.apache.hadoop.dfs.FSImage.writeINodeUnderConstruction(FSImage.java:999)
at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4372)
at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:791)
at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:276)
at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
{noformat}
not sure if these are related.
was (Author: rangadi):
I applied this patch to the same set up that had the previous NPE and got another one :
{noformat}
2008-03-28 23:28:31,020 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete: failed to remove /user/ran
gadi/10Mb-1 because it does not exist
2008-03-28 23:28:31,021 INFO org.apache.hadoop.dfs.Storage: Upgrading image directory /export/crawlspace/rangadi/hadoop-dir/de
fault/dfs/name.
old LV = -11; old CTime = 0.
new LV = -13; new CTime = 1206746911021
2008-03-28 23:28:31,034 ERROR org.apache.hadoop.dfs.NameNode: java.lang.NullPointerException
at org.apache.hadoop.dfs.FSImage.writeINodeUnderConstruction(FSImage.java:999)
at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4372)
at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:791)
at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:276)
at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
{noformat}
not if these are related.
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3118:
-------------------------------------
Status: Patch Available (was: Open)
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3118:
-------------------------------------
Status: Patch Available (was: Open)
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch, loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585092#action_12585092 ]
Hudson commented on HADOOP-3118:
--------------------------------
Integrated in Hadoop-trunk #450 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/450/])
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3118:
-------------------------------------
Attachment: loadImageNPE.patch
Hi Raghu, The earlier patch had a bug that caused locations of the last block of the file (that is stored in the lease) to be stored as null. Sorry. I have tested this patch and it should work.
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch, loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583236#action_12583236 ]
Raghu Angadi commented on HADOOP-3118:
--------------------------------------
I applied this patch to the same set up that had the previous NPE and got another one :
{noformat}
2008-03-28 23:28:31,020 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete: failed to remove /user/ran
gadi/10Mb-1 because it does not exist
2008-03-28 23:28:31,021 INFO org.apache.hadoop.dfs.Storage: Upgrading image directory /export/crawlspace/rangadi/hadoop-dir/de
fault/dfs/name.
old LV = -11; old CTime = 0.
new LV = -13; new CTime = 1206746911021
2008-03-28 23:28:31,034 ERROR org.apache.hadoop.dfs.NameNode: java.lang.NullPointerException
at org.apache.hadoop.dfs.FSImage.writeINodeUnderConstruction(FSImage.java:999)
at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4372)
at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:791)
at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:276)
at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
{noformat}
not if these are related.
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3118:
-------------------------------------
Attachment: loadImageNPE.patch
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Attachments: loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583243#action_12583243 ]
Nigel Daley commented on HADOOP-3118:
-------------------------------------
Dhruba, can you set the Affects Version field?
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3118:
-------------------------------------
Fix Version/s: 0.17.0
The new disk format stores open lease for files that were being written to. When a old disk format is upgraded to the new format, the values inside the lease were not initialised. For example, the name of the client that holds the lease was erroneously set to null.
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3118:
-------------------------------------
Attachment: loadImageNPE.patch
Avoid initialization of lastLocations with an empty array object.
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3118:
-------------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this.
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3118) Namenode NPE while loading fsimage
after a cluster upgrade from older disk format
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583112#action_12583112 ]
Raghu Angadi commented on HADOOP-3118:
--------------------------------------
Could briefly describe the fix, though the patch looks simple? Should this be fixed for 0.17?
> Namenode NPE while loading fsimage after a cluster upgrade from older disk format
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-3118
> URL: https://issues.apache.org/jira/browse/HADOOP-3118
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Attachments: loadImageNPE.patch
>
>
> FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
> 2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
> at
> org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
> at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
> at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
> at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.