You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Ben Cuthbert <be...@ymail.com> on 2012/02/18 09:20:33 UTC
namenode null pointer
All sometimes when I startup my hadoop I get the following error?
12/02/17 10:29:56 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host =iMac.local/192.168.0.191
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.203.0
STARTUP_MSG: build = http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203 -r 1099333; compiled by 'oom' on Wed May 4 07:57:50 PDT 2011
************************************************************/
12/02/17 10:29:56 WARN impl.MetricsSystemImpl: Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-namenode.properties, hadoop-metrics2.properties
2012-02-17 10:29:56.994 java[4065:1903] Unable to load realm info from SCDynamicStore
12/02/17 10:29:57 INFO util.GSet: VM type = 64-bit
12/02/17 10:29:57 INFO util.GSet: 2% max memory = 17.77875 MB
12/02/17 10:29:57 INFO util.GSet: capacity = 2^21 = 2097152 entries
12/02/17 10:29:57 INFO util.GSet: recommended=2097152, actual=2097152
12/02/17 10:29:57 INFO namenode.FSNamesystem: fsOwner=scottsue
12/02/17 10:29:57 INFO namenode.FSNamesystem: supergroup=supergroup
12/02/17 10:29:57 INFO namenode.FSNamesystem: isPermissionEnabled=true
12/02/17 10:29:57 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100
12/02/17 10:29:57 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
12/02/17 10:29:57 INFO namenode.FSNamesystem: Registered FSNamesystemStateMBean and NameNodeMXBean
12/02/17 10:29:57 INFO namenode.NameNode: Caching file names occuring more than 10 times
12/02/17 10:29:57 INFO common.Storage: Number of files = 190
12/02/17 10:29:57 INFO common.Storage: Number of files under construction = 0
12/02/17 10:29:57 INFO common.Storage: Image file of size 26377 loaded in 0 seconds.
12/02/17 10:29:57 ERROR namenode.NameNode: java.lang.NullPointerException
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:1113)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:1125)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addNode(FSDirectory.java:1028)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.unprotectedAddFile(FSDirectory.java:205)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:613)
at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:1009)
at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:827)
at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:365)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:97)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:379)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:353)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:254)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:434)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1153)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1162)
12/02/17 10:29:57 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at iMac.local/192.168.0.191
************************************************************/
Re: namenode null pointer
Posted by Ben Cuthbert <be...@ymail.com>.
So the filesystem has corrupted?
Regards
Ben
On 29 Feb 2012, at 05:51, madhu phatak wrote:
> Hi,
> This may be the issue with namenode is not correctly formatted.
>
> On Sat, Feb 18, 2012 at 1:50 PM, Ben Cuthbert <be...@ymail.com> wrote:
>
>> All sometimes when I startup my hadoop I get the following error
>>
>> 12/02/17 10:29:56 INFO namenode.NameNode: STARTUP_MSG:
>> /************************************************************
>> STARTUP_MSG: Starting NameNode
>> STARTUP_MSG: host =iMac.local/192.168.0.191
>> STARTUP_MSG: args = []
>> STARTUP_MSG: version = 0.20.203.0
>> STARTUP_MSG: build =
>> http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203-r 1099333; compiled by 'oom' on Wed May 4 07:57:50 PDT 2011
>> ************************************************************/
>> 12/02/17 10:29:56 WARN impl.MetricsSystemImpl: Metrics system not started:
>> Cannot locate configuration: tried hadoop-metrics2-namenode.properties,
>> hadoop-metrics2.properties
>> 2012-02-17 10:29:56.994 java[4065:1903] Unable to load realm info from
>> SCDynamicStore
>> 12/02/17 10:29:57 INFO util.GSet: VM type = 64-bit
>> 12/02/17 10:29:57 INFO util.GSet: 2% max memory = 17.77875 MB
>> 12/02/17 10:29:57 INFO util.GSet: capacity = 2^21 = 2097152 entries
>> 12/02/17 10:29:57 INFO util.GSet: recommended=2097152, actual=2097152
>> 12/02/17 10:29:57 INFO namenode.FSNamesystem: fsOwner=scottsue
>> 12/02/17 10:29:57 INFO namenode.FSNamesystem: supergroup=supergroup
>> 12/02/17 10:29:57 INFO namenode.FSNamesystem: isPermissionEnabled=true
>> 12/02/17 10:29:57 INFO namenode.FSNamesystem:
>> dfs.block.invalidate.limit=100
>> 12/02/17 10:29:57 INFO namenode.FSNamesystem: isAccessTokenEnabled=false
>> accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
>> 12/02/17 10:29:57 INFO namenode.FSNamesystem: Registered
>> FSNamesystemStateMBean and NameNodeMXBean
>> 12/02/17 10:29:57 INFO namenode.NameNode: Caching file names occuring more
>> than 10 times
>> 12/02/17 10:29:57 INFO common.Storage: Number of files = 190
>> 12/02/17 10:29:57 INFO common.Storage: Number of files under construction
>> = 0
>> 12/02/17 10:29:57 INFO common.Storage: Image file of size 26377 loaded in
>> 0 seconds.
>> 12/02/17 10:29:57 ERROR namenode.NameNode: java.lang.NullPointerException
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:1113)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:1125)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSDirectory.addNode(FSDirectory.java:1028)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSDirectory.unprotectedAddFile(FSDirectory.java:205)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:613)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:1009)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:827)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:365)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:97)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:379)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:353)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:254)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:434)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1153)
>> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1162)
>>
>> 12/02/17 10:29:57 INFO namenode.NameNode: SHUTDOWN_MSG:
>> /************************************************************
>> SHUTDOWN_MSG: Shutting down NameNode at iMac.local/192.168.0.191
>> ************************************************************/
>
>
>
>
> --
> Join me at http://hadoopworkshop.eventbrite.com/
Re: namenode null pointer
Posted by madhu phatak <ph...@gmail.com>.
Hi,
This may be the issue with namenode is not correctly formatted.
On Sat, Feb 18, 2012 at 1:50 PM, Ben Cuthbert <be...@ymail.com> wrote:
> All sometimes when I startup my hadoop I get the following error
>
> 12/02/17 10:29:56 INFO namenode.NameNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting NameNode
> STARTUP_MSG: host =iMac.local/192.168.0.191
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 0.20.203.0
> STARTUP_MSG: build =
> http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203-r 1099333; compiled by 'oom' on Wed May 4 07:57:50 PDT 2011
> ************************************************************/
> 12/02/17 10:29:56 WARN impl.MetricsSystemImpl: Metrics system not started:
> Cannot locate configuration: tried hadoop-metrics2-namenode.properties,
> hadoop-metrics2.properties
> 2012-02-17 10:29:56.994 java[4065:1903] Unable to load realm info from
> SCDynamicStore
> 12/02/17 10:29:57 INFO util.GSet: VM type = 64-bit
> 12/02/17 10:29:57 INFO util.GSet: 2% max memory = 17.77875 MB
> 12/02/17 10:29:57 INFO util.GSet: capacity = 2^21 = 2097152 entries
> 12/02/17 10:29:57 INFO util.GSet: recommended=2097152, actual=2097152
> 12/02/17 10:29:57 INFO namenode.FSNamesystem: fsOwner=scottsue
> 12/02/17 10:29:57 INFO namenode.FSNamesystem: supergroup=supergroup
> 12/02/17 10:29:57 INFO namenode.FSNamesystem: isPermissionEnabled=true
> 12/02/17 10:29:57 INFO namenode.FSNamesystem:
> dfs.block.invalidate.limit=100
> 12/02/17 10:29:57 INFO namenode.FSNamesystem: isAccessTokenEnabled=false
> accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
> 12/02/17 10:29:57 INFO namenode.FSNamesystem: Registered
> FSNamesystemStateMBean and NameNodeMXBean
> 12/02/17 10:29:57 INFO namenode.NameNode: Caching file names occuring more
> than 10 times
> 12/02/17 10:29:57 INFO common.Storage: Number of files = 190
> 12/02/17 10:29:57 INFO common.Storage: Number of files under construction
> = 0
> 12/02/17 10:29:57 INFO common.Storage: Image file of size 26377 loaded in
> 0 seconds.
> 12/02/17 10:29:57 ERROR namenode.NameNode: java.lang.NullPointerException
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:1113)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:1125)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirectory.addNode(FSDirectory.java:1028)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirectory.unprotectedAddFile(FSDirectory.java:205)
> at
> org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:613)
> at
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:1009)
> at
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:827)
> at
> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:365)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:97)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:379)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:353)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:254)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:434)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1153)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1162)
>
> 12/02/17 10:29:57 INFO namenode.NameNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down NameNode at iMac.local/192.168.0.191
> ************************************************************/
--
Join me at http://hadoopworkshop.eventbrite.com/