You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Wanjari, Amol" <am...@amazon.com> on 2008/08/04 11:53:48 UTC

EOFException while starting name node

I'm getting the following exceptions while starting the name node -

ERROR dfs.NameNode: java.io.EOFException
        at java.io.DataInputStream.readInt(DataInputStream.java:375)
        at
org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:87)
        at
org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:455)
        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:733)
        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:620)
        at
org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:222)
        at
org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:76)
        at
org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:221)
        at org.apache.hadoop.dfs.NameNode.init(NameNode.java:130)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:168)
        at
org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:795)
        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:804)

Is there a way to recover the name node without losing any data.

Thanks,
Amol

Re: EOFException while starting name node

Posted by steph <st...@conviva.com>.
2008-08-03 21:58:33,108 INFO org.apache.hadoop.ipc.Server: Stopping  
server on 9000
2008-08-03 21:58:33,109 ERROR org.apache.hadoop.dfs.NameNode:  
java.io.EOFException
	at java.io.DataInputStream.readFully(DataInputStream.java:178)
	at org.apache.hadoop.io.UTF8.readFields(UTF8.java:106)
	at org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:90)
	at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:433)
	at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:759)
	at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:639)
	at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java: 
222)
	at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:79)
	at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:254)
	at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
	at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:131)
	at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:176)
	at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:162)
	at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
	at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)


Actually my exception is slightly different than yours. Maybe moving  
edits file
and recreating a new one will work for you.


On Aug 4, 2008, at 2:53 AM, Wanjari, Amol wrote:

> I'm getting the following exceptions while starting the name node -
>
> ERROR dfs.NameNode: java.io.EOFException
>        at java.io.DataInputStream.readInt(DataInputStream.java:375)
>        at
> org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:87)
>        at
> org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:455)
>        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:733)
>        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:620)
>        at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:222)
>        at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:76)
>        at
> org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:221)
>        at org.apache.hadoop.dfs.NameNode.init(NameNode.java:130)
>        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:168)
>        at
> org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:795)
>        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:804)
>
> Is there a way to recover the name node without losing any data.
>
> Thanks,
> Amol

Re: EOFException while starting name node

Posted by steph <st...@conviva.com>.

I have the same thing:
ERROR dfs.NameNode: java.io.EOFException
        at java.io.DataInputStream.readInt(DataInputStream.java:375)
        at
org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:87)
        at
org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:455)
        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:733)
        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:620)
        at
org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:222)
        at
org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:76)
        at
org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:221)
        at org.apache.hadoop.dfs.NameNode.init(NameNode.java:130)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:168)
        at
org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:795)
        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:804)



I would appreciate any advice. I tried to move the 'edits' file and  
recreate a new one,
but that did not work.

Thanks,

S.

On Aug 4, 2008, at 2:53 AM, Wanjari, Amol wrote:

> I'm getting the following exceptions while starting the name node -
>
> ERROR dfs.NameNode: java.io.EOFException
>        at java.io.DataInputStream.readInt(DataInputStream.java:375)
>        at
> org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:87)
>        at
> org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:455)
>        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:733)
>        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:620)
>        at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:222)
>        at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:76)
>        at
> org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:221)
>        at org.apache.hadoop.dfs.NameNode.init(NameNode.java:130)
>        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:168)
>        at
> org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:795)
>        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:804)
>
> Is there a way to recover the name node without losing any data.
>
> Thanks,
> Amol

Re: EOFException while starting name node

Posted by steph <st...@conviva.com>.

I have the same thing:
ERROR dfs.NameNode: java.io.EOFException
        at java.io.DataInputStream.readInt(DataInputStream.java:375)
        at
org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:87)
        at
org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:455)
        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:733)
        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:620)
        at
org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:222)
        at
org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:76)
        at
org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:221)
        at org.apache.hadoop.dfs.NameNode.init(NameNode.java:130)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:168)
        at
org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:795)
        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:804)



I would appreciate any advice. I tried to move the 'edits' file and  
recreate a new one,
but that did not work.

Thanks,

S.

On Aug 4, 2008, at 2:53 AM, Wanjari, Amol wrote:

> I'm getting the following exceptions while starting the name node -
>
> ERROR dfs.NameNode: java.io.EOFException
>        at java.io.DataInputStream.readInt(DataInputStream.java:375)
>        at
> org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:87)
>        at
> org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:455)
>        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:733)
>        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:620)
>        at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:222)
>        at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:76)
>        at
> org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:221)
>        at org.apache.hadoop.dfs.NameNode.init(NameNode.java:130)
>        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:168)
>        at
> org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:795)
>        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:804)
>
> Is there a way to recover the name node without losing any data.
>
> Thanks,
> Amol