You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Joe Montanez <jm...@veoh.com> on 2009/01/13 18:53:30 UTC

Hadoop 0.17.1 => EOFException reading FSEdits file, what causes this? how to prevent?

Hi:

 

I'm using Hadoop 0.17.1 and I'm encountering EOFException reading the
FSEdits file.  I don't have a clear understanding what is causing this
and how to prevent this.  Has anyone seen this and can advise?

 

Thanks in advance,

Joe

 

2009-01-12 22:51:45,573 ERROR org.apache.hadoop.dfs.NameNode:
java.io.EOFException

        at java.io.DataInputStream.readFully(DataInputStream.java:180)

        at org.apache.hadoop.io.UTF8.readFields(UTF8.java:106)

        at
org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:90)

        at
org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:599)

        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)

        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)

        at
org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:223)

        at
org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)

        at
org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)

        at
org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)

        at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)

        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)

        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)

        at
org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:848)

        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:857)

 

2009-01-12 22:51:45,574 INFO org.apache.hadoop.dfs.NameNode:
SHUTDOWN_MSG:

Re: Hadoop 0.17.1 => EOFException reading FSEdits file, what causes this? how to prevent?

Posted by Aaron Kimball <aa...@cloudera.com>.
Does the file exist or maybe was it deleted? Also, are the permissions on
that directory set correctly, or could they have been changed out from under
you by accident?

- Aaron

On Tue, Jan 13, 2009 at 9:53 AM, Joe Montanez <jm...@veoh.com> wrote:

> Hi:
>
>
>
> I'm using Hadoop 0.17.1 and I'm encountering EOFException reading the
> FSEdits file.  I don't have a clear understanding what is causing this
> and how to prevent this.  Has anyone seen this and can advise?
>
>
>
> Thanks in advance,
>
> Joe
>
>
>
> 2009-01-12 22:51:45,573 ERROR org.apache.hadoop.dfs.NameNode:
> java.io.EOFException
>
>        at java.io.DataInputStream.readFully(DataInputStream.java:180)
>
>        at org.apache.hadoop.io.UTF8.readFields(UTF8.java:106)
>
>        at
> org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:90)
>
>        at
> org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:599)
>
>        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
>
>        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
>
>        at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:223)
>
>        at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
>
>        at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
>
>        at
> org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
>
>        at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
>
>        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
>
>        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
>
>        at
> org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:848)
>
>        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:857)
>
>
>
> 2009-01-12 22:51:45,574 INFO org.apache.hadoop.dfs.NameNode:
> SHUTDOWN_MSG:
>
>
>
>

Re: Hadoop 0.17.1 => EOFException reading FSEdits file, what causes this? how to prevent?

Posted by Rasit OZDAS <ra...@gmail.com>.
I would prefer catching the EOFException in my own code,
assuming you are happy with the output before exception occurs.

Hope this helps,
Rasit

2009/1/16 Konstantin Shvachko <sh...@yahoo-inc.com>

> Joe,
>
> It looks like you edits file is corrupted or truncated.
> Most probably the last modification was not written to it,
> when the name-node was turned off. This may happen if the
> node crashes depending on the underlying local file system I guess.
>
> Here are some options for you to consider:
> - try an alternative replica of the image directory if you had one.
> - try to edit the edits file if you know the internal format.
> - try to modify local copy of your name-node code, which should
> catch EOFException and ignore it.
> - Use a checkpointed image if you can afford to loose latest modifications
> to the fs.
> - Formatting of cause is the last resort since you loose everything.
>
> Thanks,
> --Konstantin
>
>
> Joe Montanez wrote:
>
>> Hi:
>>
>>
>> I'm using Hadoop 0.17.1 and I'm encountering EOFException reading the
>> FSEdits file.  I don't have a clear understanding what is causing this
>> and how to prevent this.  Has anyone seen this and can advise?
>>
>>
>> Thanks in advance,
>>
>> Joe
>>
>>
>> 2009-01-12 22:51:45,573 ERROR org.apache.hadoop.dfs.NameNode:
>> java.io.EOFException
>>
>>        at java.io.DataInputStream.readFully(DataInputStream.java:180)
>>
>>        at org.apache.hadoop.io.UTF8.readFields(UTF8.java:106)
>>
>>        at
>> org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:90)
>>
>>        at
>> org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:599)
>>
>>        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
>>
>>        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
>>
>>        at
>> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:223)
>>
>>        at
>> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
>>
>>        at
>> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
>>
>>        at
>> org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
>>
>>        at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
>>
>>        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
>>
>>        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
>>
>>        at
>> org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:848)
>>
>>        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:857)
>>
>>
>> 2009-01-12 22:51:45,574 INFO org.apache.hadoop.dfs.NameNode:
>> SHUTDOWN_MSG:
>>
>>
>>
>>


-- 
M. Raşit ÖZDAŞ

Re: Hadoop 0.17.1 => EOFException reading FSEdits file, what causes this? how to prevent?

Posted by Konstantin Shvachko <sh...@yahoo-inc.com>.
Joe,

It looks like you edits file is corrupted or truncated.
Most probably the last modification was not written to it,
when the name-node was turned off. This may happen if the
node crashes depending on the underlying local file system I guess.

Here are some options for you to consider:
- try an alternative replica of the image directory if you had one.
- try to edit the edits file if you know the internal format.
- try to modify local copy of your name-node code, which should
catch EOFException and ignore it.
- Use a checkpointed image if you can afford to loose latest modifications to the fs.
- Formatting of cause is the last resort since you loose everything.

Thanks,
--Konstantin

Joe Montanez wrote:
> Hi:
> 
>  
> 
> I'm using Hadoop 0.17.1 and I'm encountering EOFException reading the
> FSEdits file.  I don't have a clear understanding what is causing this
> and how to prevent this.  Has anyone seen this and can advise?
> 
>  
> 
> Thanks in advance,
> 
> Joe
> 
>  
> 
> 2009-01-12 22:51:45,573 ERROR org.apache.hadoop.dfs.NameNode:
> java.io.EOFException
> 
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
> 
>         at org.apache.hadoop.io.UTF8.readFields(UTF8.java:106)
> 
>         at
> org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:90)
> 
>         at
> org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:599)
> 
>         at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
> 
>         at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
> 
>         at
> org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:223)
> 
>         at
> org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
> 
>         at
> org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
> 
>         at
> org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
> 
>         at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
> 
>         at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
> 
>         at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
> 
>         at
> org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:848)
> 
>         at org.apache.hadoop.dfs.NameNode.main(NameNode.java:857)
> 
>  
> 
> 2009-01-12 22:51:45,574 INFO org.apache.hadoop.dfs.NameNode:
> SHUTDOWN_MSG:
> 
>  
> 
>