You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Furkan Bıçak <bi...@gmail.com> on 2013/10/03 09:44:41 UTC

Secondary NameNode doCheckpoint Exception

Hi Everyone,

I am starting my hadoop cluster manually from Java which works fine 
until some time. When secondary NameNode tries to do merge it gives me 
the following exception:

---------------------------
13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception 
in doCheckpoint:
13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: 
java.lang.AssertionError: Negative layout version is expected.
     at 
org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
     at java.lang.Thread.run(Thread.java:724)

java.lang.AssertionError: Negative layout version is expected.
     at 
org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
     at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
     at java.lang.Thread.run(Thread.java:724)
---------------------------

What causes this exception to occur?
Any help would be appreciated!

Kind Regards,

Furkan Bicak.


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Hi,

I have noticed that this exception occurs when I start the cluster from 
a JUnit test case. If the cluster is started from a main method, it 
doesn't give any exception at all. What may differ between these cases 
so that SecondaryNameNode cannot do the merge operation?

Thanks,

Frkn.

On 03-10-2013 10:52, Furkan Bıçak wrote:
> On 03-10-2013 10:44, Furkan Bıçak wrote:
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine 
>> until some time. When secondary NameNode tries to do merge it gives 
>> me the following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable 
>> Exception in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: 
>> java.lang.AssertionError: Negative layout version is expected.
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>     at java.lang.Thread.run(Thread.java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>     at java.lang.Thread.run(Thread.java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
> I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Hi,

Content of the VERSION file of NameNode is as follows:
-----------------------------------------------------
#Thu Oct 03 11:20:57 EEST 2013
namespaceID=1005981884
cTime=0
storageType=NAME_NODE
layoutVersion=-41
-----------------------------------------------------

However, I could not find any VERSION file for Secondary NameNode. Just 
to mention, I am using Pseudo-Distributed Mode.

Thanks.

On 03-10-2013 11:23, Jitendra Yadav wrote:
> Hi,
>
> There is some layout Version value issue in your VERSION file. Can you 
> please share the VERSION file content from NN and SNN ?
>
> ${dfs.name.dir}/current/VERSION
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>         Hi Everyone,
>
>         I am starting my hadoop cluster manually from Java which works
>         fine until some time. When secondary NameNode tries to do
>         merge it gives me the following exception:
>
>         ---------------------------
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable
>         Exception in doCheckpoint:
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>         ---------------------------
>
>         What causes this exception to occur?
>         Any help would be appreciated!
>
>         Kind Regards,
>
>         Furkan Bicak.
>
>     I forgot to mention the hadoop version. I am using hadoop 1.2.1
>     version.
>
>     Thanks.
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Hi,

Content of the VERSION file of NameNode is as follows:
-----------------------------------------------------
#Thu Oct 03 11:20:57 EEST 2013
namespaceID=1005981884
cTime=0
storageType=NAME_NODE
layoutVersion=-41
-----------------------------------------------------

However, I could not find any VERSION file for Secondary NameNode. Just 
to mention, I am using Pseudo-Distributed Mode.

Thanks.

On 03-10-2013 11:23, Jitendra Yadav wrote:
> Hi,
>
> There is some layout Version value issue in your VERSION file. Can you 
> please share the VERSION file content from NN and SNN ?
>
> ${dfs.name.dir}/current/VERSION
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>         Hi Everyone,
>
>         I am starting my hadoop cluster manually from Java which works
>         fine until some time. When secondary NameNode tries to do
>         merge it gives me the following exception:
>
>         ---------------------------
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable
>         Exception in doCheckpoint:
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>         ---------------------------
>
>         What causes this exception to occur?
>         Any help would be appreciated!
>
>         Kind Regards,
>
>         Furkan Bicak.
>
>     I forgot to mention the hadoop version. I am using hadoop 1.2.1
>     version.
>
>     Thanks.
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Hi,

Content of the VERSION file of NameNode is as follows:
-----------------------------------------------------
#Thu Oct 03 11:20:57 EEST 2013
namespaceID=1005981884
cTime=0
storageType=NAME_NODE
layoutVersion=-41
-----------------------------------------------------

However, I could not find any VERSION file for Secondary NameNode. Just 
to mention, I am using Pseudo-Distributed Mode.

Thanks.

On 03-10-2013 11:23, Jitendra Yadav wrote:
> Hi,
>
> There is some layout Version value issue in your VERSION file. Can you 
> please share the VERSION file content from NN and SNN ?
>
> ${dfs.name.dir}/current/VERSION
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>         Hi Everyone,
>
>         I am starting my hadoop cluster manually from Java which works
>         fine until some time. When secondary NameNode tries to do
>         merge it gives me the following exception:
>
>         ---------------------------
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable
>         Exception in doCheckpoint:
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>         ---------------------------
>
>         What causes this exception to occur?
>         Any help would be appreciated!
>
>         Kind Regards,
>
>         Furkan Bicak.
>
>     I forgot to mention the hadoop version. I am using hadoop 1.2.1
>     version.
>
>     Thanks.
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Hi,

Content of the VERSION file of NameNode is as follows:
-----------------------------------------------------
#Thu Oct 03 11:20:57 EEST 2013
namespaceID=1005981884
cTime=0
storageType=NAME_NODE
layoutVersion=-41
-----------------------------------------------------

However, I could not find any VERSION file for Secondary NameNode. Just 
to mention, I am using Pseudo-Distributed Mode.

Thanks.

On 03-10-2013 11:23, Jitendra Yadav wrote:
> Hi,
>
> There is some layout Version value issue in your VERSION file. Can you 
> please share the VERSION file content from NN and SNN ?
>
> ${dfs.name.dir}/current/VERSION
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>         Hi Everyone,
>
>         I am starting my hadoop cluster manually from Java which works
>         fine until some time. When secondary NameNode tries to do
>         merge it gives me the following exception:
>
>         ---------------------------
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable
>         Exception in doCheckpoint:
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>         ---------------------------
>
>         What causes this exception to occur?
>         Any help would be appreciated!
>
>         Kind Regards,
>
>         Furkan Bicak.
>
>     I forgot to mention the hadoop version. I am using hadoop 1.2.1
>     version.
>
>     Thanks.
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Hi,

There is some layout Version value issue in your VERSION file. Can you
please share the VERSION file content from NN and SNN ?

${dfs.name.dir}/current/VERSION

Regards
Jitendra


On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:

> On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine until
>> some time. When secondary NameNode tries to do merge it gives me the
>> following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>> in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
>>  I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
What I simply do is starting NameNode, DataNode, SecondaryNameNode, 
JobTracker and TaskTracker respectively. Why would SecondaryNameNode 
throws an exception when doing merge. Am I missing some configurations? 
Or how can I set checkpoint period?

Thanks,
Frkn.

On 03-10-2013 13:18, Furkan Bıçak wrote:
> Yes, I am doing some development and starting my hadoop cluster using 
> my IDE.
>
> Thanks,
> Frkn.
> On 03-10-2013 13:06, Jitendra Yadav wrote:
>> When you said "started from java" does that means you are doing some 
>> development work using eclipse and hadoop?
>>
>> May be I'm not familiar with this kind of environment.
>>
>> Regards
>> Jitendra
>>
>>
>> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
>> <ma...@gmail.com>> wrote:
>>
>>     I don't have any problem when starting and stoping the cluster
>>     with scripts. I am having this problem when starting the cluster
>>     from Java.
>>
>>     Also, when I start the cluster from Java, I can run map-reduce
>>     jobs and it succesfully finishes. However, after some time about
>>     5 minutes when the secondary namenode is started, it tries the
>>     merge and then gives that error.
>>
>>     Thanks,
>>     Frkn.
>>
>>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>>     Can you restart your cluster using below scripts and check the
>>>     logs?
>>>
>>>     # stop-all.sh
>>>     #start-all.sh
>>>
>>>     Regards
>>>     Jitendra
>>>
>>>
>>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>>     <ma...@gmail.com>> wrote:
>>>
>>>         No, I started from scratch.
>>>
>>>         Thanks,
>>>         Frkn.
>>>
>>>
>>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>>         Did you upgraded your cluster ?
>>>>
>>>>         Regards
>>>>         Jitendra
>>>>
>>>>
>>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>>         <bicak.cs@gmail.com <ma...@gmail.com>> wrote:
>>>>
>>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>>
>>>>                 Hi Everyone,
>>>>
>>>>                 I am starting my hadoop cluster manually from Java
>>>>                 which works fine until some time. When secondary
>>>>                 NameNode tries to do merge it gives me the
>>>>                 following exception:
>>>>
>>>>                 ---------------------------
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 Throwable Exception in doCheckpoint:
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>                 ---------------------------
>>>>
>>>>                 What causes this exception to occur?
>>>>                 Any help would be appreciated!
>>>>
>>>>                 Kind Regards,
>>>>
>>>>                 Furkan Bicak.
>>>>
>>>>             I forgot to mention the hadoop version. I am using
>>>>             hadoop 1.2.1 version.
>>>>
>>>>             Thanks.
>>>>
>>>>
>>>
>>>
>>
>>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
What I simply do is starting NameNode, DataNode, SecondaryNameNode, 
JobTracker and TaskTracker respectively. Why would SecondaryNameNode 
throws an exception when doing merge. Am I missing some configurations? 
Or how can I set checkpoint period?

Thanks,
Frkn.

On 03-10-2013 13:18, Furkan Bıçak wrote:
> Yes, I am doing some development and starting my hadoop cluster using 
> my IDE.
>
> Thanks,
> Frkn.
> On 03-10-2013 13:06, Jitendra Yadav wrote:
>> When you said "started from java" does that means you are doing some 
>> development work using eclipse and hadoop?
>>
>> May be I'm not familiar with this kind of environment.
>>
>> Regards
>> Jitendra
>>
>>
>> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
>> <ma...@gmail.com>> wrote:
>>
>>     I don't have any problem when starting and stoping the cluster
>>     with scripts. I am having this problem when starting the cluster
>>     from Java.
>>
>>     Also, when I start the cluster from Java, I can run map-reduce
>>     jobs and it succesfully finishes. However, after some time about
>>     5 minutes when the secondary namenode is started, it tries the
>>     merge and then gives that error.
>>
>>     Thanks,
>>     Frkn.
>>
>>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>>     Can you restart your cluster using below scripts and check the
>>>     logs?
>>>
>>>     # stop-all.sh
>>>     #start-all.sh
>>>
>>>     Regards
>>>     Jitendra
>>>
>>>
>>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>>     <ma...@gmail.com>> wrote:
>>>
>>>         No, I started from scratch.
>>>
>>>         Thanks,
>>>         Frkn.
>>>
>>>
>>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>>         Did you upgraded your cluster ?
>>>>
>>>>         Regards
>>>>         Jitendra
>>>>
>>>>
>>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>>         <bicak.cs@gmail.com <ma...@gmail.com>> wrote:
>>>>
>>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>>
>>>>                 Hi Everyone,
>>>>
>>>>                 I am starting my hadoop cluster manually from Java
>>>>                 which works fine until some time. When secondary
>>>>                 NameNode tries to do merge it gives me the
>>>>                 following exception:
>>>>
>>>>                 ---------------------------
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 Throwable Exception in doCheckpoint:
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>                 ---------------------------
>>>>
>>>>                 What causes this exception to occur?
>>>>                 Any help would be appreciated!
>>>>
>>>>                 Kind Regards,
>>>>
>>>>                 Furkan Bicak.
>>>>
>>>>             I forgot to mention the hadoop version. I am using
>>>>             hadoop 1.2.1 version.
>>>>
>>>>             Thanks.
>>>>
>>>>
>>>
>>>
>>
>>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
What I simply do is starting NameNode, DataNode, SecondaryNameNode, 
JobTracker and TaskTracker respectively. Why would SecondaryNameNode 
throws an exception when doing merge. Am I missing some configurations? 
Or how can I set checkpoint period?

Thanks,
Frkn.

On 03-10-2013 13:18, Furkan Bıçak wrote:
> Yes, I am doing some development and starting my hadoop cluster using 
> my IDE.
>
> Thanks,
> Frkn.
> On 03-10-2013 13:06, Jitendra Yadav wrote:
>> When you said "started from java" does that means you are doing some 
>> development work using eclipse and hadoop?
>>
>> May be I'm not familiar with this kind of environment.
>>
>> Regards
>> Jitendra
>>
>>
>> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
>> <ma...@gmail.com>> wrote:
>>
>>     I don't have any problem when starting and stoping the cluster
>>     with scripts. I am having this problem when starting the cluster
>>     from Java.
>>
>>     Also, when I start the cluster from Java, I can run map-reduce
>>     jobs and it succesfully finishes. However, after some time about
>>     5 minutes when the secondary namenode is started, it tries the
>>     merge and then gives that error.
>>
>>     Thanks,
>>     Frkn.
>>
>>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>>     Can you restart your cluster using below scripts and check the
>>>     logs?
>>>
>>>     # stop-all.sh
>>>     #start-all.sh
>>>
>>>     Regards
>>>     Jitendra
>>>
>>>
>>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>>     <ma...@gmail.com>> wrote:
>>>
>>>         No, I started from scratch.
>>>
>>>         Thanks,
>>>         Frkn.
>>>
>>>
>>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>>         Did you upgraded your cluster ?
>>>>
>>>>         Regards
>>>>         Jitendra
>>>>
>>>>
>>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>>         <bicak.cs@gmail.com <ma...@gmail.com>> wrote:
>>>>
>>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>>
>>>>                 Hi Everyone,
>>>>
>>>>                 I am starting my hadoop cluster manually from Java
>>>>                 which works fine until some time. When secondary
>>>>                 NameNode tries to do merge it gives me the
>>>>                 following exception:
>>>>
>>>>                 ---------------------------
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 Throwable Exception in doCheckpoint:
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>                 ---------------------------
>>>>
>>>>                 What causes this exception to occur?
>>>>                 Any help would be appreciated!
>>>>
>>>>                 Kind Regards,
>>>>
>>>>                 Furkan Bicak.
>>>>
>>>>             I forgot to mention the hadoop version. I am using
>>>>             hadoop 1.2.1 version.
>>>>
>>>>             Thanks.
>>>>
>>>>
>>>
>>>
>>
>>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
What I simply do is starting NameNode, DataNode, SecondaryNameNode, 
JobTracker and TaskTracker respectively. Why would SecondaryNameNode 
throws an exception when doing merge. Am I missing some configurations? 
Or how can I set checkpoint period?

Thanks,
Frkn.

On 03-10-2013 13:18, Furkan Bıçak wrote:
> Yes, I am doing some development and starting my hadoop cluster using 
> my IDE.
>
> Thanks,
> Frkn.
> On 03-10-2013 13:06, Jitendra Yadav wrote:
>> When you said "started from java" does that means you are doing some 
>> development work using eclipse and hadoop?
>>
>> May be I'm not familiar with this kind of environment.
>>
>> Regards
>> Jitendra
>>
>>
>> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
>> <ma...@gmail.com>> wrote:
>>
>>     I don't have any problem when starting and stoping the cluster
>>     with scripts. I am having this problem when starting the cluster
>>     from Java.
>>
>>     Also, when I start the cluster from Java, I can run map-reduce
>>     jobs and it succesfully finishes. However, after some time about
>>     5 minutes when the secondary namenode is started, it tries the
>>     merge and then gives that error.
>>
>>     Thanks,
>>     Frkn.
>>
>>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>>     Can you restart your cluster using below scripts and check the
>>>     logs?
>>>
>>>     # stop-all.sh
>>>     #start-all.sh
>>>
>>>     Regards
>>>     Jitendra
>>>
>>>
>>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>>     <ma...@gmail.com>> wrote:
>>>
>>>         No, I started from scratch.
>>>
>>>         Thanks,
>>>         Frkn.
>>>
>>>
>>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>>         Did you upgraded your cluster ?
>>>>
>>>>         Regards
>>>>         Jitendra
>>>>
>>>>
>>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>>         <bicak.cs@gmail.com <ma...@gmail.com>> wrote:
>>>>
>>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>>
>>>>                 Hi Everyone,
>>>>
>>>>                 I am starting my hadoop cluster manually from Java
>>>>                 which works fine until some time. When secondary
>>>>                 NameNode tries to do merge it gives me the
>>>>                 following exception:
>>>>
>>>>                 ---------------------------
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 Throwable Exception in doCheckpoint:
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>                 ---------------------------
>>>>
>>>>                 What causes this exception to occur?
>>>>                 Any help would be appreciated!
>>>>
>>>>                 Kind Regards,
>>>>
>>>>                 Furkan Bicak.
>>>>
>>>>             I forgot to mention the hadoop version. I am using
>>>>             hadoop 1.2.1 version.
>>>>
>>>>             Thanks.
>>>>
>>>>
>>>
>>>
>>
>>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Yes, I am doing some development and starting my hadoop cluster using my 
IDE.

Thanks,
Frkn.
On 03-10-2013 13:06, Jitendra Yadav wrote:
> When you said "started from java" does that means you are doing some 
> development work using eclipse and hadoop?
>
> May be I'm not familiar with this kind of environment.
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     I don't have any problem when starting and stoping the cluster
>     with scripts. I am having this problem when starting the cluster
>     from Java.
>
>     Also, when I start the cluster from Java, I can run map-reduce
>     jobs and it succesfully finishes. However, after some time about 5
>     minutes when the secondary namenode is started, it tries the merge
>     and then gives that error.
>
>     Thanks,
>     Frkn.
>
>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>     Can you restart your cluster using below scripts and check the logs?
>>
>>     # stop-all.sh
>>     #start-all.sh
>>
>>     Regards
>>     Jitendra
>>
>>
>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>     <ma...@gmail.com>> wrote:
>>
>>         No, I started from scratch.
>>
>>         Thanks,
>>         Frkn.
>>
>>
>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>         Did you upgraded your cluster ?
>>>
>>>         Regards
>>>         Jitendra
>>>
>>>
>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>         <bicak.cs@gmail.com <ma...@gmail.com>> wrote:
>>>
>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>
>>>                 Hi Everyone,
>>>
>>>                 I am starting my hadoop cluster manually from Java
>>>                 which works fine until some time. When secondary
>>>                 NameNode tries to do merge it gives me the following
>>>                 exception:
>>>
>>>                 ---------------------------
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 Throwable Exception in doCheckpoint:
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>                 ---------------------------
>>>
>>>                 What causes this exception to occur?
>>>                 Any help would be appreciated!
>>>
>>>                 Kind Regards,
>>>
>>>                 Furkan Bicak.
>>>
>>>             I forgot to mention the hadoop version. I am using
>>>             hadoop 1.2.1 version.
>>>
>>>             Thanks.
>>>
>>>
>>
>>
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Yes, I am doing some development and starting my hadoop cluster using my 
IDE.

Thanks,
Frkn.
On 03-10-2013 13:06, Jitendra Yadav wrote:
> When you said "started from java" does that means you are doing some 
> development work using eclipse and hadoop?
>
> May be I'm not familiar with this kind of environment.
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     I don't have any problem when starting and stoping the cluster
>     with scripts. I am having this problem when starting the cluster
>     from Java.
>
>     Also, when I start the cluster from Java, I can run map-reduce
>     jobs and it succesfully finishes. However, after some time about 5
>     minutes when the secondary namenode is started, it tries the merge
>     and then gives that error.
>
>     Thanks,
>     Frkn.
>
>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>     Can you restart your cluster using below scripts and check the logs?
>>
>>     # stop-all.sh
>>     #start-all.sh
>>
>>     Regards
>>     Jitendra
>>
>>
>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>     <ma...@gmail.com>> wrote:
>>
>>         No, I started from scratch.
>>
>>         Thanks,
>>         Frkn.
>>
>>
>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>         Did you upgraded your cluster ?
>>>
>>>         Regards
>>>         Jitendra
>>>
>>>
>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>         <bicak.cs@gmail.com <ma...@gmail.com>> wrote:
>>>
>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>
>>>                 Hi Everyone,
>>>
>>>                 I am starting my hadoop cluster manually from Java
>>>                 which works fine until some time. When secondary
>>>                 NameNode tries to do merge it gives me the following
>>>                 exception:
>>>
>>>                 ---------------------------
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 Throwable Exception in doCheckpoint:
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>                 ---------------------------
>>>
>>>                 What causes this exception to occur?
>>>                 Any help would be appreciated!
>>>
>>>                 Kind Regards,
>>>
>>>                 Furkan Bicak.
>>>
>>>             I forgot to mention the hadoop version. I am using
>>>             hadoop 1.2.1 version.
>>>
>>>             Thanks.
>>>
>>>
>>
>>
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Yes, I am doing some development and starting my hadoop cluster using my 
IDE.

Thanks,
Frkn.
On 03-10-2013 13:06, Jitendra Yadav wrote:
> When you said "started from java" does that means you are doing some 
> development work using eclipse and hadoop?
>
> May be I'm not familiar with this kind of environment.
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     I don't have any problem when starting and stoping the cluster
>     with scripts. I am having this problem when starting the cluster
>     from Java.
>
>     Also, when I start the cluster from Java, I can run map-reduce
>     jobs and it succesfully finishes. However, after some time about 5
>     minutes when the secondary namenode is started, it tries the merge
>     and then gives that error.
>
>     Thanks,
>     Frkn.
>
>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>     Can you restart your cluster using below scripts and check the logs?
>>
>>     # stop-all.sh
>>     #start-all.sh
>>
>>     Regards
>>     Jitendra
>>
>>
>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>     <ma...@gmail.com>> wrote:
>>
>>         No, I started from scratch.
>>
>>         Thanks,
>>         Frkn.
>>
>>
>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>         Did you upgraded your cluster ?
>>>
>>>         Regards
>>>         Jitendra
>>>
>>>
>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>         <bicak.cs@gmail.com <ma...@gmail.com>> wrote:
>>>
>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>
>>>                 Hi Everyone,
>>>
>>>                 I am starting my hadoop cluster manually from Java
>>>                 which works fine until some time. When secondary
>>>                 NameNode tries to do merge it gives me the following
>>>                 exception:
>>>
>>>                 ---------------------------
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 Throwable Exception in doCheckpoint:
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>                 ---------------------------
>>>
>>>                 What causes this exception to occur?
>>>                 Any help would be appreciated!
>>>
>>>                 Kind Regards,
>>>
>>>                 Furkan Bicak.
>>>
>>>             I forgot to mention the hadoop version. I am using
>>>             hadoop 1.2.1 version.
>>>
>>>             Thanks.
>>>
>>>
>>
>>
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Yes, I am doing some development and starting my hadoop cluster using my 
IDE.

Thanks,
Frkn.
On 03-10-2013 13:06, Jitendra Yadav wrote:
> When you said "started from java" does that means you are doing some 
> development work using eclipse and hadoop?
>
> May be I'm not familiar with this kind of environment.
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     I don't have any problem when starting and stoping the cluster
>     with scripts. I am having this problem when starting the cluster
>     from Java.
>
>     Also, when I start the cluster from Java, I can run map-reduce
>     jobs and it succesfully finishes. However, after some time about 5
>     minutes when the secondary namenode is started, it tries the merge
>     and then gives that error.
>
>     Thanks,
>     Frkn.
>
>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>     Can you restart your cluster using below scripts and check the logs?
>>
>>     # stop-all.sh
>>     #start-all.sh
>>
>>     Regards
>>     Jitendra
>>
>>
>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>     <ma...@gmail.com>> wrote:
>>
>>         No, I started from scratch.
>>
>>         Thanks,
>>         Frkn.
>>
>>
>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>         Did you upgraded your cluster ?
>>>
>>>         Regards
>>>         Jitendra
>>>
>>>
>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>         <bicak.cs@gmail.com <ma...@gmail.com>> wrote:
>>>
>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>
>>>                 Hi Everyone,
>>>
>>>                 I am starting my hadoop cluster manually from Java
>>>                 which works fine until some time. When secondary
>>>                 NameNode tries to do merge it gives me the following
>>>                 exception:
>>>
>>>                 ---------------------------
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 Throwable Exception in doCheckpoint:
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>                 ---------------------------
>>>
>>>                 What causes this exception to occur?
>>>                 Any help would be appreciated!
>>>
>>>                 Kind Regards,
>>>
>>>                 Furkan Bicak.
>>>
>>>             I forgot to mention the hadoop version. I am using
>>>             hadoop 1.2.1 version.
>>>
>>>             Thanks.
>>>
>>>
>>
>>
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
When you said "started from java" does that means you are doing some
development work using eclipse and hadoop?

May be I'm not familiar with this kind of environment.

Regards
Jitendra


On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bi...@gmail.com> wrote:

>  I don't have any problem when starting and stoping the cluster with
> scripts. I am having this problem when starting the cluster from Java.
>
> Also, when I start the cluster from Java, I can run map-reduce jobs and it
> succesfully finishes. However, after some time about 5 minutes when the
> secondary namenode is started, it tries the merge and then gives that error.
>
> Thanks,
> Frkn.
>
> On 03-10-2013 12:10, Jitendra Yadav wrote:
>
> Can you restart your cluster using below scripts and check the logs?
>
>  # stop-all.sh
> #start-all.sh
>
>  Regards
>  Jitendra
>
>
> On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>
>>  No, I started from scratch.
>>
>> Thanks,
>> Frkn.
>>
>>
>> On 03-10-2013 11:32, Jitendra Yadav wrote:
>>
>> Did you upgraded your cluster ?
>>
>>  Regards
>> Jitendra
>>
>>
>> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>>
>>>  On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>
>>>> Hi Everyone,
>>>>
>>>> I am starting my hadoop cluster manually from Java which works fine
>>>> until some time. When secondary NameNode tries to do merge it gives me the
>>>> following exception:
>>>>
>>>> ---------------------------
>>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>>>> in doCheckpoint:
>>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>> java.lang.AssertionError: Negative layout version is expected.
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>     at java.lang.Thread.run(Thread.java:724)
>>>>
>>>> java.lang.AssertionError: Negative layout version is expected.
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>     at java.lang.Thread.run(Thread.java:724)
>>>> ---------------------------
>>>>
>>>> What causes this exception to occur?
>>>> Any help would be appreciated!
>>>>
>>>> Kind Regards,
>>>>
>>>> Furkan Bicak.
>>>>
>>>>   I forgot to mention the hadoop version. I am using hadoop 1.2.1
>>> version.
>>>
>>> Thanks.
>>>
>>
>>
>>
>
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
When you said "started from java" does that means you are doing some
development work using eclipse and hadoop?

May be I'm not familiar with this kind of environment.

Regards
Jitendra


On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bi...@gmail.com> wrote:

>  I don't have any problem when starting and stoping the cluster with
> scripts. I am having this problem when starting the cluster from Java.
>
> Also, when I start the cluster from Java, I can run map-reduce jobs and it
> succesfully finishes. However, after some time about 5 minutes when the
> secondary namenode is started, it tries the merge and then gives that error.
>
> Thanks,
> Frkn.
>
> On 03-10-2013 12:10, Jitendra Yadav wrote:
>
> Can you restart your cluster using below scripts and check the logs?
>
>  # stop-all.sh
> #start-all.sh
>
>  Regards
>  Jitendra
>
>
> On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>
>>  No, I started from scratch.
>>
>> Thanks,
>> Frkn.
>>
>>
>> On 03-10-2013 11:32, Jitendra Yadav wrote:
>>
>> Did you upgraded your cluster ?
>>
>>  Regards
>> Jitendra
>>
>>
>> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>>
>>>  On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>
>>>> Hi Everyone,
>>>>
>>>> I am starting my hadoop cluster manually from Java which works fine
>>>> until some time. When secondary NameNode tries to do merge it gives me the
>>>> following exception:
>>>>
>>>> ---------------------------
>>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>>>> in doCheckpoint:
>>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>> java.lang.AssertionError: Negative layout version is expected.
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>     at java.lang.Thread.run(Thread.java:724)
>>>>
>>>> java.lang.AssertionError: Negative layout version is expected.
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>     at java.lang.Thread.run(Thread.java:724)
>>>> ---------------------------
>>>>
>>>> What causes this exception to occur?
>>>> Any help would be appreciated!
>>>>
>>>> Kind Regards,
>>>>
>>>> Furkan Bicak.
>>>>
>>>>   I forgot to mention the hadoop version. I am using hadoop 1.2.1
>>> version.
>>>
>>> Thanks.
>>>
>>
>>
>>
>
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
When you said "started from java" does that means you are doing some
development work using eclipse and hadoop?

May be I'm not familiar with this kind of environment.

Regards
Jitendra


On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bi...@gmail.com> wrote:

>  I don't have any problem when starting and stoping the cluster with
> scripts. I am having this problem when starting the cluster from Java.
>
> Also, when I start the cluster from Java, I can run map-reduce jobs and it
> succesfully finishes. However, after some time about 5 minutes when the
> secondary namenode is started, it tries the merge and then gives that error.
>
> Thanks,
> Frkn.
>
> On 03-10-2013 12:10, Jitendra Yadav wrote:
>
> Can you restart your cluster using below scripts and check the logs?
>
>  # stop-all.sh
> #start-all.sh
>
>  Regards
>  Jitendra
>
>
> On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>
>>  No, I started from scratch.
>>
>> Thanks,
>> Frkn.
>>
>>
>> On 03-10-2013 11:32, Jitendra Yadav wrote:
>>
>> Did you upgraded your cluster ?
>>
>>  Regards
>> Jitendra
>>
>>
>> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>>
>>>  On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>
>>>> Hi Everyone,
>>>>
>>>> I am starting my hadoop cluster manually from Java which works fine
>>>> until some time. When secondary NameNode tries to do merge it gives me the
>>>> following exception:
>>>>
>>>> ---------------------------
>>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>>>> in doCheckpoint:
>>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>> java.lang.AssertionError: Negative layout version is expected.
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>     at java.lang.Thread.run(Thread.java:724)
>>>>
>>>> java.lang.AssertionError: Negative layout version is expected.
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>     at java.lang.Thread.run(Thread.java:724)
>>>> ---------------------------
>>>>
>>>> What causes this exception to occur?
>>>> Any help would be appreciated!
>>>>
>>>> Kind Regards,
>>>>
>>>> Furkan Bicak.
>>>>
>>>>   I forgot to mention the hadoop version. I am using hadoop 1.2.1
>>> version.
>>>
>>> Thanks.
>>>
>>
>>
>>
>
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
When you said "started from java" does that means you are doing some
development work using eclipse and hadoop?

May be I'm not familiar with this kind of environment.

Regards
Jitendra


On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bi...@gmail.com> wrote:

>  I don't have any problem when starting and stoping the cluster with
> scripts. I am having this problem when starting the cluster from Java.
>
> Also, when I start the cluster from Java, I can run map-reduce jobs and it
> succesfully finishes. However, after some time about 5 minutes when the
> secondary namenode is started, it tries the merge and then gives that error.
>
> Thanks,
> Frkn.
>
> On 03-10-2013 12:10, Jitendra Yadav wrote:
>
> Can you restart your cluster using below scripts and check the logs?
>
>  # stop-all.sh
> #start-all.sh
>
>  Regards
>  Jitendra
>
>
> On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>
>>  No, I started from scratch.
>>
>> Thanks,
>> Frkn.
>>
>>
>> On 03-10-2013 11:32, Jitendra Yadav wrote:
>>
>> Did you upgraded your cluster ?
>>
>>  Regards
>> Jitendra
>>
>>
>> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>>
>>>  On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>
>>>> Hi Everyone,
>>>>
>>>> I am starting my hadoop cluster manually from Java which works fine
>>>> until some time. When secondary NameNode tries to do merge it gives me the
>>>> following exception:
>>>>
>>>> ---------------------------
>>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>>>> in doCheckpoint:
>>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>> java.lang.AssertionError: Negative layout version is expected.
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>     at java.lang.Thread.run(Thread.java:724)
>>>>
>>>> java.lang.AssertionError: Negative layout version is expected.
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>     at
>>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>     at java.lang.Thread.run(Thread.java:724)
>>>> ---------------------------
>>>>
>>>> What causes this exception to occur?
>>>> Any help would be appreciated!
>>>>
>>>> Kind Regards,
>>>>
>>>> Furkan Bicak.
>>>>
>>>>   I forgot to mention the hadoop version. I am using hadoop 1.2.1
>>> version.
>>>
>>> Thanks.
>>>
>>
>>
>>
>
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
I don't have any problem when starting and stoping the cluster with 
scripts. I am having this problem when starting the cluster from Java.

Also, when I start the cluster from Java, I can run map-reduce jobs and 
it succesfully finishes. However, after some time about 5 minutes when 
the secondary namenode is started, it tries the merge and then gives 
that error.

Thanks,
Frkn.

On 03-10-2013 12:10, Jitendra Yadav wrote:
> Can you restart your cluster using below scripts and check the logs?
>
> # stop-all.sh
> #start-all.sh
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     No, I started from scratch.
>
>     Thanks,
>     Frkn.
>
>
>     On 03-10-2013 11:32, Jitendra Yadav wrote:
>>     Did you upgraded your cluster ?
>>
>>     Regards
>>     Jitendra
>>
>>
>>     On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com
>>     <ma...@gmail.com>> wrote:
>>
>>         On 03-10-2013 10:44, Furkan Bıçak wrote:
>>
>>             Hi Everyone,
>>
>>             I am starting my hadoop cluster manually from Java which
>>             works fine until some time. When secondary NameNode tries
>>             to do merge it gives me the following exception:
>>
>>             ---------------------------
>>             13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>             Throwable Exception in doCheckpoint:
>>             13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>             java.lang.AssertionError: Negative layout version is
>>             expected.
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>                 at java.lang.Thread.run(Thread.java:724)
>>
>>             java.lang.AssertionError: Negative layout version is
>>             expected.
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>                 at java.lang.Thread.run(Thread.java:724)
>>             ---------------------------
>>
>>             What causes this exception to occur?
>>             Any help would be appreciated!
>>
>>             Kind Regards,
>>
>>             Furkan Bicak.
>>
>>         I forgot to mention the hadoop version. I am using hadoop
>>         1.2.1 version.
>>
>>         Thanks.
>>
>>
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
I don't have any problem when starting and stoping the cluster with 
scripts. I am having this problem when starting the cluster from Java.

Also, when I start the cluster from Java, I can run map-reduce jobs and 
it succesfully finishes. However, after some time about 5 minutes when 
the secondary namenode is started, it tries the merge and then gives 
that error.

Thanks,
Frkn.

On 03-10-2013 12:10, Jitendra Yadav wrote:
> Can you restart your cluster using below scripts and check the logs?
>
> # stop-all.sh
> #start-all.sh
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     No, I started from scratch.
>
>     Thanks,
>     Frkn.
>
>
>     On 03-10-2013 11:32, Jitendra Yadav wrote:
>>     Did you upgraded your cluster ?
>>
>>     Regards
>>     Jitendra
>>
>>
>>     On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com
>>     <ma...@gmail.com>> wrote:
>>
>>         On 03-10-2013 10:44, Furkan Bıçak wrote:
>>
>>             Hi Everyone,
>>
>>             I am starting my hadoop cluster manually from Java which
>>             works fine until some time. When secondary NameNode tries
>>             to do merge it gives me the following exception:
>>
>>             ---------------------------
>>             13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>             Throwable Exception in doCheckpoint:
>>             13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>             java.lang.AssertionError: Negative layout version is
>>             expected.
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>                 at java.lang.Thread.run(Thread.java:724)
>>
>>             java.lang.AssertionError: Negative layout version is
>>             expected.
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>                 at java.lang.Thread.run(Thread.java:724)
>>             ---------------------------
>>
>>             What causes this exception to occur?
>>             Any help would be appreciated!
>>
>>             Kind Regards,
>>
>>             Furkan Bicak.
>>
>>         I forgot to mention the hadoop version. I am using hadoop
>>         1.2.1 version.
>>
>>         Thanks.
>>
>>
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
I don't have any problem when starting and stoping the cluster with 
scripts. I am having this problem when starting the cluster from Java.

Also, when I start the cluster from Java, I can run map-reduce jobs and 
it succesfully finishes. However, after some time about 5 minutes when 
the secondary namenode is started, it tries the merge and then gives 
that error.

Thanks,
Frkn.

On 03-10-2013 12:10, Jitendra Yadav wrote:
> Can you restart your cluster using below scripts and check the logs?
>
> # stop-all.sh
> #start-all.sh
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     No, I started from scratch.
>
>     Thanks,
>     Frkn.
>
>
>     On 03-10-2013 11:32, Jitendra Yadav wrote:
>>     Did you upgraded your cluster ?
>>
>>     Regards
>>     Jitendra
>>
>>
>>     On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com
>>     <ma...@gmail.com>> wrote:
>>
>>         On 03-10-2013 10:44, Furkan Bıçak wrote:
>>
>>             Hi Everyone,
>>
>>             I am starting my hadoop cluster manually from Java which
>>             works fine until some time. When secondary NameNode tries
>>             to do merge it gives me the following exception:
>>
>>             ---------------------------
>>             13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>             Throwable Exception in doCheckpoint:
>>             13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>             java.lang.AssertionError: Negative layout version is
>>             expected.
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>                 at java.lang.Thread.run(Thread.java:724)
>>
>>             java.lang.AssertionError: Negative layout version is
>>             expected.
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>                 at java.lang.Thread.run(Thread.java:724)
>>             ---------------------------
>>
>>             What causes this exception to occur?
>>             Any help would be appreciated!
>>
>>             Kind Regards,
>>
>>             Furkan Bicak.
>>
>>         I forgot to mention the hadoop version. I am using hadoop
>>         1.2.1 version.
>>
>>         Thanks.
>>
>>
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
I don't have any problem when starting and stoping the cluster with 
scripts. I am having this problem when starting the cluster from Java.

Also, when I start the cluster from Java, I can run map-reduce jobs and 
it succesfully finishes. However, after some time about 5 minutes when 
the secondary namenode is started, it tries the merge and then gives 
that error.

Thanks,
Frkn.

On 03-10-2013 12:10, Jitendra Yadav wrote:
> Can you restart your cluster using below scripts and check the logs?
>
> # stop-all.sh
> #start-all.sh
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     No, I started from scratch.
>
>     Thanks,
>     Frkn.
>
>
>     On 03-10-2013 11:32, Jitendra Yadav wrote:
>>     Did you upgraded your cluster ?
>>
>>     Regards
>>     Jitendra
>>
>>
>>     On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com
>>     <ma...@gmail.com>> wrote:
>>
>>         On 03-10-2013 10:44, Furkan Bıçak wrote:
>>
>>             Hi Everyone,
>>
>>             I am starting my hadoop cluster manually from Java which
>>             works fine until some time. When secondary NameNode tries
>>             to do merge it gives me the following exception:
>>
>>             ---------------------------
>>             13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>             Throwable Exception in doCheckpoint:
>>             13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>             java.lang.AssertionError: Negative layout version is
>>             expected.
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>                 at java.lang.Thread.run(Thread.java:724)
>>
>>             java.lang.AssertionError: Negative layout version is
>>             expected.
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>                 at
>>             org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>                 at java.lang.Thread.run(Thread.java:724)
>>             ---------------------------
>>
>>             What causes this exception to occur?
>>             Any help would be appreciated!
>>
>>             Kind Regards,
>>
>>             Furkan Bicak.
>>
>>         I forgot to mention the hadoop version. I am using hadoop
>>         1.2.1 version.
>>
>>         Thanks.
>>
>>
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Can you restart your cluster using below scripts and check the logs?

# stop-all.sh
#start-all.sh

Regards
Jitendra


On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bi...@gmail.com> wrote:

>  No, I started from scratch.
>
> Thanks,
> Frkn.
>
>
> On 03-10-2013 11:32, Jitendra Yadav wrote:
>
> Did you upgraded your cluster ?
>
>  Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>
>>  On 03-10-2013 10:44, Furkan Bıçak wrote:
>>
>>> Hi Everyone,
>>>
>>> I am starting my hadoop cluster manually from Java which works fine
>>> until some time. When secondary NameNode tries to do merge it gives me the
>>> following exception:
>>>
>>> ---------------------------
>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>>> in doCheckpoint:
>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>> java.lang.AssertionError: Negative layout version is expected.
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>     at java.lang.Thread.run(Thread.java:724)
>>>
>>> java.lang.AssertionError: Negative layout version is expected.
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>     at java.lang.Thread.run(Thread.java:724)
>>> ---------------------------
>>>
>>> What causes this exception to occur?
>>> Any help would be appreciated!
>>>
>>> Kind Regards,
>>>
>>> Furkan Bicak.
>>>
>>>   I forgot to mention the hadoop version. I am using hadoop 1.2.1
>> version.
>>
>> Thanks.
>>
>
>
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Can you restart your cluster using below scripts and check the logs?

# stop-all.sh
#start-all.sh

Regards
Jitendra


On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bi...@gmail.com> wrote:

>  No, I started from scratch.
>
> Thanks,
> Frkn.
>
>
> On 03-10-2013 11:32, Jitendra Yadav wrote:
>
> Did you upgraded your cluster ?
>
>  Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>
>>  On 03-10-2013 10:44, Furkan Bıçak wrote:
>>
>>> Hi Everyone,
>>>
>>> I am starting my hadoop cluster manually from Java which works fine
>>> until some time. When secondary NameNode tries to do merge it gives me the
>>> following exception:
>>>
>>> ---------------------------
>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>>> in doCheckpoint:
>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>> java.lang.AssertionError: Negative layout version is expected.
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>     at java.lang.Thread.run(Thread.java:724)
>>>
>>> java.lang.AssertionError: Negative layout version is expected.
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>     at java.lang.Thread.run(Thread.java:724)
>>> ---------------------------
>>>
>>> What causes this exception to occur?
>>> Any help would be appreciated!
>>>
>>> Kind Regards,
>>>
>>> Furkan Bicak.
>>>
>>>   I forgot to mention the hadoop version. I am using hadoop 1.2.1
>> version.
>>
>> Thanks.
>>
>
>
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Can you restart your cluster using below scripts and check the logs?

# stop-all.sh
#start-all.sh

Regards
Jitendra


On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bi...@gmail.com> wrote:

>  No, I started from scratch.
>
> Thanks,
> Frkn.
>
>
> On 03-10-2013 11:32, Jitendra Yadav wrote:
>
> Did you upgraded your cluster ?
>
>  Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>
>>  On 03-10-2013 10:44, Furkan Bıçak wrote:
>>
>>> Hi Everyone,
>>>
>>> I am starting my hadoop cluster manually from Java which works fine
>>> until some time. When secondary NameNode tries to do merge it gives me the
>>> following exception:
>>>
>>> ---------------------------
>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>>> in doCheckpoint:
>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>> java.lang.AssertionError: Negative layout version is expected.
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>     at java.lang.Thread.run(Thread.java:724)
>>>
>>> java.lang.AssertionError: Negative layout version is expected.
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>     at java.lang.Thread.run(Thread.java:724)
>>> ---------------------------
>>>
>>> What causes this exception to occur?
>>> Any help would be appreciated!
>>>
>>> Kind Regards,
>>>
>>> Furkan Bicak.
>>>
>>>   I forgot to mention the hadoop version. I am using hadoop 1.2.1
>> version.
>>
>> Thanks.
>>
>
>
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Can you restart your cluster using below scripts and check the logs?

# stop-all.sh
#start-all.sh

Regards
Jitendra


On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bi...@gmail.com> wrote:

>  No, I started from scratch.
>
> Thanks,
> Frkn.
>
>
> On 03-10-2013 11:32, Jitendra Yadav wrote:
>
> Did you upgraded your cluster ?
>
>  Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:
>
>>  On 03-10-2013 10:44, Furkan Bıçak wrote:
>>
>>> Hi Everyone,
>>>
>>> I am starting my hadoop cluster manually from Java which works fine
>>> until some time. When secondary NameNode tries to do merge it gives me the
>>> following exception:
>>>
>>> ---------------------------
>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>>> in doCheckpoint:
>>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>> java.lang.AssertionError: Negative layout version is expected.
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>     at java.lang.Thread.run(Thread.java:724)
>>>
>>> java.lang.AssertionError: Negative layout version is expected.
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>     at
>>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>     at java.lang.Thread.run(Thread.java:724)
>>> ---------------------------
>>>
>>> What causes this exception to occur?
>>> Any help would be appreciated!
>>>
>>> Kind Regards,
>>>
>>> Furkan Bicak.
>>>
>>>   I forgot to mention the hadoop version. I am using hadoop 1.2.1
>> version.
>>
>> Thanks.
>>
>
>
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
No, I started from scratch.

Thanks,
Frkn.

On 03-10-2013 11:32, Jitendra Yadav wrote:
> Did you upgraded your cluster ?
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>         Hi Everyone,
>
>         I am starting my hadoop cluster manually from Java which works
>         fine until some time. When secondary NameNode tries to do
>         merge it gives me the following exception:
>
>         ---------------------------
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable
>         Exception in doCheckpoint:
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>         ---------------------------
>
>         What causes this exception to occur?
>         Any help would be appreciated!
>
>         Kind Regards,
>
>         Furkan Bicak.
>
>     I forgot to mention the hadoop version. I am using hadoop 1.2.1
>     version.
>
>     Thanks.
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
No, I started from scratch.

Thanks,
Frkn.

On 03-10-2013 11:32, Jitendra Yadav wrote:
> Did you upgraded your cluster ?
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>         Hi Everyone,
>
>         I am starting my hadoop cluster manually from Java which works
>         fine until some time. When secondary NameNode tries to do
>         merge it gives me the following exception:
>
>         ---------------------------
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable
>         Exception in doCheckpoint:
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>         ---------------------------
>
>         What causes this exception to occur?
>         Any help would be appreciated!
>
>         Kind Regards,
>
>         Furkan Bicak.
>
>     I forgot to mention the hadoop version. I am using hadoop 1.2.1
>     version.
>
>     Thanks.
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
No, I started from scratch.

Thanks,
Frkn.

On 03-10-2013 11:32, Jitendra Yadav wrote:
> Did you upgraded your cluster ?
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>         Hi Everyone,
>
>         I am starting my hadoop cluster manually from Java which works
>         fine until some time. When secondary NameNode tries to do
>         merge it gives me the following exception:
>
>         ---------------------------
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable
>         Exception in doCheckpoint:
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>         ---------------------------
>
>         What causes this exception to occur?
>         Any help would be appreciated!
>
>         Kind Regards,
>
>         Furkan Bicak.
>
>     I forgot to mention the hadoop version. I am using hadoop 1.2.1
>     version.
>
>     Thanks.
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
No, I started from scratch.

Thanks,
Frkn.

On 03-10-2013 11:32, Jitendra Yadav wrote:
> Did you upgraded your cluster ?
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>         Hi Everyone,
>
>         I am starting my hadoop cluster manually from Java which works
>         fine until some time. When secondary NameNode tries to do
>         merge it gives me the following exception:
>
>         ---------------------------
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable
>         Exception in doCheckpoint:
>         13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>
>         java.lang.AssertionError: Negative layout version is expected.
>             at
>         org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>             at
>         org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>             at java.lang.Thread.run(Thread.java:724)
>         ---------------------------
>
>         What causes this exception to occur?
>         Any help would be appreciated!
>
>         Kind Regards,
>
>         Furkan Bicak.
>
>     I forgot to mention the hadoop version. I am using hadoop 1.2.1
>     version.
>
>     Thanks.
>
>


Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Did you upgraded your cluster ?

Regards
Jitendra


On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:

> On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine until
>> some time. When secondary NameNode tries to do merge it gives me the
>> following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>> in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
>>  I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Hi,

I have noticed that this exception occurs when I start the cluster from 
a JUnit test case. If the cluster is started from a main method, it 
doesn't give any exception at all. What may differ between these cases 
so that SecondaryNameNode cannot do the merge operation?

Thanks,

Frkn.

On 03-10-2013 10:52, Furkan Bıçak wrote:
> On 03-10-2013 10:44, Furkan Bıçak wrote:
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine 
>> until some time. When secondary NameNode tries to do merge it gives 
>> me the following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable 
>> Exception in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: 
>> java.lang.AssertionError: Negative layout version is expected.
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>     at java.lang.Thread.run(Thread.java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>     at java.lang.Thread.run(Thread.java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
> I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.


Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Hi,

I have noticed that this exception occurs when I start the cluster from 
a JUnit test case. If the cluster is started from a main method, it 
doesn't give any exception at all. What may differ between these cases 
so that SecondaryNameNode cannot do the merge operation?

Thanks,

Frkn.

On 03-10-2013 10:52, Furkan Bıçak wrote:
> On 03-10-2013 10:44, Furkan Bıçak wrote:
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine 
>> until some time. When secondary NameNode tries to do merge it gives 
>> me the following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable 
>> Exception in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: 
>> java.lang.AssertionError: Negative layout version is expected.
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>     at java.lang.Thread.run(Thread.java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>     at java.lang.Thread.run(Thread.java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
> I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.


Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Did you upgraded your cluster ?

Regards
Jitendra


On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:

> On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine until
>> some time. When secondary NameNode tries to do merge it gives me the
>> following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>> in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
>>  I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Hi,

There is some layout Version value issue in your VERSION file. Can you
please share the VERSION file content from NN and SNN ?

${dfs.name.dir}/current/VERSION

Regards
Jitendra


On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:

> On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine until
>> some time. When secondary NameNode tries to do merge it gives me the
>> following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>> in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
>>  I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Hi,

There is some layout Version value issue in your VERSION file. Can you
please share the VERSION file content from NN and SNN ?

${dfs.name.dir}/current/VERSION

Regards
Jitendra


On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:

> On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine until
>> some time. When secondary NameNode tries to do merge it gives me the
>> following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>> in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
>>  I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Did you upgraded your cluster ?

Regards
Jitendra


On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:

> On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine until
>> some time. When secondary NameNode tries to do merge it gives me the
>> following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>> in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
>>  I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Hi,

There is some layout Version value issue in your VERSION file. Can you
please share the VERSION file content from NN and SNN ?

${dfs.name.dir}/current/VERSION

Regards
Jitendra


On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:

> On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine until
>> some time. When secondary NameNode tries to do merge it gives me the
>> following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>> in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
>>  I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
Hi,

I have noticed that this exception occurs when I start the cluster from 
a JUnit test case. If the cluster is started from a main method, it 
doesn't give any exception at all. What may differ between these cases 
so that SecondaryNameNode cannot do the merge operation?

Thanks,

Frkn.

On 03-10-2013 10:52, Furkan Bıçak wrote:
> On 03-10-2013 10:44, Furkan Bıçak wrote:
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine 
>> until some time. When secondary NameNode tries to do merge it gives 
>> me the following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable 
>> Exception in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: 
>> java.lang.AssertionError: Negative layout version is expected.
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>     at java.lang.Thread.run(Thread.java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>     at 
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>     at java.lang.Thread.run(Thread.java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
> I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.


Re: Secondary NameNode doCheckpoint Exception

Posted by Jitendra Yadav <je...@gmail.com>.
Did you upgraded your cluster ?

Regards
Jitendra


On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak <bi...@gmail.com> wrote:

> On 03-10-2013 10:44, Furkan Bıçak wrote:
>
>> Hi Everyone,
>>
>> I am starting my hadoop cluster manually from Java which works fine until
>> some time. When secondary NameNode tries to do merge it gives me the
>> following exception:
>>
>> ---------------------------
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable Exception
>> in doCheckpoint:
>> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>>
>> java.lang.AssertionError: Negative layout version is expected.
>>     at org.apache.hadoop.hdfs.server.**namenode.FSImage.loadFSImage(**
>> FSImage.java:857)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.doMerge(**SecondaryNameNode.java:780)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode$**
>> CheckpointStorage.access$600(**SecondaryNameNode.java:680)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doMerge(SecondaryNameNode.**java:557)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doCheckpoint(**SecondaryNameNode.java:521)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> doWork(SecondaryNameNode.java:**396)
>>     at org.apache.hadoop.hdfs.server.**namenode.SecondaryNameNode.**
>> run(SecondaryNameNode.java:**360)
>>     at java.lang.Thread.run(Thread.**java:724)
>> ---------------------------
>>
>> What causes this exception to occur?
>> Any help would be appreciated!
>>
>> Kind Regards,
>>
>> Furkan Bicak.
>>
>>  I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.
>
> Thanks.
>

Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
On 03-10-2013 10:44, Furkan Bıçak wrote:
> Hi Everyone,
>
> I am starting my hadoop cluster manually from Java which works fine 
> until some time. When secondary NameNode tries to do merge it gives me 
> the following exception:
>
> ---------------------------
> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable 
> Exception in doCheckpoint:
> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: 
> java.lang.AssertionError: Negative layout version is expected.
>     at 
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>     at java.lang.Thread.run(Thread.java:724)
>
> java.lang.AssertionError: Negative layout version is expected.
>     at 
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>     at java.lang.Thread.run(Thread.java:724)
> ---------------------------
>
> What causes this exception to occur?
> Any help would be appreciated!
>
> Kind Regards,
>
> Furkan Bicak.
>
I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.

Thanks.

Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
On 03-10-2013 10:44, Furkan Bıçak wrote:
> Hi Everyone,
>
> I am starting my hadoop cluster manually from Java which works fine 
> until some time. When secondary NameNode tries to do merge it gives me 
> the following exception:
>
> ---------------------------
> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable 
> Exception in doCheckpoint:
> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: 
> java.lang.AssertionError: Negative layout version is expected.
>     at 
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>     at java.lang.Thread.run(Thread.java:724)
>
> java.lang.AssertionError: Negative layout version is expected.
>     at 
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>     at java.lang.Thread.run(Thread.java:724)
> ---------------------------
>
> What causes this exception to occur?
> Any help would be appreciated!
>
> Kind Regards,
>
> Furkan Bicak.
>
I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.

Thanks.

Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
On 03-10-2013 10:44, Furkan Bıçak wrote:
> Hi Everyone,
>
> I am starting my hadoop cluster manually from Java which works fine 
> until some time. When secondary NameNode tries to do merge it gives me 
> the following exception:
>
> ---------------------------
> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable 
> Exception in doCheckpoint:
> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: 
> java.lang.AssertionError: Negative layout version is expected.
>     at 
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>     at java.lang.Thread.run(Thread.java:724)
>
> java.lang.AssertionError: Negative layout version is expected.
>     at 
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>     at java.lang.Thread.run(Thread.java:724)
> ---------------------------
>
> What causes this exception to occur?
> Any help would be appreciated!
>
> Kind Regards,
>
> Furkan Bicak.
>
I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.

Thanks.

Re: Secondary NameNode doCheckpoint Exception

Posted by Furkan Bıçak <bi...@gmail.com>.
On 03-10-2013 10:44, Furkan Bıçak wrote:
> Hi Everyone,
>
> I am starting my hadoop cluster manually from Java which works fine 
> until some time. When secondary NameNode tries to do merge it gives me 
> the following exception:
>
> ---------------------------
> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: Throwable 
> Exception in doCheckpoint:
> 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode: 
> java.lang.AssertionError: Negative layout version is expected.
>     at 
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>     at java.lang.Thread.run(Thread.java:724)
>
> java.lang.AssertionError: Negative layout version is expected.
>     at 
> org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>     at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>     at java.lang.Thread.run(Thread.java:724)
> ---------------------------
>
> What causes this exception to occur?
> Any help would be appreciated!
>
> Kind Regards,
>
> Furkan Bicak.
>
I forgot to mention the hadoop version. I am using hadoop 1.2.1 version.

Thanks.