You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Yuqi Gu (Jira)" <ji...@apache.org> on 2022/06/15 08:39:00 UTC
[jira] [Closed] (BIGTOP-3701) Remove deprecated Hadoop fs-image file after uninstalling HDFS-namenode
[ https://issues.apache.org/jira/browse/BIGTOP-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuqi Gu closed BIGTOP-3701.
---------------------------
> Remove deprecated Hadoop fs-image file after uninstalling HDFS-namenode
> -----------------------------------------------------------------------
>
> Key: BIGTOP-3701
> URL: https://issues.apache.org/jira/browse/BIGTOP-3701
> Project: Bigtop
> Issue Type: Sub-task
> Components: build, hadoop
> Affects Versions: 3.2.0
> Reporter: Yuqi Gu
> Assignee: Yuqi Gu
> Priority: Minor
> Fix For: 3.2.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Usecase scenario:
> When deploying HDFS, Yarn and MapReduce services by Ambari-Mpack from Bigtop RPMs,
> firstly I installed Hadoop-2.10 from Bigtop-1.5 repo, then I uninstalled it and re-installed Hadoop 3.2 from Bigtop-3.1.0 repo.
> It would fail to format namenode:
> {code:java}
> ERROR namenode.NameNode (NameNode.java:main(1795)) - Failed to start namenode.
> java.io.IOException:
> File system image contains an old layout version -63.
> An upgrade to version -65 is required.
> at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:280)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1135)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:750)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:658)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:734)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:977)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:950)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1723)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1790)
> 2022-05-24 15:26:35,431 INFO util.ExitUtil (ExitUtil.java:terminate(210)) - Exiting with status 1: java.io.IOException:
> File system image contains an old layout version -63.
> An upgrade to version -65 is required.
> {code}
> The user have to restart NameNode with the "-rollingUpgrade started" option if a rolling upgrade is already started; or restart NameNode with the "-upgrade" option to start a new upgrade. It would confuse some new Hadoop users.
>
> It's better to remove deprecated Hadoop fs-image file after uninstalling HDFS-namenode in RPM spec.
>
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)