You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by andreina <an...@huawei.com> on 2012/04/25 10:19:02 UTC
Query regarding the configuration in hdfs-site.xml
Hi,
When "dfs.namenode.safemode.min.datanodes" is configured to n
So namenode will be in safemode until n DN are registered with the namenode
.
But in UI it displays that n+1 datanodes are additionally needed. And "safe
mode will be turned off automatically " message is also displayed .
==========
"dfs.namenode.safemode.min.datanodes" =2
Started the NN
The UI report displays that
"Safe mode is on.The number of live datanodes 0 needs additional 3 live
datanodes to reach the minimum number 2. Safe mode will turned off
automatically".
Scenario 2:
========
"dfs.namenode.safemode.min.datanodes"=2147483647
UI report
"Safemode is on.The number of live datanodes 0 needs additional live
datanodes -2147483648 to reach the minimum number 2147483647. Safe mode
will turned off automatically"
As per the given description when the configured value is reached the
namenode comes out of safemode
But Why In the UI report shows that it needs additional n+1 datanode needed
when configured to n ?
For the configuration dfs.namenode.safemode.threshold-pct also adds one
block extra in the UI report
Scenario :3
==========
dfs.namenode.safemode.threshold-pct=1
Started NN,2DN
Wrote a file with 167 blocks
Stoped 2DN and NN
Started NN
UI report:
"Safemode is on.The reported blocks 0 needs additional 168 blocks to reach
threshold 1.000 0f total blocks 167.Safe mode will turned off
automatically".
Huawei Technologies India Pvt. Ltd.
Level 3,4 &5 Leela Galleria, The Leela Palce
23, Airport Road, Bangalore - 560008
<http://www.huawei.com> www.huawei.com
----------------------------------------------------------------------------
---------------------------------------------------------
This e-mail and its attachments contain confidential information from
HUAWEI, which
is intended only for the person or entity whose address is listed above. Any
use of the
information contained herein in any way (including, but not limited to,
total or partial
disclosure, reproduction, or dissemination) by persons other than the
intended
recipient(s) is prohibited. If you receive this e-mail in error, please
notify the sender by
phone or email immediately and delete it!
Re: Query regarding the configuration in hdfs-site.xml
Posted by Ravi Prakash <ra...@gmail.com>.
Hi Andreina,
You are right! FSNamesystem.java:3156 (and line 3023) has a "less than"
comparison, when in fact it ought to be <= . Could you please file a JIRA?
Thanks
Ravi.
if (numLive < datanodeThreshold) {
if (!"".equals(msg)) {
msg += "\n";
}
msg += String.format(
"The number of live datanodes %d needs an additional %d live "
+ "datanodes to reach the minimum number %d.",
numLive, (datanodeThreshold - numLive) + 1 , datanodeThreshold);
}
On Wed, Apr 25, 2012 at 3:19 AM, andreina <an...@huawei.com> wrote:
> Hi,****
>
> When *“dfs.namenode.safemode.min.datanodes”* is configured to n****
>
> So namenode will be in safemode until n DN are registered with the
> namenode .****
>
> ** **
>
> But in UI it displays that n+1 datanodes are additionally needed. And
> “safe mode will be turned off automatically “ message is also displayed .*
> ***
>
> ==========****
>
> “dfs.namenode.safemode.min.datanodes” =2****
>
> Started the NN****
>
> The UI report displays that ****
>
> ** **
>
> “Safe mode is on.The number of live datanodes 0 needs additional *3* live
> inimum number 2. Safe mode will turned off automatically”.****
>
> Scenario 2:****
>
> ========****
>
> “dfs.namenode.safemode.min.datanodes”=2147483647****
>
> ** **
>
> UI report****
>
> “Safemode is on.The number of live datanodes 0 needs additional live
> datanodes *-2147483648 *to reach the minimum number 2147483647. Safe
> mode will turned off automatically*”*
>
> ** **
>
> *As per the given description when the configured value is reached the
> namenode comes out of safemode*
>
> *But Why In the UI report shows that it needs additional n+1 datanode
> needed when configured to n ?*
>
> ** **
>
> ** **
> e configuration *dfs.namenode.safemode.threshold-pct* also adds one
> block extra in the UI report****
>
> Scenario :3****
>
> ==========****
>
> dfs.namenode.safemode.threshold-pct=1****
>
> Started NN,2DN****
>
> Wrote a file with 167 blocks****
>
> Stoped 2DN and NN****
>
> Started NN****
>
> UI report:****
>
> “Safemode is on.The reported blocks 0 needs additional *168 *blocks to
> reach threshold 1.000 0f total blocks 167.Safe mode will turned off
> automatically”.****
>
> ** **
>
>
> Huawei Technologies India Pvt. Ltd.
> Level 3,4 e Leela Palce
> 23, Airport Road, Bangalore - 560008
>
>
> www.huawei.com
>
> -------------------------------------------------------------------------------------------------------------------------------------
> This e-mail and its attachments contain confidential information from
> HUAWEI, which
> is intended only for the person or entity whose address is listed above.
> Any use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender by
> phone or email immediately and delete it!****
>
> ** **
>