You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Manoj Samel <ma...@gmail.com> on 2014/10/09 00:33:58 UTC
How to find extent of data node imbalance ?
Hi,
Before running hadoop rebalancer, it is possible to find the extent to
which the data nodes are unbalanced ?
Thanks,
RE: How to find extent of data node imbalance ?
Posted by Brahma Reddy Battula <br...@huawei.com>.
HI Manoj,
You can check from namenode web UI also apart from what you mentioned..
http://<NameNode-host>:<httpPort>/dfsnodelist.jsp?whatNodes=LIVE<http://10.18.51.157:25000/dfsnodelist.jsp?whatNodes=LIVE>
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Manoj Samel [manojsameltech@gmail.com]
Sent: Saturday, October 11, 2014 2:26 AM
To: user@hadoop.apache.org
Subject: Re: How to find extent of data node imbalance ?
Reposting ...
One option is to do "hdfs dfsadmin -report" and see "DFS Used%" on each data node and then compute the extent of imbalance across nodes. Is there any other way ?
Thanks,
On Wed, Oct 8, 2014 at 3:33 PM, Manoj Samel <ma...@gmail.com>> wrote:
Hi,
Before running hadoop rebalancer, it is possible to find the extent to which the data nodes are unbalanced ?
Thanks,
RE: How to find extent of data node imbalance ?
Posted by Brahma Reddy Battula <br...@huawei.com>.
HI Manoj,
You can check from namenode web UI also apart from what you mentioned..
http://<NameNode-host>:<httpPort>/dfsnodelist.jsp?whatNodes=LIVE<http://10.18.51.157:25000/dfsnodelist.jsp?whatNodes=LIVE>
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Manoj Samel [manojsameltech@gmail.com]
Sent: Saturday, October 11, 2014 2:26 AM
To: user@hadoop.apache.org
Subject: Re: How to find extent of data node imbalance ?
Reposting ...
One option is to do "hdfs dfsadmin -report" and see "DFS Used%" on each data node and then compute the extent of imbalance across nodes. Is there any other way ?
Thanks,
On Wed, Oct 8, 2014 at 3:33 PM, Manoj Samel <ma...@gmail.com>> wrote:
Hi,
Before running hadoop rebalancer, it is possible to find the extent to which the data nodes are unbalanced ?
Thanks,
RE: How to find extent of data node imbalance ?
Posted by Brahma Reddy Battula <br...@huawei.com>.
HI Manoj,
You can check from namenode web UI also apart from what you mentioned..
http://<NameNode-host>:<httpPort>/dfsnodelist.jsp?whatNodes=LIVE<http://10.18.51.157:25000/dfsnodelist.jsp?whatNodes=LIVE>
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Manoj Samel [manojsameltech@gmail.com]
Sent: Saturday, October 11, 2014 2:26 AM
To: user@hadoop.apache.org
Subject: Re: How to find extent of data node imbalance ?
Reposting ...
One option is to do "hdfs dfsadmin -report" and see "DFS Used%" on each data node and then compute the extent of imbalance across nodes. Is there any other way ?
Thanks,
On Wed, Oct 8, 2014 at 3:33 PM, Manoj Samel <ma...@gmail.com>> wrote:
Hi,
Before running hadoop rebalancer, it is possible to find the extent to which the data nodes are unbalanced ?
Thanks,
RE: How to find extent of data node imbalance ?
Posted by Brahma Reddy Battula <br...@huawei.com>.
HI Manoj,
You can check from namenode web UI also apart from what you mentioned..
http://<NameNode-host>:<httpPort>/dfsnodelist.jsp?whatNodes=LIVE<http://10.18.51.157:25000/dfsnodelist.jsp?whatNodes=LIVE>
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Manoj Samel [manojsameltech@gmail.com]
Sent: Saturday, October 11, 2014 2:26 AM
To: user@hadoop.apache.org
Subject: Re: How to find extent of data node imbalance ?
Reposting ...
One option is to do "hdfs dfsadmin -report" and see "DFS Used%" on each data node and then compute the extent of imbalance across nodes. Is there any other way ?
Thanks,
On Wed, Oct 8, 2014 at 3:33 PM, Manoj Samel <ma...@gmail.com>> wrote:
Hi,
Before running hadoop rebalancer, it is possible to find the extent to which the data nodes are unbalanced ?
Thanks,
Re: How to find extent of data node imbalance ?
Posted by Manoj Samel <ma...@gmail.com>.
Reposting ...
One option is to do "hdfs dfsadmin -report" and see "DFS Used%" on each
data node and then compute the extent of imbalance across nodes. Is there
any other way ?
Thanks,
On Wed, Oct 8, 2014 at 3:33 PM, Manoj Samel <ma...@gmail.com>
wrote:
> Hi,
>
> Before running hadoop rebalancer, it is possible to find the extent to
> which the data nodes are unbalanced ?
>
> Thanks,
>
Re: How to find extent of data node imbalance ?
Posted by Manoj Samel <ma...@gmail.com>.
Reposting ...
One option is to do "hdfs dfsadmin -report" and see "DFS Used%" on each
data node and then compute the extent of imbalance across nodes. Is there
any other way ?
Thanks,
On Wed, Oct 8, 2014 at 3:33 PM, Manoj Samel <ma...@gmail.com>
wrote:
> Hi,
>
> Before running hadoop rebalancer, it is possible to find the extent to
> which the data nodes are unbalanced ?
>
> Thanks,
>
Re: How to find extent of data node imbalance ?
Posted by Manoj Samel <ma...@gmail.com>.
Reposting ...
One option is to do "hdfs dfsadmin -report" and see "DFS Used%" on each
data node and then compute the extent of imbalance across nodes. Is there
any other way ?
Thanks,
On Wed, Oct 8, 2014 at 3:33 PM, Manoj Samel <ma...@gmail.com>
wrote:
> Hi,
>
> Before running hadoop rebalancer, it is possible to find the extent to
> which the data nodes are unbalanced ?
>
> Thanks,
>
Re: How to find extent of data node imbalance ?
Posted by Manoj Samel <ma...@gmail.com>.
Reposting ...
One option is to do "hdfs dfsadmin -report" and see "DFS Used%" on each
data node and then compute the extent of imbalance across nodes. Is there
any other way ?
Thanks,
On Wed, Oct 8, 2014 at 3:33 PM, Manoj Samel <ma...@gmail.com>
wrote:
> Hi,
>
> Before running hadoop rebalancer, it is possible to find the extent to
> which the data nodes are unbalanced ?
>
> Thanks,
>