Size of data directory same on all nodes in cluster

[Vimal Jain <vk...@gmail.com>]

Hi,
I have setup 2 node Hbase cluster on top of 2 node HDFS cluster.
When i perform "du -sh" command on data directory ( where hadoop stores
data ) on both machines , its shows the same size.
As per my understanding , of entire data half of the data is stored in one
machine and other half on other machine.
Please help.

-- 
Thanks and Regards,
Vimal Jain

Re: Size of data directory same on all nodes in cluster

[divye sheth <di...@gmail.com>]

What is the replication factor you have set on the cluster? If it is 2 then
the data should be evenly balanced between the two nodes.

Use "hadoop dfsadmin -report" command to get a full report of the
datanodes.
AFAIK it should make no difference in how data is distributed/replicated
between HDFS datanodes even when you have Hbase on top of it.

Thanks
Divye Sheth


On Wed, Mar 12, 2014 at 12:37 PM, Kashif Jawed Siddiqui <kashifjs@huawei.com
> wrote:

> You should use hadoop fs command OR hdfs dfs command to check
>
>
> Usage: hadoop fs [generic options] -du [-s] [-h] <path> ...
>
> OR
>
> Usage: hdfs dfs -du [-s] [-h] <path> ...
>
>
>
>
>
> Regards
>
> KASHIF
>
>
>
> -----Original Message-----
> From: Vimal Jain [mailto:vkjk89@gmail.com]
> Sent: 12 March 2014 11:31
> To: user@hbase.apache.org; user@hadoop.apache.org
> Subject: Size of data directory same on all nodes in cluster
>
>
>
> Hi,
>
> I have setup 2 node Hbase cluster on top of 2 node HDFS cluster.
>
> When i perform "du -sh" command on data directory ( where hadoop stores
> data ) on both machines , its shows the same size.
>
> As per my understanding , of entire data half of the data is stored in one
> machine and other half on other machine.
>
> Please help.
>
>
>
> --
>
> Thanks and Regards,
>
> Vimal Jain
>

RE: Size of data directory same on all nodes in cluster

[Kashif Jawed Siddiqui <ka...@huawei.com>]

You should use hadoop fs command OR hdfs dfs command to check


Usage: hadoop fs [generic options] -du [-s] [-h] <path> ...

OR

Usage: hdfs dfs -du [-s] [-h] <path> ...





Regards

KASHIF



-----Original Message-----
From: Vimal Jain [mailto:vkjk89@gmail.com]
Sent: 12 March 2014 11:31
To: user@hbase.apache.org; user@hadoop.apache.org
Subject: Size of data directory same on all nodes in cluster



Hi,

I have setup 2 node Hbase cluster on top of 2 node HDFS cluster.

When i perform "du -sh" command on data directory ( where hadoop stores data ) on both machines , its shows the same size.

As per my understanding , of entire data half of the data is stored in one machine and other half on other machine.

Please help.



--

Thanks and Regards,

Vimal Jain