You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by mohanpothula <mo...@gmail.com> on 2015/07/23 04:03:10 UTC

Terasort query

I have setup 3 node cluster each node having 100GB for configured VM on 3
nodes .
When I did Terasort first time ,very less space reserved for NonHDFS , due
to that blocks are corrupted on 3 nodes .Again I had setup the cluster with
300GB on each node .
To get HDFS size use the below command on each node .
 sudo -u hdfs hadoop fs -du -h /
0        0       /system
3.4 M    10.1 M  /tmp
385.1 M  1.1 G   /user

There are total 4 GB used for HDFS

Can you please help on the below  terasort testing on 3 node cluster

1.How much HDFS size?
2.How much Non HDFS size?
3.Any customization parameters are required?

Regards,
Mohan