Question about Balancer

[Harold Lim <ro...@yahoo.com>]

I currently have an HDFS cluster. On another separate machine (not part of the HDFS cluster but has the hdfs binaries), I want to run balancer.
The JavaDoc mentions about  dfs.balance.bandwidthPerSec parameter.
Where do I set this? Do I add this into my hdfs-site.xml? Do I have to also add this parameter in all datanode/namenode? Or do I simply add that on the machine that is going to run the balancer?

Suppose, I want a different bandwidthPerSec. Do I have to simply modify the hdfs-site.xml before running the balancer script?





Thanks,
Harold


      

Re: Question about Balancer

[Dhruba Borthakur <dh...@gmail.com>]

This is used by the datanodes to throttle IO requests, so you would have to
set this in the config file used by the datanode(s) and then restart those
datanodes.

thanks,
dhruba


On Thu, Sep 10, 2009 at 2:50 PM, Harold Lim <ro...@yahoo.com> wrote:

> I currently have an HDFS cluster. On another separate machine (not part of
> the HDFS cluster but has the hdfs binaries), I want to run balancer.
> The JavaDoc mentions about  dfs.balance.bandwidthPerSec parameter.
> Where do I set this? Do I add this into my hdfs-site.xml? Do I have to also
> add this parameter in all datanode/namenode? Or do I simply add that on the
> machine that is going to run the balancer?
>
> Suppose, I want a different bandwidthPerSec. Do I have to simply modify the
> hdfs-site.xml before running the balancer script?
>
>
>
>
>
> Thanks,
> Harold
>
>
>
>