HDFS Balancer and HBase

[Erik Onnen <eo...@gmail.com>]

Is there any reason why running an HDFS balancer on the filesystem
used for HBase would be considered bad practice? Doesn't seem so to me
at face value but I wanted to be sure it seemed sane before enabling
it.

Thanks,
-erik

Re: HDFS Balancer and HBase

[Jean-Daniel Cryans <jd...@apache.org>]

It would move blocks that are used by the local region servers,
messing up your block locality. That the first reason I can think of.

J-D

On Mon, May 16, 2011 at 11:14 AM, Erik Onnen <eo...@gmail.com> wrote:
> Is there any reason why running an HDFS balancer on the filesystem
> used for HBase would be considered bad practice? Doesn't seem so to me
> at face value but I wanted to be sure it seemed sane before enabling
> it.
>
> Thanks,
> -erik
>

Re: HDFS Balancer and HBase

[Erik Onnen <eo...@gmail.com>]

We're only at about .4 network capacity during peak load so I don't
think we'll cause network issues. Disk I/O may be another story but
network will be fine I suspect.

On Mon, May 16, 2011 at 11:16 AM, Stack <st...@duboce.net> wrote:
> Should be fine.  Don't run it at a high rate or the network traffic
> will drag on your hbase serving.
> St.Ack
>
> On Mon, May 16, 2011 at 11:14 AM, Erik Onnen <eo...@gmail.com> wrote:
>> Is there any reason why running an HDFS balancer on the filesystem
>> used for HBase would be considered bad practice? Doesn't seem so to me
>> at face value but I wanted to be sure it seemed sane before enabling
>> it.
>>
>> Thanks,
>> -erik
>>
>

Re: HDFS Balancer and HBase

[Stack <st...@duboce.net>]

Should be fine.  Don't run it at a high rate or the network traffic
will drag on your hbase serving.
St.Ack

On Mon, May 16, 2011 at 11:14 AM, Erik Onnen <eo...@gmail.com> wrote:
> Is there any reason why running an HDFS balancer on the filesystem
> used for HBase would be considered bad practice? Doesn't seem so to me
> at face value but I wanted to be sure it seemed sane before enabling
> it.
>
> Thanks,
> -erik
>