You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jeff Whiting <je...@qualtrics.com> on 2011/09/13 00:10:52 UTC
Balancer is running automatically
Any hints as to why the balancer isn't running automatically. I'll have a situation like the one below:
ds1.dev.qualtrics.com:60030 1315865095639 requests=0, regions=0, usedHeap=35, maxHeap=795
ds2.dev.qualtrics.com:60030 1315865040205 requests=0, regions=0, usedHeap=41, maxHeap=795
ds3.dev.qualtrics.com:60030 1315841275719 requests=45, regions=23, usedHeap=77, maxHeap=795
ds4.dev.qualtrics.com:60030 1315841273112 requests=5, regions=23, usedHeap=359, maxHeap=795
In the hbase shell I check that the balancer is supposed to be running.
hbase(main):004:0> balance_switch true
true
0 row(s) in 0.9360 seconds
It is. But it wont balance the regions until I run:
hbase(main):007:0> balancer
false
0 row(s) in 0.1000 seconds
Then everything looks good:
ds1.dev.qualtrics.com:60030 1315865095639 requests=0, regions=11, usedHeap=40, maxHeap=795
ds2.dev.qualtrics.com:60030 1315865040205 requests=3, regions=11, usedHeap=44, maxHeap=795
ds3.dev.qualtrics.com:60030 1315841275719 requests=0, regions=12, usedHeap=83, maxHeap=795
ds4.dev.qualtrics.com:60030 1315841273112 requests=1, regions=12, usedHeap=349, maxHeap=795
Is there a place I should be looking to see why the balancer isn't running automatically?
Thanks,
~Jeff
--
Jeff Whiting
Qualtrics Senior Software Engineer
jeffw@qualtrics.com
Re: Balancer is running automatically
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Have a look at the master log, it's usually because a region is stuck
in transition or it's still processing (or think it's processing) a
dead server.
J-D
On Mon, Sep 12, 2011 at 3:10 PM, Jeff Whiting <je...@qualtrics.com> wrote:
> Any hints as to why the balancer isn't running automatically. I'll have a
> situation like the one below:
>
> ds1.dev.qualtrics.com:60030 1315865095639 requests=0, regions=0,
> usedHeap=35, maxHeap=795
> ds2.dev.qualtrics.com:60030 1315865040205 requests=0, regions=0,
> usedHeap=41, maxHeap=795
> ds3.dev.qualtrics.com:60030 1315841275719 requests=45, regions=23,
> usedHeap=77, maxHeap=795
> ds4.dev.qualtrics.com:60030 1315841273112 requests=5, regions=23,
> usedHeap=359, maxHeap=795
>
> In the hbase shell I check that the balancer is supposed to be running.
>
> hbase(main):004:0> balance_switch true
> true
> 0 row(s) in 0.9360 seconds
>
> It is. But it wont balance the regions until I run:
>
> hbase(main):007:0> balancer
> false
> 0 row(s) in 0.1000 seconds
>
> Then everything looks good:
> ds1.dev.qualtrics.com:60030 1315865095639 requests=0, regions=11,
> usedHeap=40, maxHeap=795
> ds2.dev.qualtrics.com:60030 1315865040205 requests=3, regions=11,
> usedHeap=44, maxHeap=795
> ds3.dev.qualtrics.com:60030 1315841275719 requests=0, regions=12,
> usedHeap=83, maxHeap=795
> ds4.dev.qualtrics.com:60030 1315841273112 requests=1, regions=12,
> usedHeap=349, maxHeap=795
>
> Is there a place I should be looking to see why the balancer isn't running
> automatically?
>
> Thanks,
> ~Jeff
>
> --
> Jeff Whiting
> Qualtrics Senior Software Engineer
> jeffw@qualtrics.com
>
>
RE: Balancer is running automatically
Posted by Ramkrishna S Vasudevan <ra...@huawei.com>.
Hi Jeff
Balancer is a periodic operation. Did you wait for the specified period for
the balancer to run?
the balancer period is determined by the property "hbase.balancer.period".
Incase you need to check if its running pump in some regions and set this
property to a lower value. Then you can see the balancer running .
But one thing to be noted is,
If for some reason some region had been in transition due to some abnormal
operation of ZK or HDFS then balancer will not run. You need to inspect the
logs to know this.
Best Regards
Ram
-----Original Message-----
From: Jeff Whiting [mailto:jeffw@qualtrics.com]
Sent: Tuesday, September 13, 2011 3:41 AM
To: user@hbase.apache.org
Subject: Balancer is running automatically
Any hints as to why the balancer isn't running automatically. I'll have a
situation like the one below:
ds1.dev.qualtrics.com:60030 1315865095639 requests=0, regions=0,
usedHeap=35, maxHeap=795
ds2.dev.qualtrics.com:60030 1315865040205 requests=0, regions=0,
usedHeap=41, maxHeap=795
ds3.dev.qualtrics.com:60030 1315841275719 requests=45, regions=23,
usedHeap=77, maxHeap=795
ds4.dev.qualtrics.com:60030 1315841273112 requests=5, regions=23,
usedHeap=359, maxHeap=795
In the hbase shell I check that the balancer is supposed to be running.
hbase(main):004:0> balance_switch true
true
0 row(s) in 0.9360 seconds
It is. But it wont balance the regions until I run:
hbase(main):007:0> balancer
false
0 row(s) in 0.1000 seconds
Then everything looks good:
ds1.dev.qualtrics.com:60030 1315865095639 requests=0, regions=11,
usedHeap=40, maxHeap=795
ds2.dev.qualtrics.com:60030 1315865040205 requests=3, regions=11,
usedHeap=44, maxHeap=795
ds3.dev.qualtrics.com:60030 1315841275719 requests=0, regions=12,
usedHeap=83, maxHeap=795
ds4.dev.qualtrics.com:60030 1315841273112 requests=1, regions=12,
usedHeap=349, maxHeap=795
Is there a place I should be looking to see why the balancer isn't running
automatically?
Thanks,
~Jeff
--
Jeff Whiting
Qualtrics Senior Software Engineer
jeffw@qualtrics.com