You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Manjeet Singh <ma...@gmail.com> on 2016/12/06 17:19:06 UTC
Adding new node in cluster (Load balancer)
Hi All,
Can anyone help me if I want add new node of same configuration in cluser,
then how and what step I need to perform for distribution of data via load
balancer.
Thanks
Manjeet
Re: Adding new node in cluster (Load balancer)
Posted by Manjeet Singh <ma...@gmail.com>.
Thanks Esteban for your reply :)
On 6 Dec 2016 23:14, "Esteban Gutierrez" <es...@cloudera.com> wrote:
> Hi Manjeet,
>
> HBase will perform the balancing for you automatically as long as the HBase
> balancer hasn't been disabled. You can check for the state of the balancer
> using the hbase shell:
>
> $ hbase shell
> hbase(main):008:0> balancer_enabled
> true
>
> Assuming the balancer hasn't been turned off, that should be enough for you
> to let the HBase Master re-balance the regions in the cluster to include
> the new server, otherwise if the balancer is off (false) then you can
> re-enable it with the "balance_switch true" command from the hbase shell.
> See also the "balancer" command from the shell.
>
> cheers,
> esteban.
>
>
> --
> Cloudera, Inc.
>
>
> On Tue, Dec 6, 2016 at 9:19 AM, Manjeet Singh <ma...@gmail.com>
> wrote:
>
> > Hi All,
> > Can anyone help me if I want add new node of same configuration in
> cluser,
> > then how and what step I need to perform for distribution of data via
> load
> > balancer.
> >
> > Thanks
> > Manjeet
> >
>
Re: Adding new node in cluster (Load balancer)
Posted by Ted Yu <yu...@gmail.com>.
Manjeet:
Have you looked at HDFS-10540 ?
Not sure if the distribution you use has the fix.
FYI
On Wed, Dec 14, 2016 at 9:34 PM, Manjeet Singh <ma...@gmail.com>
wrote:
> Once I read some where that do not run HDFS balancer otherwise it will
> spoil Meta of Hbase
>
> I am getting bellow erroe when I add new node
>
> Dec 15, 8:23:14.549 AM ERROR
> org.apache.hadoop.hdfs.server.datanode.DiskBalancer
>
>
> Disk Balancer is not enabled.
>
>
> can any onesuggest me what to do now
>
> Thanks
> Manjeet
>
> On Tue, Dec 6, 2016 at 11:14 PM, Esteban Gutierrez <es...@cloudera.com>
> wrote:
>
> > Hi Manjeet,
> >
> > HBase will perform the balancing for you automatically as long as the
> HBase
> > balancer hasn't been disabled. You can check for the state of the
> balancer
> > using the hbase shell:
> >
> > $ hbase shell
> > hbase(main):008:0> balancer_enabled
> > true
> >
> > Assuming the balancer hasn't been turned off, that should be enough for
> you
> > to let the HBase Master re-balance the regions in the cluster to include
> > the new server, otherwise if the balancer is off (false) then you can
> > re-enable it with the "balance_switch true" command from the hbase shell.
> > See also the "balancer" command from the shell.
> >
> > cheers,
> > esteban.
> >
> >
> > --
> > Cloudera, Inc.
> >
> >
> > On Tue, Dec 6, 2016 at 9:19 AM, Manjeet Singh <
> manjeet.chandhok@gmail.com>
> > wrote:
> >
> > > Hi All,
> > > Can anyone help me if I want add new node of same configuration in
> > cluser,
> > > then how and what step I need to perform for distribution of data via
> > load
> > > balancer.
> > >
> > > Thanks
> > > Manjeet
> > >
> >
>
>
>
> --
> luv all
>
Re: Adding new node in cluster (Load balancer)
Posted by Manjeet Singh <ma...@gmail.com>.
Once I read some where that do not run HDFS balancer otherwise it will
spoil Meta of Hbase
I am getting bellow erroe when I add new node
Dec 15, 8:23:14.549 AM ERROR
org.apache.hadoop.hdfs.server.datanode.DiskBalancer
Disk Balancer is not enabled.
can any onesuggest me what to do now
Thanks
Manjeet
On Tue, Dec 6, 2016 at 11:14 PM, Esteban Gutierrez <es...@cloudera.com>
wrote:
> Hi Manjeet,
>
> HBase will perform the balancing for you automatically as long as the HBase
> balancer hasn't been disabled. You can check for the state of the balancer
> using the hbase shell:
>
> $ hbase shell
> hbase(main):008:0> balancer_enabled
> true
>
> Assuming the balancer hasn't been turned off, that should be enough for you
> to let the HBase Master re-balance the regions in the cluster to include
> the new server, otherwise if the balancer is off (false) then you can
> re-enable it with the "balance_switch true" command from the hbase shell.
> See also the "balancer" command from the shell.
>
> cheers,
> esteban.
>
>
> --
> Cloudera, Inc.
>
>
> On Tue, Dec 6, 2016 at 9:19 AM, Manjeet Singh <ma...@gmail.com>
> wrote:
>
> > Hi All,
> > Can anyone help me if I want add new node of same configuration in
> cluser,
> > then how and what step I need to perform for distribution of data via
> load
> > balancer.
> >
> > Thanks
> > Manjeet
> >
>
--
luv all
Re: Adding new node in cluster (Load balancer)
Posted by Esteban Gutierrez <es...@cloudera.com>.
Unfortunately the difference in available space per node won't be
considered by the HBase balancer, but it shouldn't matter since you are
adding more space. Worst case scenario is that you will start filling up
the other disks first before the one with the 6TB.
cheers,
esteban.
--
Cloudera, Inc.
On Wed, Dec 7, 2016 at 1:40 AM, Manjeet Singh <ma...@gmail.com>
wrote:
> Question > What if I have uneven storage
> I have 6 HDD of 300 GB
> now i want to add single Node with HDD of 6 TB so what will be the impact?
> and how and what things I do need to take care?
>
> Thanks
> Manjeet
>
> On Tue, Dec 6, 2016 at 11:14 PM, Esteban Gutierrez <es...@cloudera.com>
> wrote:
>
> > Hi Manjeet,
> >
> > HBase will perform the balancing for you automatically as long as the
> HBase
> > balancer hasn't been disabled. You can check for the state of the
> balancer
> > using the hbase shell:
> >
> > $ hbase shell
> > hbase(main):008:0> balancer_enabled
> > true
> >
> > Assuming the balancer hasn't been turned off, that should be enough for
> you
> > to let the HBase Master re-balance the regions in the cluster to include
> > the new server, otherwise if the balancer is off (false) then you can
> > re-enable it with the "balance_switch true" command from the hbase shell.
> > See also the "balancer" command from the shell.
> >
> > cheers,
> > esteban.
> >
> >
> > --
> > Cloudera, Inc.
> >
> >
> > On Tue, Dec 6, 2016 at 9:19 AM, Manjeet Singh <
> manjeet.chandhok@gmail.com>
> > wrote:
> >
> > > Hi All,
> > > Can anyone help me if I want add new node of same configuration in
> > cluser,
> > > then how and what step I need to perform for distribution of data via
> > load
> > > balancer.
> > >
> > > Thanks
> > > Manjeet
> > >
> >
>
>
>
> --
> luv all
>
Re: Adding new node in cluster (Load balancer)
Posted by Manjeet Singh <ma...@gmail.com>.
Question > What if I have uneven storage
I have 6 HDD of 300 GB
now i want to add single Node with HDD of 6 TB so what will be the impact?
and how and what things I do need to take care?
Thanks
Manjeet
On Tue, Dec 6, 2016 at 11:14 PM, Esteban Gutierrez <es...@cloudera.com>
wrote:
> Hi Manjeet,
>
> HBase will perform the balancing for you automatically as long as the HBase
> balancer hasn't been disabled. You can check for the state of the balancer
> using the hbase shell:
>
> $ hbase shell
> hbase(main):008:0> balancer_enabled
> true
>
> Assuming the balancer hasn't been turned off, that should be enough for you
> to let the HBase Master re-balance the regions in the cluster to include
> the new server, otherwise if the balancer is off (false) then you can
> re-enable it with the "balance_switch true" command from the hbase shell.
> See also the "balancer" command from the shell.
>
> cheers,
> esteban.
>
>
> --
> Cloudera, Inc.
>
>
> On Tue, Dec 6, 2016 at 9:19 AM, Manjeet Singh <ma...@gmail.com>
> wrote:
>
> > Hi All,
> > Can anyone help me if I want add new node of same configuration in
> cluser,
> > then how and what step I need to perform for distribution of data via
> load
> > balancer.
> >
> > Thanks
> > Manjeet
> >
>
--
luv all
Re: Adding new node in cluster (Load balancer)
Posted by Esteban Gutierrez <es...@cloudera.com>.
Hi Manjeet,
HBase will perform the balancing for you automatically as long as the HBase
balancer hasn't been disabled. You can check for the state of the balancer
using the hbase shell:
$ hbase shell
hbase(main):008:0> balancer_enabled
true
Assuming the balancer hasn't been turned off, that should be enough for you
to let the HBase Master re-balance the regions in the cluster to include
the new server, otherwise if the balancer is off (false) then you can
re-enable it with the "balance_switch true" command from the hbase shell.
See also the "balancer" command from the shell.
cheers,
esteban.
--
Cloudera, Inc.
On Tue, Dec 6, 2016 at 9:19 AM, Manjeet Singh <ma...@gmail.com>
wrote:
> Hi All,
> Can anyone help me if I want add new node of same configuration in cluser,
> then how and what step I need to perform for distribution of data via load
> balancer.
>
> Thanks
> Manjeet
>