You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by jeff saremi <je...@hotmail.com> on 2017/07/27 19:17:30 UTC
distributing new regions immediately
We haven't done enough testing for me to say this with certainty but as we insert data and new regions get created, it could be a while before those regions are distributed. As such and if the data injection continues the load on the region server becomes overwhelming
Is there a way to expedite the distribution of regions among available region servers?
thanks
Re: distributing new regions immediately
Posted by jeff saremi <je...@hotmail.com>.
Thanks Dima
________________________________
From: Dima Spivak <di...@apache.org>
Sent: Thursday, July 27, 2017 12:38:56 PM
To: user@hbase.apache.org
Subject: Re: distributing new regions immediately
Presplitting tables is typically how this is addressed in production cases.
On Thu, Jul 27, 2017 at 12:17 PM jeff saremi <je...@hotmail.com> wrote:
> We haven't done enough testing for me to say this with certainty but as we
> insert data and new regions get created, it could be a while before those
> regions are distributed. As such and if the data injection continues the
> load on the region server becomes overwhelming
>
> Is there a way to expedite the distribution of regions among available
> region servers?
>
> thanks
>
> --
-Dima
Re: distributing new regions immediately
Posted by Dima Spivak <di...@apache.org>.
Presplitting tables is typically how this is addressed in production cases.
On Thu, Jul 27, 2017 at 12:17 PM jeff saremi <je...@hotmail.com> wrote:
> We haven't done enough testing for me to say this with certainty but as we
> insert data and new regions get created, it could be a while before those
> regions are distributed. As such and if the data injection continues the
> load on the region server becomes overwhelming
>
> Is there a way to expedite the distribution of regions among available
> region servers?
>
> thanks
>
> --
-Dima
Re: distributing new regions immediately
Posted by jeff saremi <je...@hotmail.com>.
very interesting. Thanks Ted
________________________________
From: Ted Yu <yu...@gmail.com>
Sent: Thursday, July 27, 2017 2:13:25 PM
To: user@hbase.apache.org
Subject: Re: distributing new regions immediately
Since you're more concerned with write load, you can take a look at the
following parameter:
hbase.master.balancer.stochastic.writeRequestCost
Default value is 5, much smaller than default value for region count cost
(500).
Consider raising the value so that load balancer reacts more responsively.
On Thu, Jul 27, 2017 at 12:17 PM, jeff saremi <je...@hotmail.com>
wrote:
> We haven't done enough testing for me to say this with certainty but as we
> insert data and new regions get created, it could be a while before those
> regions are distributed. As such and if the data injection continues the
> load on the region server becomes overwhelming
>
> Is there a way to expedite the distribution of regions among available
> region servers?
>
> thanks
>
>
Re: distributing new regions immediately
Posted by Ted Yu <yu...@gmail.com>.
Since you're more concerned with write load, you can take a look at the
following parameter:
hbase.master.balancer.stochastic.writeRequestCost
Default value is 5, much smaller than default value for region count cost
(500).
Consider raising the value so that load balancer reacts more responsively.
On Thu, Jul 27, 2017 at 12:17 PM, jeff saremi <je...@hotmail.com>
wrote:
> We haven't done enough testing for me to say this with certainty but as we
> insert data and new regions get created, it could be a while before those
> regions are distributed. As such and if the data injection continues the
> load on the region server becomes overwhelming
>
> Is there a way to expedite the distribution of regions among available
> region servers?
>
> thanks
>
>