You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Ted Yu <yu...@gmail.com> on 2016/04/20 15:07:06 UTC
Re: single thread threadpool for master_table_operation
Adding subject.
Adding back user@hbase
But the master wouldn't know what next action admin is going to perform,
right ?
On Wed, Apr 20, 2016 at 5:59 AM, WangYQ <wa...@163.com> wrote:
> if i just disable tables in concurrently,
> and will never enable, modify, create table
>
> i think is ok, right?
>
>
>
>
> 在2016年04月20日 20:53 ，Ted Yu <yu...@gmail.com>写道：
>
>
> Have you seen the comment above that line ?
>
> // We depend on there being only one instance of this executor running
> // at a time. To do concurrency, would need fencing of enable/disable
> of
> // tables.
> // Any time changing this maxThreads to > 1, pls see the comment at
> // AccessController#postCreateTableHandler
>
> BTW in the future, please send queries to user@hbase
>
> On Wed, Apr 20, 2016 at 5:50 AM, WangYQ <wa...@163.com> wrote:
>
>> hbase 0.98.10
>>
>> in class hmaster
>> line 1298, the threadpool size for master_table_operation is 1, can not
>> be set
>>
>> are there any problems if i disable tables in concurrently
>>
>> thanks
>
>
>
>
>
Re: Re: Re: single thread threadpool for master_table_operation
Posted by WangYQ <wa...@163.com>.
cp is coprocsssor
this step is carried out before upgrade hbase, so after remove cp, old hbase will not be used
so i want to increase the pool size in old version to speed up the process of removing cp
On 2016-04-20 22:01 , Ted Yu Wrote:
bq. all cp of all tables
What does cp mean ? Do you mean column family ?
bq. will never create/enable tables in the future
Then what would the cluster be used for ?
On Wed, Apr 20, 2016 at 6:16 AM, WangYQ <wa...@163.com> wrote:
> i want to remove all cp of all tables in hbase
> so i disable tables concurrently, and then modify tables
> for hundreds of tables, remove all cp costs 30 miniutes, is not so fast
>
>
> so, i want to speed the whoe process. and will never create/enable tables
> in the future
>
>
> after examine the code, i want ot increase the pool size for
> master_table_operation
>
>
> but not sure if there are any problems.
>
>
> thanks..
>
> At 2016-04-20 21:07:06, "Ted Yu" <yu...@gmail.com> wrote:
> >Adding subject.
> >
> >Adding back user@hbase
> >
> >But the master wouldn't know what next action admin is going to perform,
> >right ?
> >
> >On Wed, Apr 20, 2016 at 5:59 AM, WangYQ <wa...@163.com>
> wrote:
> >
> >> if i just disable tables in concurrently,
> >> and will never enable, modify, create table
> >>
> >> i think is ok, right?
> >>
> >>
> >>
> >>
> >> 在2016年04月20日 20:53 ，Ted Yu <yu...@gmail.com>写道：
> >>
> >>
> >> Have you seen the comment above that line ?
> >>
> >> // We depend on there being only one instance of this executor
> running
> >> // at a time. To do concurrency, would need fencing of
> enable/disable
> >> of
> >> // tables.
> >> // Any time changing this maxThreads to > 1, pls see the comment at
> >> // AccessController#postCreateTableHandler
> >>
> >> BTW in the future, please send queries to user@hbase
> >>
> >> On Wed, Apr 20, 2016 at 5:50 AM, WangYQ <wa...@163.com>
> wrote:
> >>
> >>> hbase 0.98.10
> >>>
> >>> in class hmaster
> >>> line 1298, the threadpool size for master_table_operation is 1, can not
> >>> be set
> >>>
> >>> are there any problems if i disable tables in concurrently
> >>>
> >>> thanks
> >>
> >>
> >>
> >>
> >>
>
Re: Re: single thread threadpool for master_table_operation
Posted by Ted Yu <yu...@gmail.com>.
bq. all cp of all tables
What does cp mean ? Do you mean column family ?
bq. will never create/enable tables in the future
Then what would the cluster be used for ?
On Wed, Apr 20, 2016 at 6:16 AM, WangYQ <wa...@163.com> wrote:
> i want to remove all cp of all tables in hbase
> so i disable tables concurrently, and then modify tables
> for hundreds of tables, remove all cp costs 30 miniutes, is not so fast
>
>
> so, i want to speed the whoe process. and will never create/enable tables
> in the future
>
>
> after examine the code, i want ot increase the pool size for
> master_table_operation
>
>
> but not sure if there are any problems.
>
>
> thanks..
>
> At 2016-04-20 21:07:06, "Ted Yu" <yu...@gmail.com> wrote:
> >Adding subject.
> >
> >Adding back user@hbase
> >
> >But the master wouldn't know what next action admin is going to perform,
> >right ?
> >
> >On Wed, Apr 20, 2016 at 5:59 AM, WangYQ <wa...@163.com>
> wrote:
> >
> >> if i just disable tables in concurrently,
> >> and will never enable, modify, create table
> >>
> >> i think is ok, right?
> >>
> >>
> >>
> >>
> >> 在2016年04月20日 20:53 ，Ted Yu <yu...@gmail.com>写道：
> >>
> >>
> >> Have you seen the comment above that line ?
> >>
> >> // We depend on there being only one instance of this executor
> running
> >> // at a time. To do concurrency, would need fencing of
> enable/disable
> >> of
> >> // tables.
> >> // Any time changing this maxThreads to > 1, pls see the comment at
> >> // AccessController#postCreateTableHandler
> >>
> >> BTW in the future, please send queries to user@hbase
> >>
> >> On Wed, Apr 20, 2016 at 5:50 AM, WangYQ <wa...@163.com>
> wrote:
> >>
> >>> hbase 0.98.10
> >>>
> >>> in class hmaster
> >>> line 1298, the threadpool size for master_table_operation is 1, can not
> >>> be set
> >>>
> >>> are there any problems if i disable tables in concurrently
> >>>
> >>> thanks
> >>
> >>
> >>
> >>
> >>
>
Re:Re: single thread threadpool for master_table_operation
Posted by WangYQ <wa...@163.com>.
i want to remove all cp of all tables in hbase
so i disable tables concurrently, and then modify tables
for hundreds of tables, remove all cp costs 30 miniutes, is not so fast
so, i want to speed the whoe process. and will never create/enable tables in the future
after examine the code, i want ot increase the pool size for master_table_operation
but not sure if there are any problems.
thanks..
At 2016-04-20 21:07:06, "Ted Yu" <yu...@gmail.com> wrote:
>Adding subject.
>
>Adding back user@hbase
>
>But the master wouldn't know what next action admin is going to perform,
>right ?
>
>On Wed, Apr 20, 2016 at 5:59 AM, WangYQ <wa...@163.com> wrote:
>
>> if i just disable tables in concurrently,
>> and will never enable, modify, create table
>>
>> i think is ok, right?
>>
>>
>>
>>
>> 在2016年04月20日 20:53 ，Ted Yu <yu...@gmail.com>写道：
>>
>>
>> Have you seen the comment above that line ?
>>
>> // We depend on there being only one instance of this executor running
>> // at a time. To do concurrency, would need fencing of enable/disable
>> of
>> // tables.
>> // Any time changing this maxThreads to > 1, pls see the comment at
>> // AccessController#postCreateTableHandler
>>
>> BTW in the future, please send queries to user@hbase
>>
>> On Wed, Apr 20, 2016 at 5:50 AM, WangYQ <wa...@163.com> wrote:
>>
>>> hbase 0.98.10
>>>
>>> in class hmaster
>>> line 1298, the threadpool size for master_table_operation is 1, can not
>>> be set
>>>
>>> are there any problems if i disable tables in concurrently
>>>
>>> thanks
>>
>>
>>
>>
>>