You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Shushant Arora <sh...@gmail.com> on 2016/02/17 01:46:01 UTC
disable major compaction per table
Hi
1.does major compaction in hbase runs per table basis.
2.By default every 24 hours?
3.Can I disable automatic major compaction for few tables while keep it
enable for rest of tables?
4.Does hbase put ,get and delete are blocked while major compaction and are
working in minor compaction?
Thanks
Re: disable major compaction per table
Posted by Ted Yu <yu...@gmail.com>.
Please see the following for description on data block encoding :
http://hbase.apache.org/book.html#compression
If you have further questions on data block encoding, please start another
thread.
On Thu, Feb 18, 2016 at 3:16 AM, Shushant Arora <sh...@gmail.com>
wrote:
> Thanks!
>
> does hbase compress repeated values in keys and columns :location say
> (ASIA). will that be repeated with each key or hbase snappy compression
> will handle that.
>
> same applies for repeated values of a column?
>
> Thanks!
>
> On Wed, Feb 17, 2016 at 7:14 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > bq. hbase.hregion.majorcompaction = 0 per table/column family
> >
> > I searched code base but didn't find relevant test case for the above.
> > Mind giving me some pointer ?
> >
> > Thanks
> >
> > On Tue, Feb 16, 2016 at 5:38 PM, Vladimir Rodionov <
> vladrodionov@gmail.com
> > >
> > wrote:
> >
> > > 1.does major compaction in hbase runs per table basis.
> > >
> > > Per Region
> > >
> > > 2.By default every 24 hours?
> > >
> > > In older versions - yes. Current (1.x+) - 7 days
> > >
> > > 3.Can I disable automatic major compaction for few tables while keep it
> > > enable for rest of tables?
> > >
> > > yes, you can. You can set
> > >
> > > hbase.hregion.majorcompaction = 0 per table/column family
> > >
> > > 4.Does hbase put ,get and delete are blocked while major compaction and
> > are
> > > working in minor compaction?
> > >
> > > No, they are not.
> > >
> > > -Vlad
> > >
> > > On Tue, Feb 16, 2016 at 4:51 PM, Ted Yu <yu...@gmail.com> wrote:
> > >
> > > > For #2, see http://hbase.apache.org/book.html#managed.compactions
> > > >
> > > > For #3, I don't think so.
> > > >
> > > > On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora <
> > > shushantarora09@gmail.com
> > > > >
> > > > wrote:
> > > >
> > > > > Hi
> > > > >
> > > > > 1.does major compaction in hbase runs per table basis.
> > > > > 2.By default every 24 hours?
> > > > > 3.Can I disable automatic major compaction for few tables while
> keep
> > it
> > > > > enable for rest of tables?
> > > > >
> > > > > 4.Does hbase put ,get and delete are blocked while major compaction
> > and
> > > > are
> > > > > working in minor compaction?
> > > > >
> > > > > Thanks
> > > > >
> > > >
> > >
> >
>
Re: disable major compaction per table
Posted by Shushant Arora <sh...@gmail.com>.
Thanks!
does hbase compress repeated values in keys and columns :location say
(ASIA). will that be repeated with each key or hbase snappy compression
will handle that.
same applies for repeated values of a column?
Thanks!
On Wed, Feb 17, 2016 at 7:14 AM, Ted Yu <yu...@gmail.com> wrote:
> bq. hbase.hregion.majorcompaction = 0 per table/column family
>
> I searched code base but didn't find relevant test case for the above.
> Mind giving me some pointer ?
>
> Thanks
>
> On Tue, Feb 16, 2016 at 5:38 PM, Vladimir Rodionov <vladrodionov@gmail.com
> >
> wrote:
>
> > 1.does major compaction in hbase runs per table basis.
> >
> > Per Region
> >
> > 2.By default every 24 hours?
> >
> > In older versions - yes. Current (1.x+) - 7 days
> >
> > 3.Can I disable automatic major compaction for few tables while keep it
> > enable for rest of tables?
> >
> > yes, you can. You can set
> >
> > hbase.hregion.majorcompaction = 0 per table/column family
> >
> > 4.Does hbase put ,get and delete are blocked while major compaction and
> are
> > working in minor compaction?
> >
> > No, they are not.
> >
> > -Vlad
> >
> > On Tue, Feb 16, 2016 at 4:51 PM, Ted Yu <yu...@gmail.com> wrote:
> >
> > > For #2, see http://hbase.apache.org/book.html#managed.compactions
> > >
> > > For #3, I don't think so.
> > >
> > > On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora <
> > shushantarora09@gmail.com
> > > >
> > > wrote:
> > >
> > > > Hi
> > > >
> > > > 1.does major compaction in hbase runs per table basis.
> > > > 2.By default every 24 hours?
> > > > 3.Can I disable automatic major compaction for few tables while keep
> it
> > > > enable for rest of tables?
> > > >
> > > > 4.Does hbase put ,get and delete are blocked while major compaction
> and
> > > are
> > > > working in minor compaction?
> > > >
> > > > Thanks
> > > >
> > >
> >
>
Re: disable major compaction per table
Posted by Ted Yu <yu...@gmail.com>.
bq. hbase.hregion.majorcompaction = 0 per table/column family
I searched code base but didn't find relevant test case for the above.
Mind giving me some pointer ?
Thanks
On Tue, Feb 16, 2016 at 5:38 PM, Vladimir Rodionov <vl...@gmail.com>
wrote:
> 1.does major compaction in hbase runs per table basis.
>
> Per Region
>
> 2.By default every 24 hours?
>
> In older versions - yes. Current (1.x+) - 7 days
>
> 3.Can I disable automatic major compaction for few tables while keep it
> enable for rest of tables?
>
> yes, you can. You can set
>
> hbase.hregion.majorcompaction = 0 per table/column family
>
> 4.Does hbase put ,get and delete are blocked while major compaction and are
> working in minor compaction?
>
> No, they are not.
>
> -Vlad
>
> On Tue, Feb 16, 2016 at 4:51 PM, Ted Yu <yu...@gmail.com> wrote:
>
> > For #2, see http://hbase.apache.org/book.html#managed.compactions
> >
> > For #3, I don't think so.
> >
> > On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora <
> shushantarora09@gmail.com
> > >
> > wrote:
> >
> > > Hi
> > >
> > > 1.does major compaction in hbase runs per table basis.
> > > 2.By default every 24 hours?
> > > 3.Can I disable automatic major compaction for few tables while keep it
> > > enable for rest of tables?
> > >
> > > 4.Does hbase put ,get and delete are blocked while major compaction and
> > are
> > > working in minor compaction?
> > >
> > > Thanks
> > >
> >
>
Re: disable major compaction per table
Posted by Vladimir Rodionov <vl...@gmail.com>.
1.does major compaction in hbase runs per table basis.
Per Region
2.By default every 24 hours?
In older versions - yes. Current (1.x+) - 7 days
3.Can I disable automatic major compaction for few tables while keep it
enable for rest of tables?
yes, you can. You can set
hbase.hregion.majorcompaction = 0 per table/column family
4.Does hbase put ,get and delete are blocked while major compaction and are
working in minor compaction?
No, they are not.
-Vlad
On Tue, Feb 16, 2016 at 4:51 PM, Ted Yu <yu...@gmail.com> wrote:
> For #2, see http://hbase.apache.org/book.html#managed.compactions
>
> For #3, I don't think so.
>
> On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora <shushantarora09@gmail.com
> >
> wrote:
>
> > Hi
> >
> > 1.does major compaction in hbase runs per table basis.
> > 2.By default every 24 hours?
> > 3.Can I disable automatic major compaction for few tables while keep it
> > enable for rest of tables?
> >
> > 4.Does hbase put ,get and delete are blocked while major compaction and
> are
> > working in minor compaction?
> >
> > Thanks
> >
>
Re: disable major compaction per table
Posted by Ted Yu <yu...@gmail.com>.
For #2, see http://hbase.apache.org/book.html#managed.compactions
For #3, I don't think so.
On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora <sh...@gmail.com>
wrote:
> Hi
>
> 1.does major compaction in hbase runs per table basis.
> 2.By default every 24 hours?
> 3.Can I disable automatic major compaction for few tables while keep it
> enable for rest of tables?
>
> 4.Does hbase put ,get and delete are blocked while major compaction and are
> working in minor compaction?
>
> Thanks
>