You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Vimal Jain <vk...@gmail.com> on 2014/06/15 12:56:07 UTC
No of column qualifiers in a column family
Hi,
I am planning to have one table with 3 column families(cf) ,having around
200,100,200 column qualifiers (cq) in each of them resp.
Whats the number of cq a cf can hold ?
Also having different numbers of cqs in family ( as in above 2 cfs have 200
while the other one has 100 ) will have any impact on performance ?
--
Thanks and Regards,
Vimal Jain
Re: No of column qualifiers in a column family
Posted by Vimal Jain <vk...@gmail.com>.
Thanks Dima for a quick response.
Thanks and Regards,
Vimal Jain
On Jun 15, 2014 4:39 PM, "Dima Spivak" <ds...@cloudera.com> wrote:
> Hi Vimal,
>
> There's no limit on how many qualifiers a particular column family can
> have, nor should there be any performance degradation due to simply having
> different numbers of qualifiers for different families (unless this leads
> to huge differences in row numbers between families). For more details,
> please take a look at http://hbase.apache.org/book/number.of.cfs.html
>
> Cheers,
> Dima
>
> On Sunday, June 15, 2014, Vimal Jain <vk...@gmail.com> wrote:
>
> > Hi,
> > I am planning to have one table with 3 column families(cf) ,having around
> > 200,100,200 column qualifiers (cq) in each of them resp.
> > Whats the number of cq a cf can hold ?
> > Also having different numbers of cqs in family ( as in above 2 cfs have
> 200
> > while the other one has 100 ) will have any impact on performance ?
> >
> >
> > --
> > Thanks and Regards,
> > Vimal Jain
> >
>
Re: No of column qualifiers in a column family
Posted by Vimal Jain <vk...@gmail.com>.
Ohhk .. Thanks wellington .. I will check it out ..
Thanks and Regards,
Vimal Jain
On Jun 15, 2014 5:06 PM, "Wellington Chevreuil" <
wellington.chevreuil@gmail.com> wrote:
> Hi Vimal,
>
> Adding to Dima's comment, just be aware about how large your rows will
> become in bytes, with so much cqs. If you end up with a row larger than the
> configured size limit for regions, regionserver will have problems to split
> the region. Also, if your schema is defined by very wide rows, where most
> of your data is stored in few rows, then you may face performance problems,
> because most of your data will be stored on single regions, thus being
> served by the same RegionServer.
>
> To understand a little more about how data is split in hbase, and the
> implications it can have to performance, you can look at the links below:
>
> http://hbase.apache.org/book/regions.arch.html#arch.region.splits
> http://hbase.apache.org/book/ops.capacity.html#ops.capacity.regions.count
>
> Cheers.
>
>
> 2014-06-15 12:08 GMT+01:00 Dima Spivak <ds...@cloudera.com>:
>
> > Hi Vimal,
> >
> > There's no limit on how many qualifiers a particular column family can
> > have, nor should there be any performance degradation due to simply
> having
> > different numbers of qualifiers for different families (unless this leads
> > to huge differences in row numbers between families). For more details,
> > please take a look at http://hbase.apache.org/book/number.of.cfs.html
> >
> > Cheers,
> > Dima
> >
> > On Sunday, June 15, 2014, Vimal Jain <vk...@gmail.com> wrote:
> >
> > > Hi,
> > > I am planning to have one table with 3 column families(cf) ,having
> around
> > > 200,100,200 column qualifiers (cq) in each of them resp.
> > > Whats the number of cq a cf can hold ?
> > > Also having different numbers of cqs in family ( as in above 2 cfs have
> > 200
> > > while the other one has 100 ) will have any impact on performance ?
> > >
> > >
> > > --
> > > Thanks and Regards,
> > > Vimal Jain
> > >
> >
>
Re: No of column qualifiers in a column family
Posted by Wellington Chevreuil <we...@gmail.com>.
Hi Vimal,
Adding to Dima's comment, just be aware about how large your rows will
become in bytes, with so much cqs. If you end up with a row larger than the
configured size limit for regions, regionserver will have problems to split
the region. Also, if your schema is defined by very wide rows, where most
of your data is stored in few rows, then you may face performance problems,
because most of your data will be stored on single regions, thus being
served by the same RegionServer.
To understand a little more about how data is split in hbase, and the
implications it can have to performance, you can look at the links below:
http://hbase.apache.org/book/regions.arch.html#arch.region.splits
http://hbase.apache.org/book/ops.capacity.html#ops.capacity.regions.count
Cheers.
2014-06-15 12:08 GMT+01:00 Dima Spivak <ds...@cloudera.com>:
> Hi Vimal,
>
> There's no limit on how many qualifiers a particular column family can
> have, nor should there be any performance degradation due to simply having
> different numbers of qualifiers for different families (unless this leads
> to huge differences in row numbers between families). For more details,
> please take a look at http://hbase.apache.org/book/number.of.cfs.html
>
> Cheers,
> Dima
>
> On Sunday, June 15, 2014, Vimal Jain <vk...@gmail.com> wrote:
>
> > Hi,
> > I am planning to have one table with 3 column families(cf) ,having around
> > 200,100,200 column qualifiers (cq) in each of them resp.
> > Whats the number of cq a cf can hold ?
> > Also having different numbers of cqs in family ( as in above 2 cfs have
> 200
> > while the other one has 100 ) will have any impact on performance ?
> >
> >
> > --
> > Thanks and Regards,
> > Vimal Jain
> >
>
Re: No of column qualifiers in a column family
Posted by Dima Spivak <ds...@cloudera.com>.
Hi Vimal,
There's no limit on how many qualifiers a particular column family can
have, nor should there be any performance degradation due to simply having
different numbers of qualifiers for different families (unless this leads
to huge differences in row numbers between families). For more details,
please take a look at http://hbase.apache.org/book/number.of.cfs.html
Cheers,
Dima
On Sunday, June 15, 2014, Vimal Jain <vk...@gmail.com> wrote:
> Hi,
> I am planning to have one table with 3 column families(cf) ,having around
> 200,100,200 column qualifiers (cq) in each of them resp.
> Whats the number of cq a cf can hold ?
> Also having different numbers of cqs in family ( as in above 2 cfs have 200
> while the other one has 100 ) will have any impact on performance ?
>
>
> --
> Thanks and Regards,
> Vimal Jain
>