Number of Columns in Phoenix Table

[Siddharth Ubale <si...@syncoms.com>]

Hi ,

Is there any limit on the number of columns that can be stored in a Phoenix table where all the columns are qualifiers of a single Column family ?
I would like to create a table which will scale horizontally with dynamic columns and should not be more than 2500 columns , each of these columns will be column qualifier for one column family in hbase table.
I intend to store data in only 100 columns of the 2500 created columns for each row  as the remaining will not serve any purpose for the row data.
How would phoenix perform in such a situation?



Thanks,
Siddharth Ubale,

RE: Number of Columns in Phoenix Table

[Siddharth Ubale <si...@syncoms.com>]

Hi Mujtaba,

Thanks for the reply.
Can you please share how many rows does your table store and is the row count increasing on a daily basis?

Thanks,
Siddharth Ubale

From: Mujtaba Chohan [mailto:mujtaba@apache.org]
Sent: Thursday, June 30, 2016 1:02 AM
To: user@phoenix.apache.org
Subject: Re: Number of Columns in Phoenix Table

I haven't exhaustively perf. tested but I have a Phoenix table with 15K columns in a single column family storing values in only 20 or so columns per row and it's performance seems on par with table with few columns.

On Wed, Jun 29, 2016 at 3:27 AM, Siddharth Ubale <si...@syncoms.com>> wrote:
Hi ,

Is there any limit on the number of columns that can be stored in a Phoenix table where all the columns are qualifiers of a single Column family ?
I would like to create a table which will scale horizontally with dynamic columns and should not be more than 2500 columns , each of these columns will be column qualifier for one column family in hbase table.
I intend to store data in only 100 columns of the 2500 created columns for each row  as the remaining will not serve any purpose for the row data.
How would phoenix perform in such a situation?



Thanks,
Siddharth Ubale,

Re: Number of Columns in Phoenix Table

[Mujtaba Chohan <mu...@apache.org>]

I haven't exhaustively perf. tested but I have a Phoenix table with 15K
columns in a single column family storing values in only 20 or so columns
per row and it's performance seems on par with table with few columns.

On Wed, Jun 29, 2016 at 3:27 AM, Siddharth Ubale <
siddharth.ubale@syncoms.com> wrote:

> Hi ,
>
>
>
> Is there any limit on the number of columns that can be stored in a
> Phoenix table where all the columns are qualifiers of a single Column
> family ?
>
> I would like to create a table which will scale horizontally with dynamic
> columns and should not be more than 2500 columns , each of these columns
> will be column qualifier for one column family in hbase table.
>
> I intend to store data in only 100 columns of the 2500 created columns for
> each row  as the remaining will not serve any purpose for the row data.
>
> How would phoenix perform in such a situation?
>
>
>
>
>
>
>
> Thanks,
>
> Siddharth Ubale,
>
>
>