You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Manoj Khangaonkar <kh...@gmail.com> on 2014/01/23 03:17:59 UTC
Any Limits on number of items in a collection column type
Hi,
On C* 2.0.0. 3 Node cluster.
I have a column daycount list<BigInt>. The column is storing a count.
Every few secs a new count is appended. The total count for the day is the
sum of all items in the list.
My application logs indicate I wrote about 110000 items to the column for a
particular row. Assume row key is day_timestamp.
But when I do a read on the column I get back a list with only 43000 items.
Checked with both java driver and CQL.
There are no errors or exceptions anywhere.
There is this statement in the WIKI "Collection values may not be larger
than 64K". I assume this refers to 1 item in a collection.
Has anyone else seen an issue like this ?
regards
MJ
--
http://khangaonkar.blogspot.com/
Re: Any Limits on number of items in a collection column type
Posted by DuyHai Doan <do...@gmail.com>.
Alternatively you can use clustering columns to store very big collections.
Beware of not making a row too wide though (use bucketing)
Le 23 janv. 2014 04:29, "Manoj Khangaonkar" <kh...@gmail.com> a écrit
:
> Thanks. I guess I can work around by maintaining hour_counts (which will
> have fewer items) and adding the hour counts to
> get day counts.
>
> regards
>
>
> On Wed, Jan 22, 2014 at 7:15 PM, Robert Wille <rw...@fold3.com> wrote:
>
>> I didn’t read your question properly. Collections are limited to 64K
>> items, not 64K bytes per item.
>>
>> From: Manoj Khangaonkar <kh...@gmail.com>
>> Reply-To: <us...@cassandra.apache.org>
>> Date: Wednesday, January 22, 2014 at 7:17 PM
>> To: <us...@cassandra.apache.org>
>> Subject: Any Limits on number of items in a collection column type
>>
>> Hi,
>>
>> On C* 2.0.0. 3 Node cluster.
>>
>> I have a column daycount list<BigInt>. The column is storing a count.
>> Every few secs a new count is appended. The total count for the day is the
>> sum of all items in the list.
>>
>> My application logs indicate I wrote about 110000 items to the column for
>> a particular row. Assume row key is day_timestamp.
>>
>> But when I do a read on the column I get back a list with only 43000
>> items. Checked with both java driver and CQL.
>>
>> There are no errors or exceptions anywhere.
>>
>> There is this statement in the WIKI "Collection values may not be larger
>> than 64K". I assume this refers to 1 item in a collection.
>>
>> Has anyone else seen an issue like this ?
>>
>> regards
>>
>> MJ
>>
>>
>> --
>> http://khangaonkar.blogspot.com/
>>
>
>
>
> --
> http://khangaonkar.blogspot.com/
>
Re: Any Limits on number of items in a collection column type
Posted by Manoj Khangaonkar <kh...@gmail.com>.
Thanks. I guess I can work around by maintaining hour_counts (which will
have fewer items) and adding the hour counts to
get day counts.
regards
On Wed, Jan 22, 2014 at 7:15 PM, Robert Wille <rw...@fold3.com> wrote:
> I didn’t read your question properly. Collections are limited to 64K
> items, not 64K bytes per item.
>
> From: Manoj Khangaonkar <kh...@gmail.com>
> Reply-To: <us...@cassandra.apache.org>
> Date: Wednesday, January 22, 2014 at 7:17 PM
> To: <us...@cassandra.apache.org>
> Subject: Any Limits on number of items in a collection column type
>
> Hi,
>
> On C* 2.0.0. 3 Node cluster.
>
> I have a column daycount list<BigInt>. The column is storing a count.
> Every few secs a new count is appended. The total count for the day is the
> sum of all items in the list.
>
> My application logs indicate I wrote about 110000 items to the column for
> a particular row. Assume row key is day_timestamp.
>
> But when I do a read on the column I get back a list with only 43000
> items. Checked with both java driver and CQL.
>
> There are no errors or exceptions anywhere.
>
> There is this statement in the WIKI "Collection values may not be larger
> than 64K". I assume this refers to 1 item in a collection.
>
> Has anyone else seen an issue like this ?
>
> regards
>
> MJ
>
>
> --
> http://khangaonkar.blogspot.com/
>
--
http://khangaonkar.blogspot.com/
Re: Any Limits on number of items in a collection column type
Posted by Robert Wille <rw...@fold3.com>.
I didn¹t read your question properly. Collections are limited to 64K items,
not 64K bytes per item.
From: Manoj Khangaonkar <kh...@gmail.com>
Reply-To: <us...@cassandra.apache.org>
Date: Wednesday, January 22, 2014 at 7:17 PM
To: <us...@cassandra.apache.org>
Subject: Any Limits on number of items in a collection column type
Hi,
On C* 2.0.0. 3 Node cluster.
I have a column daycount list<BigInt>. The column is storing a count. Every
few secs a new count is appended. The total count for the day is the sum of
all items in the list.
My application logs indicate I wrote about 110000 items to the column for a
particular row. Assume row key is day_timestamp.
But when I do a read on the column I get back a list with only 43000 items.
Checked with both java driver and CQL.
There are no errors or exceptions anywhere.
There is this statement in the WIKI "Collection values may not be larger
than 64K". I assume this refers to 1 item in a collection.
Has anyone else seen an issue like this ?
regards
MJ
--
http://khangaonkar.blogspot.com/
Re: Any Limits on number of items in a collection column type
Posted by Robert Wille <rw...@fold3.com>.
Yes, I¹ve experienced this as well. It looks like you¹re getting the number
of items inserted mod 64K.
From: Manoj Khangaonkar <kh...@gmail.com>
Reply-To: <us...@cassandra.apache.org>
Date: Wednesday, January 22, 2014 at 7:17 PM
To: <us...@cassandra.apache.org>
Subject: Any Limits on number of items in a collection column type
Hi,
On C* 2.0.0. 3 Node cluster.
I have a column daycount list<BigInt>. The column is storing a count. Every
few secs a new count is appended. The total count for the day is the sum of
all items in the list.
My application logs indicate I wrote about 110000 items to the column for a
particular row. Assume row key is day_timestamp.
But when I do a read on the column I get back a list with only 43000 items.
Checked with both java driver and CQL.
There are no errors or exceptions anywhere.
There is this statement in the WIKI "Collection values may not be larger
than 64K". I assume this refers to 1 item in a collection.
Has anyone else seen an issue like this ?
regards
MJ
--
http://khangaonkar.blogspot.com/