You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Victor Kabdebon <vi...@gmail.com> on 2011/01/13 23:38:16 UTC
Storing big objects into columns
Dear all,
In a project I would like to store "big" objects in columns, serialized. For
example entire images (several Ko to several Mo), flash animations (several
Mo) etc...
Does someone use Cassandra with those relatively big columns and if yes does
it work well ? Is there any drawbacks using this method ?
Thank you,
Victor K.
Re: Storing big objects into columns
Posted by Peter Schuller <pe...@infidyne.com>.
> In a project I would like to store "big" objects in columns, serialized. For
> example entire images (several Ko to several Mo), flash animations (several
> Mo) etc...
> Does someone use Cassandra with those relatively big columns and if yes does
> it work well ? Is there any drawbacks using this method ?
Not in production, but I've done testing with values on the order of
"a few megs". Expect compaction to be entirely disk bound rather than
CPU bound. Make sure latency is acceptable even when data sizes grow
beyond memory size.
--
/ Peter Schuller
Re: Storing big objects into columns
Posted by Victor Kabdebon <vi...@gmail.com>.
Ok thank you very much for these information !
If somebody has more insights on this matter I am still interested !
Victor K.
2011/1/13 Ryan King <ry...@twitter.com>
> On Thu, Jan 13, 2011 at 2:44 PM, Victor Kabdebon
> <vi...@gmail.com> wrote:
> > Is there any recommanded maximum size for a Column ? (not the very upper
> > limit which is 2Gb)
> > Why is it useful to chunk the content into multiple columns ?
>
> I think you're going to have to do some tests yourself.
>
> You want to chunk it so that you can pseudo-stream the content. You
> don't want to have to load the whole content at once.
>
> -ryan
>
Re: Storing big objects into columns
Posted by Ryan King <ry...@twitter.com>.
On Thu, Jan 13, 2011 at 2:44 PM, Victor Kabdebon
<vi...@gmail.com> wrote:
> Is there any recommanded maximum size for a Column ? (not the very upper
> limit which is 2Gb)
> Why is it useful to chunk the content into multiple columns ?
I think you're going to have to do some tests yourself.
You want to chunk it so that you can pseudo-stream the content. You
don't want to have to load the whole content at once.
-ryan
Re: Storing big objects into columns
Posted by Victor Kabdebon <vi...@gmail.com>.
Is there any recommanded maximum size for a Column ? (not the very upper
limit which is 2Gb)
Why is it useful to chunk the content into multiple columns ?
Thank you,
Victor K.
2011/1/13 Ryan King <ry...@twitter.com>
> On Thu, Jan 13, 2011 at 2:38 PM, Victor Kabdebon
> <vi...@gmail.com> wrote:
> > Dear all,
> > In a project I would like to store "big" objects in columns, serialized.
> For
> > example entire images (several Ko to several Mo), flash animations
> (several
> > Mo) etc...
> > Does someone use Cassandra with those relatively big columns and if yes
> does
> > it work well ? Is there any drawbacks using this method ?
>
> I haven't benchmarked this myself, but I think you'll want to chunk
> your content into multiple columns in the same row.
>
> -ryan
>
Re: Storing big objects into columns
Posted by Ryan King <ry...@twitter.com>.
On Thu, Jan 13, 2011 at 2:38 PM, Victor Kabdebon
<vi...@gmail.com> wrote:
> Dear all,
> In a project I would like to store "big" objects in columns, serialized. For
> example entire images (several Ko to several Mo), flash animations (several
> Mo) etc...
> Does someone use Cassandra with those relatively big columns and if yes does
> it work well ? Is there any drawbacks using this method ?
I haven't benchmarked this myself, but I think you'll want to chunk
your content into multiple columns in the same row.
-ryan