You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Cool BSD <co...@coolbsd.com> on 2010/03/03 06:57:39 UTC
What's the ideal size of a column?
Be short - what's the ideal column size in real world?
Long description - I'm working on a prototype, the application is a data
store that holding blobs sizing from couple of KB to hundreds of MB, close
to 1GB in the worst case. The data model is really simple - key is a string
(UUID-like thing), and value is the blob, the only operations are "set",
"get", and "delete".
The reason I pick up Cassandra is the feature of high availability and
dynamic growth, also high write throughput is a great advantage since
read/write ratio is about 1:100. Another idea is using a simple key-value
store to keep UUID to location mapping, and store blob data as file in a NFS
server, but managing growth is not that straightforward.
If the blob size is too big to fit into Cassandra, what's the ideal size?
And if this is the case, I will try to cut it into slices but still keep
everything in Cassandra, is this better than NFS solution?
Thanks,
CB
P.S. The real reason I want to try Cassandra is that I want to play with
something new
Re: What's the ideal size of a column?
Posted by Cool BSD <co...@coolbsd.com>.
Seems not, neither Haystack nor MObStor is available at this moment.
Heading back to Cassandra now.
CB
2010/3/4 Jonathan Ellis <jb...@gmail.com>
> Is the source to Haystack actually available now?
>
> On Thu, Mar 4, 2010 at 12:43 PM, Cool BSD <co...@coolbsd.com> wrote:
> > This could be a little bit off-topic, but I found something called
> Haystack
> > (from Facebook) and MObStor (from Yahoo), it seems to me they are more
> > suitable to my project.
> >
> > http://www.facebook.com/note.php?note_id=76191543919&ref=mf
> > http://developer.yahoo.net/blog/archives/2009/07/mobstor.html
> > CB
> > 2010/3/2 Jonathan Ellis <jb...@gmail.com>
> >>
> >> On Tue, Mar 2, 2010 at 11:57 PM, Cool BSD <co...@coolbsd.com> wrote:
> >> > Be short - what's the ideal column size in real world?
> >> >
> >> > Long description - I'm working on a prototype, the application is a
> data
> >> > store that holding blobs sizing from couple of KB to hundreds of MB,
> >> > close
> >> > to 1GB in the worst case.
> >>
> >> You should be fine. "Single digits of MB" is a good rule of thumb.
> >
> >
>
Re: What's the ideal size of a column?
Posted by Jonathan Ellis <jb...@gmail.com>.
Is the source to Haystack actually available now?
On Thu, Mar 4, 2010 at 12:43 PM, Cool BSD <co...@coolbsd.com> wrote:
> This could be a little bit off-topic, but I found something called Haystack
> (from Facebook) and MObStor (from Yahoo), it seems to me they are more
> suitable to my project.
>
> http://www.facebook.com/note.php?note_id=76191543919&ref=mf
> http://developer.yahoo.net/blog/archives/2009/07/mobstor.html
> CB
> 2010/3/2 Jonathan Ellis <jb...@gmail.com>
>>
>> On Tue, Mar 2, 2010 at 11:57 PM, Cool BSD <co...@coolbsd.com> wrote:
>> > Be short - what's the ideal column size in real world?
>> >
>> > Long description - I'm working on a prototype, the application is a data
>> > store that holding blobs sizing from couple of KB to hundreds of MB,
>> > close
>> > to 1GB in the worst case.
>>
>> You should be fine. "Single digits of MB" is a good rule of thumb.
>
>
Re: What's the ideal size of a column?
Posted by Cool BSD <co...@coolbsd.com>.
This could be a little bit off-topic, but I found something called Haystack
(from Facebook) and MObStor (from Yahoo), it seems to me they are more
suitable to my project.
http://www.facebook.com/note.php?note_id=76191543919&ref=mf
http://developer.yahoo.net/blog/archives/2009/07/mobstor.html
CB
2010/3/2 Jonathan Ellis <jb...@gmail.com>
> On Tue, Mar 2, 2010 at 11:57 PM, Cool BSD <co...@coolbsd.com> wrote:
> > Be short - what's the ideal column size in real world?
> >
> > Long description - I'm working on a prototype, the application is a data
> > store that holding blobs sizing from couple of KB to hundreds of MB,
> close
> > to 1GB in the worst case.
>
> You should be fine. "Single digits of MB" is a good rule of thumb.
>
Re: What's the ideal size of a column?
Posted by Jonathan Ellis <jb...@gmail.com>.
On Tue, Mar 2, 2010 at 11:57 PM, Cool BSD <co...@coolbsd.com> wrote:
> Be short - what's the ideal column size in real world?
>
> Long description - I'm working on a prototype, the application is a data
> store that holding blobs sizing from couple of KB to hundreds of MB, close
> to 1GB in the worst case.
You should be fine. "Single digits of MB" is a good rule of thumb.