You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Brian Burruss <bb...@real.com> on 2009/12/18 19:38:23 UTC

hard disk size

what are other folks' database size (on disk) per node?  or what are you expecting to grow to per node.  trying to size out a cluster and wondering what is a practical limit for cassandra.  the read latency is growing as the dataset gets larger and seems like if i got to a terrabyte on one server the latency would possibly be too high.

thoughts?

Re: hard disk size

Posted by Mark Robson <ma...@gmail.com>.
I had in mind the idea that nodes would store at least 3Tb of native
capacity per node. I can't see how I can get cost-effective storage
otherwise (machines are quite expensive compared to disc, especially in
terms of power which is usually the limiting factor)

Probably physically 4-6 drives per server or something along those lines.

We've not tested Cassandra under load, but that was what I was assuming for
capacity.

Mark

RE: hard disk size

Posted by Brian Burruss <bb...@real.com>.
it does help after a compaction but it seems to compact quite a bit under load so the disk is always very active keeping read performance lower than desirable.

after i get the cluster restarted because of the OOM i can give some numbers.

________________________________________
From: Jonathan Ellis [jbellis@gmail.com]
Sent: Friday, December 18, 2009 2:04 PM
To: cassandra-user@incubator.apache.org
Subject: Re: hard disk size

Does "nodeprobe compact" to help w/ read latency?

On Fri, Dec 18, 2009 at 12:38 PM, Brian Burruss <bb...@real.com> wrote:
> what are other folks' database size (on disk) per node?  or what are you expecting to grow to per node.  trying to size out a cluster and wondering what is a practical limit for cassandra.  the read latency is growing as the dataset gets larger and seems like if i got to a terrabyte on one server the latency would possibly be too high.
>
> thoughts?

Re: hard disk size

Posted by Jonathan Ellis <jb...@gmail.com>.
Does "nodeprobe compact" to help w/ read latency?

On Fri, Dec 18, 2009 at 12:38 PM, Brian Burruss <bb...@real.com> wrote:
> what are other folks' database size (on disk) per node?  or what are you expecting to grow to per node.  trying to size out a cluster and wondering what is a practical limit for cassandra.  the read latency is growing as the dataset gets larger and seems like if i got to a terrabyte on one server the latency would possibly be too high.
>
> thoughts?