RE: [EXTERNAL] Re: Data Node Density

["Durity, Sean R" <SE...@homedepot.com>]

You asked for experience; here’s mine.

I support one PR cluster where the hardware was built more for HBase than Cassandra. So the data capacity is large (4.5 TB/node). Administratively, it is the worst cluster to work on because any kind of repairs, streaming, replacement take forever. And when some nodes were hitting the disk capacity? Yikes!

So, I am hesitant to recommend anything over 3 TB/node for any application in our setting. I understand that the cost of disk storage (with a 35-50% compaction overhead and replication factor and mode nodes) makes denser nodes more appealing, but I resist.


Sean Durity

From: Amit Agrawal [mailto:amit.ku.agrawal@gmail.com]
Sent: Friday, December 15, 2017 9:38 AM
To: user@cassandra.apache.org
Subject: [EXTERNAL] Re: Data Node Density

Thanks Nicholas. Am aware of the official recommendations. However, in the last project, we tried with 5 TB and it worked fine.

So asking for expereinces around.

Anybody knows anyone who provides a consultancy on open source cassandra. Datastax just does it for the enterprise version!

On Fri, Dec 15, 2017 at 3:08 PM, Nicolas Guyomar <ni...@gmail.com>> wrote:
Hi Amit,

This is way too much data per node, official recommendation are to try to stay below 2Tb per node, I have seen nodes up to 4Tb but then maintenance gets really complicated (backup, boostrap, streaming for repair etc etc)

Nicolas

On 15 December 2017 at 15:01, Amit Agrawal <am...@gmail.com>> wrote:
Hi,

We are trying to setup a 3 node cluster with 20 TB HD on each node.
its a bare metal setup with 44 cores on each node.

So in total 60 TB, 66 cores , 3 node cluster.

The data velocity is very less, low access rates.

has anyone tried with this configuration ?

A bit urgent.

Regards,
-A





________________________________

The information in this Internet Email is confidential and may be legally privileged. It is intended solely for the addressee. Access to this Email by anyone else is unauthorized. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. When addressed to our clients any opinions or advice contained in this Email are subject to the terms and conditions expressed in any applicable governing The Home Depot terms of business or client engagement letter. The Home Depot disclaims all responsibility and liability for the accuracy and content of this attachment and for any damages or losses arising from any inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other items of a destructive nature, which may be contained in this attachment and shall not be liable for direct, indirect, consequential or special damages in connection with this e-mail message or its attachment.