Maximum SSTable size

[Lucas Benevides <lu...@maurobenevides.com.br>]

Hello Community,

Is there a maximum SSTable Size?
If there is not, does it go up to the maximum Operational System values?

Thanks in advance,
Lucas Benevides

Re: Maximum SSTable size

[Jeff Jirsa <jj...@gmail.com>]

That’s a target and not a maximum, and it can go over that even on LCS with wide partitions

In general, the practical limit is hundreds of gigabytes (I’ve seen 500-600 a lot, but not more than a terabyte very often). You’ll typically hit other issues and need to tune some params before you hit hard caps (unless you know what you’re doing).

-- 
Jeff Jirsa


> On Jun 27, 2018, at 3:11 PM, ZAIDI, ASAD A <az...@att.com> wrote:
> 
> With  Leveled compaction strategy  , you can set target size with sstable_size_in_mb attribute however actual size can still be larger than target given large partition size.
>  
> Thanks/Asad
>  
> From: Lucas Benevides [mailto:lucas@maurobenevides.com.br] 
> Sent: Wednesday, June 27, 2018 7:02 AM
> To: user@cassandra.apache.org
> Subject: Maximum SSTable size
>  
> Hello Community,
>  
> Is there a maximum SSTable Size?  
> If there is not, does it go up to the maximum Operational System values? 
>  
> Thanks in advance,
> Lucas Benevides

RE: Maximum SSTable size

["ZAIDI, ASAD A" <az...@att.com>]

With  Leveled compaction strategy<http://cassandra.apache.org/doc/latest/operating/compaction.html#lcs>  , you can set target size with sstable_size_in_mb attribute however actual size can still be larger than target given large partition size.

Thanks/Asad

From: Lucas Benevides [mailto:lucas@maurobenevides.com.br]
Sent: Wednesday, June 27, 2018 7:02 AM
To: user@cassandra.apache.org
Subject: Maximum SSTable size

Hello Community,

Is there a maximum SSTable Size?
If there is not, does it go up to the maximum Operational System values?

Thanks in advance,
Lucas Benevides

Re: [External] Maximum SSTable size

[Tom van der Woerdt <to...@booking.com>]

I’ve had SSTables as big as 11TB. It works, read performance is fine. But,
compaction is hell, because you’ll need twice that in disk space and it
will take many hours 🙂

Avoid large SSTables unless you really know what you’re doing. LCS is a
great default for almost every workload, especially if your cluster has a
single large table. STCS is the actual Cassandra default but it often
causes more trouble than it solves, because of large SSTables 🙂

Hope that helps!

Tom


On Wed, 27 Jun 2018 at 08:02, Lucas Benevides <lu...@maurobenevides.com.br>
wrote:

> Hello Community,
>
> Is there a maximum SSTable Size?
> If there is not, does it go up to the maximum Operational System values?
>
> Thanks in advance,
> Lucas Benevides
>
-- 
Tom van der Woerdt
Site Reliability Engineer

Booking.com B.V.
Vijzelstraat 66-80 Amsterdam 1017HL Netherlands
Direct +31207153426
[image: Booking.com] <https://www.booking.com/>
The world's #1 accommodation site
43 languages, 198+ offices worldwide, 120,000+ global destinations,
1,550,000+ room nights booked every day
No booking fees, best price always guaranteed
Subsidiary of Booking Holdings Inc. (NASDAQ: BKNG)