[jira] [Commented] (CASSANDRA-7666) Range-segmented sstables

["Tupshin Harper (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-7666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325050#comment-15325050 ] 

Tupshin Harper commented on CASSANDRA-7666:
-------------------------------------------

In addition to being relevant to CASSANDRA-11989, I believe range-segmented sstables represents an under-appreciated potential optimization for compaction strategies. As a rule of thumb, we tend to recommend that STCS workloads be kept under 2TB, or so. The main reason for this (besides operational concerns involving time to bootstrap/repair/etc), is that STCS compaction performance scales sublinearly with the amount of data in a table/node, and that the write amplification factor is substantially higher at 10TB than 2.  With range-segmented-sstables, just 5 segments would allow 10TB to be isolated into 2 segment sections, and as long as the cumulative IO and CPU of the nodes was sufficient for the total workload, could sustain performance at that scale. 

I suggest that this ticket be re-opsened for those two reasons.

> Range-segmented sstables
> ------------------------
>
>                 Key: CASSANDRA-7666
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-7666
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: CQL
>            Reporter: Jonathan Ellis
>              Labels: dense-storage
>
> It would be useful to segment sstables by data range (not just token range as envisioned by CASSANDRA-6696).
> The primary use case is to allow deleting those data ranges for "free" by dropping the sstables involved.  We should also (possibly as a separate ticket) be able to leverage this information in query planning to avoid unnecessary sstable reads.
> Relational databases typically call this "partitioning" the table, but obviously we use that term already for something else: http://www.postgresql.org/docs/9.1/static/ddl-partitioning.html
> Tokutek's take for mongodb: http://docs.tokutek.com/tokumx/tokumx-partitioned-collections.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)