[jira] [Commented] (CASSANDRA-7409) Allow multiple overlapping sstables in L1

["Carl Yeksigian (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-7409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086767#comment-14086767 ] 

Carl Yeksigian commented on CASSANDRA-7409:
-------------------------------------------

I've updated the patch to combine OCS and LCS, and to run STCS in L0
if MOLO = 0.

I ran a test to compare the performance between LCS and OLCS, which
uses the incremental backup and then running compaction on the
results.
- 3:04 to compact using LCS w/ STCS.
- 2:50 to compact using OLCS w/ MOLO = 2.

Another round of testing is needed, specifically around compactions
which can take advantage of concurrent compactors. One benefit of OLCS
is that concurrent compactors can be working between L0 and L1, up to
the max overlapping level.


> Allow multiple overlapping sstables in L1
> -----------------------------------------
>
>                 Key: CASSANDRA-7409
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-7409
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: Carl Yeksigian
>            Assignee: Carl Yeksigian
>
> Currently, when a normal L0 compaction takes place (not STCS), we take up to MAX_COMPACTING_L0 L0 sstables and all of the overlapping L1 sstables and compact them together. If we didn't have to deal with the overlapping L1 tables, we could compact a higher number of L0 sstables together into a set of non-overlapping L1 sstables.
> This could be done by delaying the invariant that L1 has no overlapping sstables. Going from L1 to L2, we would be compacting fewer sstables together which overlap.
> When reading, we will not have the same one sstable per level (except L0) guarantee, but this can be bounded (once we have too many sets of sstables, either compact them back into the same level, or compact them up to the next level).
> This could be generalized to allow any level to be the maximum for this overlapping strategy.



--
This message was sent by Atlassian JIRA
(v6.2#6252)