[jira] [Commented] (CASSANDRA-6851) Improve anticompaction after incremental repair

["Russell Alexander Spitzer (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032039#comment-14032039 ] 

Russell Alexander Spitzer commented on CASSANDRA-6851:
------------------------------------------------------

Gave this another go, this is another rough draft and I'll need to add a few more unit tests to make sure it's behaving as schedule. 

I implemented a naive grouper which lets you just define a number of sstables to group together during an anti compaction. For the final version of this patch we can determine a more clever way of grouping together sstables.

https://github.com/RussellSpitzer/cassandra/commit/afd9e5200e5b7b455b8ab8237a8234bed2de9d61

Sorry it took me a while to get back to this, my weekends have been pretty devoted to DSE what with the new release coming so soon. 

> Improve anticompaction after incremental repair
> -----------------------------------------------
>
>                 Key: CASSANDRA-6851
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6851
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Marcus Eriksson
>            Assignee: Russell Alexander Spitzer
>            Priority: Minor
>              Labels: compaction, lhf
>             Fix For: 2.1.1
>
>
> After an incremental repair we iterate over all sstables and split them in two parts, one containing the repaired data and one the unrepaired. We could in theory double the number of sstables on a node.
> To avoid this we could make anticompaction also do a compaction, for example, if we are to anticompact 10 sstables, we could anticompact those to 2.
> Note that we need to avoid creating too big sstables though, if we anticompact all sstables on a node it would essentially be a major compaction.



--
This message was sent by Atlassian JIRA
(v6.2#6252)