[jira] [Commented] (CASSANDRA-18216) Allow sharding of the SAI in-memory index

["Caleb Rackliffe (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-18216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18044707#comment-18044707 ] 

Caleb Rackliffe commented on CASSANDRA-18216:
---------------------------------------------

[~wnguyen25] To the extend that some of the latency hit from SAI on write is being caused by contention on the Memtable-attached index bits, this issue might be interesting to you. (I'm vaguely remembering a slide from [https://youtu.be/DQDWpvI7FLw?si=4X97YeWKWnVZ0eM_] about this...)

> Allow sharding of the SAI in-memory index 
> ------------------------------------------
>
>                 Key: CASSANDRA-18216
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-18216
>             Project: Apache Cassandra
>          Issue Type: Improvement
>          Components: Feature/SAI
>            Reporter: Mike Adamson
>            Assignee: Atri Sharma
>            Priority: Normal
>              Labels: SAI
>             Fix For: 5.x
>
>
> The Memtable implementation allows it to be split into a number of shards. This reduces contention during writes. 
> The MemtableIndex in SAI should follow this practice. It currently does not support sharding so all writes hit the same synchronized write block. The in-memory index search can also use the sharding to reduce the number of indexes that it searches based on the key range passed to the search.
> This exists already in the DS fork: https://github.com/datastax/cassandra/pull/298



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org