You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Venkata Naladala (Jira)" <ji...@apache.org> on 2024/06/17 20:28:00 UTC
[jira] [Comment Edited] (CASSANDRA-19715) TWCS - Provide a flag to pick a time when compaction happens for the n-1 window
[ https://issues.apache.org/jira/browse/CASSANDRA-19715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855726#comment-17855726 ]
Venkata Naladala edited comment on CASSANDRA-19715 at 6/17/24 8:27 PM:
-----------------------------------------------------------------------
Thank you for checking this.
I am not really sure. Env var or yaml will make it a node level where the table option will make it global for the selected table.
This is what we are thinking of.
{{compaction = \{ 'class' : 'org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy', 'compaction_window_size' : 1, 'compaction_window_unit' : 'DAYS', 'max_threshold' : 32, 'min_threshold' : 4, 'compaction_window_offset': 4, 'compaction_window_offset_unit': 'HOURS' }}}
{{{{compaction_window_offset_unit < compaction_window_unit}}}}
This way, the compaction for the n-1 window happens at 4:00 UTC rather than 00:00 UTC.
was (Author: JIRAUSER305852):
Thank you for checking this.
I am not really sure. Env var or yaml will make it a node level where the table option will make it global for the selected table.
This is what we are thinking of.
{{{{compaction = \{ 'class' : 'org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy', 'compaction_window_size' : 1, 'compaction_window_unit' : 'DAYS', 'max_threshold' : 32, 'min_threshold' : 4, 'compaction_window_offset': 4, 'compaction_window_offset_unit': 'HOURS' }}}}}
{{{{compaction_window_offset_unit < compaction_window_unit}}}}
This way, the compaction for the n-1 window happens at 4:00 UTC rather than 00:00 UTC.
> TWCS - Provide a flag to pick a time when compaction happens for the n-1 window
> -------------------------------------------------------------------------------
>
> Key: CASSANDRA-19715
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19715
> Project: Cassandra
> Issue Type: New Feature
> Reporter: Venkata Naladala
> Priority: Normal
>
> Below are the settings for the TWCS. With the settings below, the compaction for the n-1 window happens at around 00:00 UTC on all the nodes in the cluster. This causes a spike in IO utilization on the entire cluster, which in turn increases the read latencies.
> {{{}compaction = { 'class' : 'org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy', 'compaction_window_size' : 1, 'compaction_window_unit' : 'DAYS', 'max_threshold' : 32, 'min_threshold' : 4{}}}}
> Requesting to provide a new option for TWCS where we can specify when the compaction for n-1 window happens. This way, we can provide a custom time instead of the default time(beginning of the new window) so that we can pick low-traffic hours and avoid impacting the customer.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org