[jira] [Comment Edited] (CASSANDRA-19048) Audit table properties passed through Analytics CqlUtils

["Doug Rohrer (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-19048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17788873#comment-17788873 ] 

Doug Rohrer edited comment on CASSANDRA-19048 at 11/22/23 7:35 PM:
-------------------------------------------------------------------

After some additional research, the following props need to be allowed, as they all affect the files written by the Analytics library:
{code:java}
bloom_filter_fp_chance
cdc
compression
default_time_to_live
min_index_interval
max_index_interva
{code}


was (Author: drohrer):
After some additional research, the following props need to be allowed, as they all affect the on-disk SSTable written by the Analytics library:
{code:java}
bloom_filter_fp_chance
cdc
compression
default_time_to_live
min_index_interval
max_index_interva
{code}

> Audit table properties passed through Analytics CqlUtils
> --------------------------------------------------------
>
>                 Key: CASSANDRA-19048
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-19048
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Analytics Library
>            Reporter: Doug Rohrer
>            Assignee: Doug Rohrer
>            Priority: Normal
>
> In mixed version clusters, table properties (`WITH` clauses in the table definition) have historically been moved or renamed without much thought to backward-compatibility of external tools. This has caused breaking changes to the Analytics library in the past. Therefore, the Analytics library removes most table properties from the table schema it uses in order to avoid these issues. However, it is currently too aggressive in this removal process.  For example, the `default_time_to_live` parameter is currently removed from the table options, but the Bulk Writer should use this to set the appropriate TTL when the user doesn’t specify it in the bulk job.
> Similarly, compression options passed to the Bulk Writer should be honored so that the appropriate compression algorithm is used when generating sstables.
> The allowlist of options needs to be audited and improved to add additional options where appropriate.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org