[jira] [Updated] (CASSANALYTICS-102) Add TimeRangeFilter to filter out SSTables outside given time window

["Saranya Krishnakumar (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CASSANALYTICS-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Saranya Krishnakumar updated CASSANALYTICS-102:
-----------------------------------------------
    Change Category: Performance
         Complexity: Normal
        Component/s: Reader
           Assignee: Saranya Krishnakumar
             Status: Open  (was: Triage Needed)

> Add TimeRangeFilter to filter out SSTables outside given time window
> --------------------------------------------------------------------
>
>                 Key: CASSANALYTICS-102
>                 URL: https://issues.apache.org/jira/browse/CASSANALYTICS-102
>             Project: Apache Cassandra Analytics
>          Issue Type: New Feature
>          Components: Reader
>            Reporter: Saranya Krishnakumar
>            Assignee: Saranya Krishnakumar
>            Priority: Normal
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Creating this MTC request to add time range filter in Bulk Reader. This filter can improve the performance of bulk reader especially for tables using TimeWindowCompactionStrategy, when analytics users want to filter out SSTables outside the required time window. Analytics users will be able to set start and end timestamp of SSTable they are interested in with spark options. Internally a time range filter is created from the options and passed to SSTableReader. We filter out SSTables with min and max SSTable timestamp and avoid streaming data files.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org