[jira] [Assigned] (PHOENIX-7584) Conditional TTL on SYSTEM.CDC_STREAM

["Palash Chauhan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PHOENIX-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Palash Chauhan reassigned PHOENIX-7584:
---------------------------------------

    Assignee: Palash Chauhan

> Conditional TTL on SYSTEM.CDC_STREAM
> ------------------------------------
>
>                 Key: PHOENIX-7584
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-7584
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: Viraj Jasani
>            Assignee: Palash Chauhan
>            Priority: Major
>             Fix For: 5.3.0
>
>
> SYSTEM.CDC_STREAM consists of partition (region) records and maintains lineage using split or merge of the regions.
> After configurable duration, the records from SYSTEM.CDC_STREAM table should be removed as the client is expected to read the change stream for specific time duration. For instance, if the client keeps maxLookback of the base table as 24 hr, the TTL for the CDC Index is expected to be 24 hr. Therefore, once a region closes due to split or merge, updating SYSTEM.CDC_STREAM record with non-null PARTITION_END_TIME value, we should purge the partition record from SYSTEM.CDC_STREAM after 24 hr.
>  
> For this purpose, we should define Conditional TTL on SYSTEM.CDC_STREAM as:
> {code:java}
> TTL = PARTITION_END_TIME IS NOT NULL AND CURRENT_TIME() >= (PHOENIX_ROW_TIMESTAMP() + (24 * 60 * 60 * 1000)){code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)