[jira] [Updated] (KAFKA-3658) RocksDBWindowStore should guarantee a single window locates completely in one segment

["Guozhang Wang (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Guozhang Wang updated KAFKA-3658:
---------------------------------
    Fix Version/s:     (was: 0.10.0.0)
                   0.10.0.1

> RocksDBWindowStore should guarantee a single window locates completely in one segment
> -------------------------------------------------------------------------------------
>
>                 Key: KAFKA-3658
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3658
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>            Reporter: Guozhang Wang
>            Assignee: Guozhang Wang
>              Labels: architecture
>             Fix For: 0.10.0.1
>
>
> As [~hcai@pinterest.com] found out, the current implementation of {{RocksDBWindowStore}} does not guarantee a single window locates completely in one segment, and hence when we expiring a segment, that would result in partial window expiration (i.e. some records of the window are dropped, while some others are still available for queries). We need to fix this issue in setting the segment size to consider the window size.
> Another minor issue is that retention size should be validated correctly to be no less than the window size.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)