You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/02/08 01:32:00 UTC

[jira] [Commented] (KAFKA-4730) Streams does not have an in-memory windowed store

    [ https://issues.apache.org/jira/browse/KAFKA-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16763215#comment-16763215 ] 

ASF GitHub Bot commented on KAFKA-4730:
---------------------------------------

ableegoldman commented on pull request #6239: KAFKA-4730: Streams does not have an in-memory windowed store
URL: https://github.com/apache/kafka/pull/6239
 
 
   Implemented an in-memory window store allowing for range queries. A finite retention period defines how long records will be kept, ie the window of time for fetching, and the grace period defines the window within which late-arriving data may still be written to the store.
   
   Unit tests were written to test the functionality of the window store, including its insert/update/delete and fetch operations. Single-record, all records, and range fetch were tested, for both time ranges and key ranges. The logging and metrics for late-arriving (dropped)records were tested as well as the ability to restore from a changelog. 
   
   ### Committer Checklist (excluded from commit message)
   - [ ] Verify design and implementation 
   - [ ] Verify test coverage and CI build status
   - [ ] Verify documentation (including upgrade notes)
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Streams does not have an in-memory windowed store
> -------------------------------------------------
>
>                 Key: KAFKA-4730
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4730
>             Project: Kafka
>          Issue Type: New Feature
>          Components: streams
>    Affects Versions: 0.10.2.0
>            Reporter: Eno Thereska
>            Assignee: Sophie Blee-Goldman
>            Priority: Major
>
> Streams has windowed persistent stores (e.g., see PersistentKeyValueFactory interface with "windowed" method), however it does not allow for windowed in-memory stores (e.g., see InMemoryKeyValueFactory interface). 
> In addition to the interface not allowing it, streams does not actually have an implementation of an in-memory windowed store.
> The implications are that operations that require windowing cannot use in-memory stores. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)