You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Xinyu Liu (JIRA)" <ji...@apache.org> on 2018/04/30 16:58:00 UTC

[jira] [Updated] (SAMZA-1691) Support get iterable from KeyValueStore

     [ https://issues.apache.org/jira/browse/SAMZA-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xinyu Liu updated SAMZA-1691:
-----------------------------
    Fix Version/s: 0.14.1

> Support get iterable from KeyValueStore
> ---------------------------------------
>
>                 Key: SAMZA-1691
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1691
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Xinyu Liu
>            Assignee: Xinyu Liu
>            Priority: Major
>             Fix For: 0.14.1
>
>
> Right now for KeyValueStore we have a range query to return an iterator. For usage in BEAM, we need a iterable which can create an iterator when needed. Add the iterate() function in KeyValueStore to support it. It's implemented as follows:
> 1) for rocksDb, it will create the iterator when it's called, which will has a snapshot of the elements. Then every time when the iterator is needed, we will seek the iterator from beginning;
> 2) for inMemoryDb, it will create the snapshot submap when iterate() is called. The submap is an iterable and it can return a new iterator when needed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)