You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Elias Levy (JIRA)" <ji...@apache.org> on 2016/05/20 21:32:12 UTC

[jira] [Created] (FLINK-3947) Provide low level access to RocksDB state backend

Elias Levy created FLINK-3947:
---------------------------------

             Summary: Provide low level access to RocksDB state backend
                 Key: FLINK-3947
                 URL: https://issues.apache.org/jira/browse/FLINK-3947
             Project: Flink
          Issue Type: Improvement
          Components: state backends
    Affects Versions: 1.0.3
            Reporter: Elias Levy


The current state API is limiting and some implementations are not as efficient as they could be, particularly when working with large states. For instance, a ListState is append only.  You cannot remove values from the list.  And the RocksDBListState get() implementation reads all list values from RocksDB instead of returning an Iterable that only reads values as needed.

Furthermore, RocksDB is an ordered KV store, yet there is no ordered map state API with an ability to iterate over the stored values in order.






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)