You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Kristopher Kane <kk...@gmail.com> on 2017/10/05 16:15:38 UTC

Store - RocksDB - aging data off

Not sure if I have missed it in the streams developer docs, but, is there a
mechanism to age data off the state store similar to a key based TTL?  It
looks like RocksDB has TTL built in so would I pass that via some store
configuration?


Kris

Re: Store - RocksDB - aging data off

Posted by Ted Yu <yu...@gmail.com>.

Past thread related to TTL:

http://search-hadoop.com/m/Kafka/uyzND1RLg4VOJ84U?subj=Re+Streams+TTLCacheStore

On Thu, Oct 5, 2017 at 9:54 AM, Ted Yu <yu...@gmail.com> wrote:

> Looking at streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBStore.java
> :
>
>                 throw new UnsupportedOperationException("Change log is
> not supported for store " + this.name + " since it is TTL based.");
>                 // TODO: support TTL with change log?
>                 // return TtlDB.open(options, dir.toString(), ttl, false);
>
> On Thu, Oct 5, 2017 at 9:15 AM, Kristopher Kane <kk...@gmail.com>
> wrote:
>
>> Not sure if I have missed it in the streams developer docs, but, is there
>> a
>> mechanism to age data off the state store similar to a key based TTL?  It
>> looks like RocksDB has TTL built in so would I pass that via some store
>> configuration?
>>
>>
>> Kris
>>
>
>

Re: Store - RocksDB - aging data off

Posted by Ted Yu <yu...@gmail.com>.

Looking
at streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBStore.java
:

                throw new UnsupportedOperationException("Change log is not
supported for store " + this.name + " since it is TTL based.");
                // TODO: support TTL with change log?
                // return TtlDB.open(options, dir.toString(), ttl, false);

On Thu, Oct 5, 2017 at 9:15 AM, Kristopher Kane <kk...@gmail.com>
wrote:

> Not sure if I have missed it in the streams developer docs, but, is there a
> mechanism to age data off the state store similar to a key based TTL?  It
> looks like RocksDB has TTL built in so would I pass that via some store
> configuration?
>
>
> Kris
>