You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/09/26 17:36:00 UTC
[jira] [Commented] (SAMZA-1423) Implement a RocksDb backed
time-series store for storing and retrieving messages time-ranges
[ https://issues.apache.org/jira/browse/SAMZA-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181196#comment-16181196 ]
ASF GitHub Bot commented on SAMZA-1423:
---------------------------------------
GitHub user vjagadish1989 opened a pull request:
https://github.com/apache/samza/pull/303
SAMZA-1423: Implement time series storage for joins and windows
Notable changes:
* New interface for storing and retrieving time series data.
* New store and serde implementation for use in windows and joins
Pending:
* Documentation, and minor clean-ups
* Wire-up of stores from ExecutionPlanner
* Usage of the store to implement various windows and joins
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vjagadish1989/samza window-store
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/303.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #303
----
commit 9420aa2251752c72fd4e3880a4cc087f64a3b9c3
Author: Jagadish <ja...@apache.org>
Date: 2017-09-25T11:52:43Z
stuff
commit 5f8653417a4dae850160ec3b12a0dfc67abf6f6b
Author: Jagadish <ja...@apache.org>
Date: 2017-09-25T11:52:49Z
Merge branch 'master' of https://github.com/apache/samza into window-store
commit 625faccf7cb1eb6e0e6084f9e7de331d9865724a
Author: Jagadish <ja...@apache.org>
Date: 2017-09-26T17:09:34Z
clean up APIs and add docs
commit 26517ce322ea9d64cf40633e6413762a6ebcd4b9
Author: Jagadish <ja...@apache.org>
Date: 2017-09-26T17:11:43Z
clean up APIs and add docs
commit d44a2dfb1f06aaf19b0776db0a348767b525e0e7
Author: Jagadish <ja...@apache.org>
Date: 2017-09-26T17:26:42Z
revert unintended changes
commit 7f3a91f87c1f37893d0194a520bb9ce8c70c0951
Author: Jagadish <ja...@apache.org>
Date: 2017-09-26T17:29:31Z
revert unintended changes
----
> Implement a RocksDb backed time-series store for storing and retrieving messages time-ranges
> --------------------------------------------------------------------------------------------
>
> Key: SAMZA-1423
> URL: https://issues.apache.org/jira/browse/SAMZA-1423
> Project: Samza
> Issue Type: Sub-task
> Reporter: Jagadish
> Assignee: Jagadish
>
> I'm thinking of the following API for the time-series store:
> {code}
> /**
> * A key-value store that allows entries to be queried and stored based on time ranges.
> *
> * Implementations of this interface are expected to be thread-safe.
> *
> * @param <K>, the type of key in the store
> * @param <V>, the type of value in the store
> */
> public interface TimeSeriesStore<K, V> {
> ClosableIterator<KV<V, Long>> get(K key, Long startTimestamp, Long endTimeStamp);
> void put(K key, V val, Long timeStamp);
> void remove(K key, Long startTimestamp, Long endTimeStamp);
> }
> {code}
> {code}
> /**
> * An iterator that can be closed.
> *
> * <p> Implement close to free resources assigned to the iterator such as open file handles, persistent state etc.
> *
> * @param <V>
> */
> public interface ClosableIterator<V> extends Iterator<V> {
> /**
> * Closes this iterator and frees resources assigned to it.
> *
> * It is illegal to invoke {@link #next()} and {@link #hasNext()} after an iterator has been closed.
> */
> public void close();
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)