You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Chris Riccomini (JIRA)" <ji...@apache.org> on 2014/02/18 21:14:23 UTC
[jira] [Commented] (SAMZA-147) Add a generic stream metadata API to
SystemAdmin
[ https://issues.apache.org/jira/browse/SAMZA-147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904517#comment-13904517 ]
Chris Riccomini commented on SAMZA-147:
---------------------------------------
Need to update hello-samza as part of this.
> Add a generic stream metadata API to SystemAdmin
> ------------------------------------------------
>
> Key: SAMZA-147
> URL: https://issues.apache.org/jira/browse/SAMZA-147
> Project: Samza
> Issue Type: Sub-task
> Components: container
> Affects Versions: 0.6.0
> Reporter: Chris Riccomini
> Assignee: Chris Riccomini
> Attachments: SAMZA-147.0.patch
>
>
> While investigating SAMZA-142, it became clear that the getLastOffsets and getPartitions APIs in SystemAdmin are insufficient.
> Samza currently wants to know four things:
> 1. Partition count for each stream it's reading from.
> 2. Offset of the oldest message in the stream. This is useful to fully read a changelog.
> 3. Offset of the newest message in the stream. This is useful when checking of we've finished bootstrapping a stream in the DefaultChooser.
> 4. Offset of the "future" message in the stream. This is useful when a job wishes to start reading from "realtime", and skip all older messages.
> In addition, (2) is useful in cases where a job wishes to start reading input topics from the oldest message in the stream (the opposite (4)).
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)