You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Chris Riccomini (JIRA)" <ji...@apache.org> on 2014/02/18 21:14:23 UTC

[jira] [Commented] (SAMZA-147) Add a generic stream metadata API to SystemAdmin

    [ https://issues.apache.org/jira/browse/SAMZA-147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904517#comment-13904517 ] 

Chris Riccomini commented on SAMZA-147:
---------------------------------------

Need to update hello-samza as part of this.

> Add a generic stream metadata API to SystemAdmin
> ------------------------------------------------
>
>                 Key: SAMZA-147
>                 URL: https://issues.apache.org/jira/browse/SAMZA-147
>             Project: Samza
>          Issue Type: Sub-task
>          Components: container
>    Affects Versions: 0.6.0
>            Reporter: Chris Riccomini
>            Assignee: Chris Riccomini
>         Attachments: SAMZA-147.0.patch
>
>
> While investigating SAMZA-142, it became clear that the getLastOffsets and getPartitions APIs in SystemAdmin are insufficient.
> Samza currently wants to know four things:
> 1. Partition count for each stream it's reading from.
> 2. Offset of the oldest message in the stream. This is useful to fully read a changelog.
> 3. Offset of the newest message in the stream. This is useful when checking of we've finished bootstrapping a stream in the DefaultChooser.
> 4. Offset of the "future" message in the stream. This is useful when a job wishes to start reading from "realtime", and skip all older messages.
> In addition, (2) is useful in cases where a job wishes to start reading input topics from the oldest message in the stream (the opposite (4)).



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)