[jira] [Commented] (SAMZA-1042) Allow offset notifications for input systems

["Boris Shkolnik (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SAMZA-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664634#comment-15664634 ] 

Boris Shkolnik commented on SAMZA-1042:
---------------------------------------

great. Thanks. 

> Allow offset notifications for input systems
> --------------------------------------------
>
>                 Key: SAMZA-1042
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1042
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Boris Shkolnik
>            Assignee: Boris Shkolnik
>         Attachments: NotifiableConsumer.md, NotifiableConsumer.pdf, SAMZA-1042-0.patch, notifiable consumer2.md, notifiable-consumer2.pdf, rb53453.patch
>
>
> Currently we keep track of the progress of each consumer using checkpointing mechanism. These checkpoints are controlled by Samza, and the system consumer is not aware of it.
> But some systems may require knowledge of the current checkpointed position in the stream.
> For this purpose we propose an optional notification mechanism for input systems.
> See the attached doc for details.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)