[jira] [Updated] (SAMZA-1042) Allow offset notifications for input systems

["Boris Shkolnik (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SAMZA-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Boris Shkolnik updated SAMZA-1042:
----------------------------------
    Summary: Allow offset notifications for input systems  (was: [DISCUSS] Allow offset notifications for input systems)

RB. 
https://reviews.apache.org/r/53453/

> Allow offset notifications for input systems
> --------------------------------------------
>
>                 Key: SAMZA-1042
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1042
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Boris Shkolnik
>            Assignee: Boris Shkolnik
>         Attachments: NotifiableConsumer.md, NotifiableConsumer.pdf, notifiable consumer2.md, notifiable-consumer2.pdf
>
>
> Currently we keep track of the progress of each consumer using checkpointing mechanism. These checkpoints are controlled by Samza, and the system consumer is not aware of it.
> But some systems may require knowledge of the current checkpointed position in the stream.
> For this purpose we propose an optional notification mechanism for input systems.
> See the attached doc for details.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)