[jira] [Commented] (KAFKA-9909) Kafka Streams : offset control to Streams API

["Guozhang Wang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092420#comment-17092420 ] 

Guozhang Wang commented on KAFKA-9909:
--------------------------------------

Hello [~gopikrishna.chaganti@target.com] If you want to control "when" to commit, you can set the streams commit interval to infinity and use `context.commit` manually when you want to.

If you want to control "what" to commit (I'm not sure if that the case for you), I think it is a bit risky to do so because it may have vulnerability to many semantical guarantees in stream processing. Do you have any specific scenarios for it?

> Kafka Streams : offset control to Streams API
> ---------------------------------------------
>
>                 Key: KAFKA-9909
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9909
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>    Affects Versions: 2.5.0
>         Environment: All
>            Reporter: Gopikrishna
>            Priority: Minor
>              Labels: Offset, commit
>
> Hello team, really inspired the way streams api is running today. I would like to have a feature to be flexible regarding the offset. when we write the processor api, processor context object can be used to commit the offset. this is not effective. but streams are controlling the offset. the moment the process method executed or scheduled window completed, the offset is committed automatically by streams internally. 
> Like traditional kafka consumer, its better the context object should have complete control over the offset whether to commit or not. This will give more control to the api to handle failovers and especially when message cannot be processed, context should not commit the offset. Appreciate this can be implemented. 
>  
> h4. enable.auto.commit is by default false, but streams are committing automatically the offset. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)