You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/04/05 15:59:25 UTC

[jira] [Commented] (FLINK-3398) Flink Kafka consumer should support auto-commit opt-outs

    [ https://issues.apache.org/jira/browse/FLINK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226294#comment-15226294 ] 

ASF GitHub Bot commented on FLINK-3398:
---------------------------------------

Github user StephanEwen commented on the pull request:

    https://github.com/apache/flink/pull/1690#issuecomment-205819299
  
    I think the functionality is very desirable. In many cases, you really don't want Flink to write something to Zookeeper for some random GroupId. This floods ZooKeeper with garbage that helps no one.
    
    I think that this is actually a kind of nice solution. The `auto.commit.enable` in Flink means not necessary periodically, but "on checkpoint or periodically".


> Flink Kafka consumer should support auto-commit opt-outs
> --------------------------------------------------------
>
>                 Key: FLINK-3398
>                 URL: https://issues.apache.org/jira/browse/FLINK-3398
>             Project: Flink
>          Issue Type: Bug
>            Reporter: Shikhar Bhushan
>
> Currently the Kafka source will commit consumer offsets to Zookeeper, either upon a checkpoint if checkpointing is enabled, otherwise periodically based on {{auto.commit.interval.ms}}
> It should be possible to opt-out of committing consumer offsets to Zookeeper. Kafka has this config as {{auto.commit.enable}} (0.8) and {{enable.auto.commit}} (0.9).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)