You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2015/07/22 22:01:05 UTC

[jira] [Commented] (KAFKA-2342) KafkaConsumer rebalance with in-flight fetch can cause invalid position

    [ https://issues.apache.org/jira/browse/KAFKA-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637525#comment-14637525 ] 

ASF GitHub Bot commented on KAFKA-2342:
---------------------------------------

Github user asfgit closed the pull request at:

    https://github.com/apache/kafka/pull/88


> KafkaConsumer rebalance with in-flight fetch can cause invalid position
> -----------------------------------------------------------------------
>
>                 Key: KAFKA-2342
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2342
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: core
>    Affects Versions: 0.8.3
>            Reporter: Jun Rao
>            Assignee: Jason Gustafson
>             Fix For: 0.9.0
>
>
> If a rebalance occurs with an in-flight fetch, the new KafkaConsumer can end up updating the fetch position of a partition to an offset which is no longer valid. The consequence is that we may end up either returning to the user messages with an unexpected position or we may fail to give back the right offset in position(). 
> Additionally, this bug causes transient test failures in ConsumerBounceTest.testConsumptionWithBrokerFailures with the following exception:
> kafka.api.ConsumerBounceTest > testConsumptionWithBrokerFailures FAILED
>     java.lang.NullPointerException
>         at org.apache.kafka.clients.consumer.KafkaConsumer.position(KafkaConsumer.java:949)
>         at kafka.api.ConsumerBounceTest.consumeWithBrokerFailures(ConsumerBounceTest.scala:86)
>         at kafka.api.ConsumerBounceTest.testConsumptionWithBrokerFailures(ConsumerBounceTest.scala:61)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)