[jira] [Updated] (KAFKA-2342) KafkaConsumer rebalance with in-flight fetch can cause invalid position

["Jason Gustafson (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Gustafson updated KAFKA-2342:
-----------------------------------
    Summary: KafkaConsumer rebalance with in-flight fetch can cause invalid position  (was: transient unit test failure in testConsumptionWithBrokerFailures)

> KafkaConsumer rebalance with in-flight fetch can cause invalid position
> -----------------------------------------------------------------------
>
>                 Key: KAFKA-2342
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2342
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: core
>    Affects Versions: 0.8.3
>            Reporter: Jun Rao
>            Assignee: Jason Gustafson
>
> If a rebalance occurs with an in-flight fetch, the new KafkaConsumer can end up updating the fetch position of a partition to an offset which is no longer valid. The consequence is that we may end up either returning to the user messages with an unexpected position or we may fail to give back the right offset in position(). 
> Additionally, this bug causes transient test failures in ConsumerBounceTest.testConsumptionWithBrokerFailures with the following exception:
> kafka.api.ConsumerBounceTest > testConsumptionWithBrokerFailures FAILED
>     java.lang.NullPointerException
>         at org.apache.kafka.clients.consumer.KafkaConsumer.position(KafkaConsumer.java:949)
>         at kafka.api.ConsumerBounceTest.consumeWithBrokerFailures(ConsumerBounceTest.scala:86)
>         at kafka.api.ConsumerBounceTest.testConsumptionWithBrokerFailures(ConsumerBounceTest.scala:61)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)