[jira] [Commented] (KAFKA-5075) The position in the consumers may be advanced incorrectly when some exception is thrown from consumer.poll()

["Gwen Shapira (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15969681#comment-15969681 ] 

Gwen Shapira commented on KAFKA-5075:
-------------------------------------

I changed the fixVersion since this isn't marked as a blocker and we already have an RC for 0.10.2.1.

If you think this is a blocker, please mark it as blocker and respond to the VOTE thread for 0.10.2.1 so we'll know we need to stop the vote.
Is this issue new to 0.10.2 or did it exist in earlier releases too?

> The position in the consumers may be advanced incorrectly when some exception is thrown from consumer.poll()
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-5075
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5075
>             Project: Kafka
>          Issue Type: Bug
>          Components: clients, consumer
>    Affects Versions: 0.10.2.0
>            Reporter: Jiangjie Qin
>             Fix For: 0.11.0.0
>
>
> In Fetcher.fetchRecords() we iterate over the partition data to collect the ConsumerRecords, after we collect some consumer records from a partition, we advance the position of that partition then move on to the next partition. If the next partition throws exceptions (e.g. OffsetOutOfRangeException), the messages that have already been read out of the buffer will not be delivered to the users. Since the positions of the previous partitions have been be updated, those messages will not be consumed again either.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)