You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "chenshangan (JIRA)" <ji...@apache.org> on 2014/09/18 11:50:34 UTC

[jira] [Created] (KAFKA-1640) consumer will fail if encounter special offset

chenshangan created KAFKA-1640:
----------------------------------

             Summary: consumer will fail if encounter special offset
                 Key: KAFKA-1640
                 URL: https://issues.apache.org/jira/browse/KAFKA-1640
             Project: Kafka
          Issue Type: Bug
          Components: consumer
    Affects Versions: 0.8.1.1
            Reporter: chenshangan
            Assignee: Neha Narkhede


I'm running topology on storm which consume messages from kafka. Sometimes I encounter exceptions like offset out of range.  I did not pay much attention on this problem before and just restarted the topology to consume messages from latest offset because of various reasons. Recently, more services are dependent on kafka, and this problem still exists.  According to the invalid offset information, I did a test and finally found the problem. There exists an offset which consumer can never start from and can not skip over it unless you provide next valid offset to start from.  I can not figure out why.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)