You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "netcafe (JIRA)" <ji...@apache.org> on 2015/11/16 14:58:11 UTC

[jira] [Updated] (KAFKA-2843) when consumer got empty messageset, fetchResponse.highWatermark != current_offset?

     [ https://issues.apache.org/jira/browse/KAFKA-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

netcafe updated KAFKA-2843:
---------------------------
    Description: 
I use simple consumer fetch message from brokers,when consumer got empty messageSet,e.g :

    val offset = nextOffset
    val msgSet = fetchResponse.messageSet(topic, partition)

    if (msgSet.isEmpty) {
      val hwOffset = fetchResponse.highWatermark(cli.kafkaTopic, cli.kafkaPartition)
      
      if (offset == hwOffset) {
	 // ok, doSomething...
      } else {  
         // in our scene, i found highWatermark may not equals current offset ,but we did not reproduced it.
	// Is this case could happen ?  if could, why ?
      }
    }

  was:
I use simple consumer fetch message from brokers,when consumer got empty messageSet,e.g :

    val offset = lastOffset
    val msgSet = fetchResponse.messageSet(topic, partition)

    if (msgSet.isEmpty) {
      val hwOffset = fetchResponse.highWatermark(cli.kafkaTopic, cli.kafkaPartition)
      
      if (offset == hwOffset) {
	 // ok, doSomething...
      } else {  
         // in our scene, i found highWatermark may not equals current offset ,but we did not reproduced it.
	// Is this case could happen ?  if could, why ?
      }
    }


> when consumer got empty messageset, fetchResponse.highWatermark != current_offset?
> ----------------------------------------------------------------------------------
>
>                 Key: KAFKA-2843
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2843
>             Project: Kafka
>          Issue Type: Bug
>          Components: offset manager
>    Affects Versions: 0.8.2.1
>            Reporter: netcafe
>
> I use simple consumer fetch message from brokers,when consumer got empty messageSet,e.g :
>     val offset = nextOffset
>     val msgSet = fetchResponse.messageSet(topic, partition)
>     if (msgSet.isEmpty) {
>       val hwOffset = fetchResponse.highWatermark(cli.kafkaTopic, cli.kafkaPartition)
>       
>       if (offset == hwOffset) {
> 	 // ok, doSomething...
>       } else {  
>          // in our scene, i found highWatermark may not equals current offset ,but we did not reproduced it.
> 	// Is this case could happen ?  if could, why ?
>       }
>     }



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)