You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "netcafe (JIRA)" <ji...@apache.org> on 2015/11/16 14:58:11 UTC
[jira] [Updated] (KAFKA-2843) when consumer got empty messageset,
fetchResponse.highWatermark != current_offset?
[ https://issues.apache.org/jira/browse/KAFKA-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
netcafe updated KAFKA-2843:
---------------------------
Description:
I use simple consumer fetch message from brokers,when consumer got empty messageSet,e.g :
val offset = nextOffset
val msgSet = fetchResponse.messageSet(topic, partition)
if (msgSet.isEmpty) {
val hwOffset = fetchResponse.highWatermark(cli.kafkaTopic, cli.kafkaPartition)
if (offset == hwOffset) {
// ok, doSomething...
} else {
// in our scene, i found highWatermark may not equals current offset ,but we did not reproduced it.
// Is this case could happen ? if could, why ?
}
}
was:
I use simple consumer fetch message from brokers,when consumer got empty messageSet,e.g :
val offset = lastOffset
val msgSet = fetchResponse.messageSet(topic, partition)
if (msgSet.isEmpty) {
val hwOffset = fetchResponse.highWatermark(cli.kafkaTopic, cli.kafkaPartition)
if (offset == hwOffset) {
// ok, doSomething...
} else {
// in our scene, i found highWatermark may not equals current offset ,but we did not reproduced it.
// Is this case could happen ? if could, why ?
}
}
> when consumer got empty messageset, fetchResponse.highWatermark != current_offset?
> ----------------------------------------------------------------------------------
>
> Key: KAFKA-2843
> URL: https://issues.apache.org/jira/browse/KAFKA-2843
> Project: Kafka
> Issue Type: Bug
> Components: offset manager
> Affects Versions: 0.8.2.1
> Reporter: netcafe
>
> I use simple consumer fetch message from brokers,when consumer got empty messageSet,e.g :
> val offset = nextOffset
> val msgSet = fetchResponse.messageSet(topic, partition)
> if (msgSet.isEmpty) {
> val hwOffset = fetchResponse.highWatermark(cli.kafkaTopic, cli.kafkaPartition)
>
> if (offset == hwOffset) {
> // ok, doSomething...
> } else {
> // in our scene, i found highWatermark may not equals current offset ,but we did not reproduced it.
> // Is this case could happen ? if could, why ?
> }
> }
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)