You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/09/18 09:02:00 UTC
[jira] [Updated] (STORM-2607) [kafka-client] Consumer group every
time with lag 1
[ https://issues.apache.org/jira/browse/STORM-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated STORM-2607:
----------------------------------
Labels: pull-request-available (was: )
> [kafka-client] Consumer group every time with lag 1
> ---------------------------------------------------
>
> Key: STORM-2607
> URL: https://issues.apache.org/jira/browse/STORM-2607
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-kafka-client
> Affects Versions: 2.0.0, 1.1.1
> Reporter: Rodolfo Ribeiro SIlva
> Assignee: Hugo Louro
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> When i put a message a partition, the storm-kafka-client consume this message.
> But storm-kafka-client commit the offset -1.
> storm-kafka-client: 1.1.0
> storm-core : 1.1.0
> kafka: 0.10.2.0
> Steps to bug
> #1 - Insert message in kafka
> #2 - Read with storm Spout this topic
> #3 - Get the offset for the consumer group and the offset is always offset -1
> The KafkaSpoutConfig
> protected static KafkaSpoutConfig<String, String> newKafkaSpoutConfig() {
> return KafkaSpoutConfig.builder("192.168.57.11:9092", "topic").
> setGroupId("storm").setOffsetCommitPeriodMs(10_000).
> setMaxUncommittedOffsets(100_0000).setRetry(newRetryService())
> .build();
> }
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)