You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Romaric Parmentier (JIRA)" <ji...@apache.org> on 2016/12/08 10:03:58 UTC
[jira] [Comment Edited] (KAFKA-4505) Cannot get topic lag since
kafka upgrade from 0.8.1.0 to 0.10.1.0
[ https://issues.apache.org/jira/browse/KAFKA-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731713#comment-15731713 ]
Romaric Parmentier edited comment on KAFKA-4505 at 12/8/16 10:03 AM:
---------------------------------------------------------------------
Hi huxi,
Thank you for you answer.
Indeed, it seems that some owners have desappear: Here some example:
This one has no more owners or ids
[zk: 172.16.22.1:2181(CONNECTED) 2] ls /consumers/log_level_export2_group_deduplicating
[offsets]
[zk: 172.16.22.1:2181(CONNECTED) 3] ls /consumers/log_level_export2_group_deduplicating/offsets
[Views]
[zk: 172.16.22.1:2181(CONNECTED) 4] ls /consumers/log_level_export2_group_deduplicating/offsets/Views
[3, 2, 1, 0]
I have 2 other topics (with only one partition) sharing the same group name and it has owners, offsets and ids for both topics:
[zk: 172.16.22.1:2181(CONNECTED) 5] ls /consumers/hourly_group
[owners, offsets, ids]
[zk: 172.16.22.1:2181(CONNECTED) 6] ls /consumers/hourly_group/owners
[hourly_valo, hourly]
I have 2 other topics (with each 3 partition) sharing the same group name and it has owners for only one of the topics and offsets for both.
What should I do ?
was (Author: rparmentier):
Hi huxi,
Thank you for you answer.
Indeed, it seems that some owners have desappear: Here some example:
This one has no more owners or ids
[zk: 172.16.22.1:2181(CONNECTED) 2] ls /consumers/log_level_export2_group_deduplicating
[offsets]
[zk: 172.16.22.1:2181(CONNECTED) 3] ls /consumers/log_level_export2_group_deduplicating/offsets
[Views]
[zk: 172.16.22.1:2181(CONNECTED) 4] ls /consumers/log_level_export2_group_deduplicating/offsets/Views
[3, 2, 1, 0]
I have 2 other topics (with only one partition) sharing the same group name and it has owners, offsets and ids for both topics:
[zk: 172.16.22.1:2181(CONNECTED) 5] ls /consumers/hourly_group
[owners, offsets, ids]
[zk: 172.16.22.1:2181(CONNECTED) 6] ls /consumers/hourly_group/owners
[hourly_valo, hourly]
I have 2 other topics (with each 3 partition) sharing the same group name and it has owners for only one of the topics, offsets for both.
What should I do ?
> Cannot get topic lag since kafka upgrade from 0.8.1.0 to 0.10.1.0
> -----------------------------------------------------------------
>
> Key: KAFKA-4505
> URL: https://issues.apache.org/jira/browse/KAFKA-4505
> Project: Kafka
> Issue Type: Bug
> Components: consumer, metrics, offset manager
> Affects Versions: 0.10.1.0
> Reporter: Romaric Parmentier
> Priority: Critical
>
> We were using kafka 0.8.1.1 and we just migrate to version 0.10.1.0.
> Since we migrate we are using the new script kafka-consumer-groups.sh to retreive topic lags but it don't seem to work anymore.
> Because the application is using the 0.8 driver we have added the following conf to each kafka servers:
> log.message.format.version=0.8.2
> inter.broker.protocol.version=0.10.0.0
> When I'm using the option --list with kafka-consumer-groups.sh I can see every consumer groups I'm using but the --describe is not working:
> /usr/share/kafka$ bin/kafka-consumer-groups.sh --zookeeper ip:2181 --describe --group group_name
> No topic available for consumer group provided
> GROUP TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG OWNER
> When I'm looking into zookeeper I can see the offset increasing for this consumer group.
> Any idea ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)