You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Ara Ebrahimi <ar...@argyledata.com> on 2017/02/01 20:14:08 UTC
kafka-consumer-offset-checker complaining about NoNode for X in zk
Hi,
For a subset of our topics we get this error:
$KAFKA_HOME/bin/kafka-consumer-offset-checker.sh --group argyle-streams --topic topic_name --zookeeper $ZOOKEEPERS
[2017-02-01 12:08:56,115] WARN WARNING: ConsumerOffsetChecker is deprecated and will be dropped in releases following 0.9.0. Use ConsumerGroupCommand instead. (kafka.tools.ConsumerOffsetChecker$)
Exiting due to: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /consumers/streams-app/offsets/topic_name/2.
All topics are created via the same process but a few of them report this error.
Why I check in zk there’s noting under /consumers:
zookeeper-client -server $ZOOKEEPERS -cmd ls /consumers
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
[]
But the kafka-consumer-offset-checker does work for many topics anyway, and it fails for a few.
Why does this happen? How can I fix it?
Thanks,
Ara.
________________________________
This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Thank you in advance for your cooperation.
________________________________
Re: kafka-consumer-offset-checker complaining about NoNode for X in
zk
Posted by Ara Ebrahimi <ar...@argyledata.com>.
Thanks! Worked like a charm.
For some partitions, which do have data, I see “unknown” reported as offset. Any idea what unknown means?
Also what’s the new command for setting offsets? Specifically move it back to point 0, AND also to move it to the end.
Ara.
> On Feb 2, 2017, at 11:21 AM, Jan Filipiak <Ja...@trivago.com> wrote:
>
> Hi,
>
> sorry and using the consumer group tool, instead of the offset checker
>
>
> On 02.02.2017 20:08, Jan Filipiak wrote:
>> Hi,
>>
>> if its a kafka stream app, its most likely going to store its offsets
>> in kafka rather than zookeeper.
>> You can use the --new-consumer option to check for kafka stored offsets.
>>
>> Best Jan
>>
>>
>> On 01.02.2017 21:14, Ara Ebrahimi wrote:
>>> Hi,
>>>
>>> For a subset of our topics we get this error:
>>>
>>> $KAFKA_HOME/bin/kafka-consumer-offset-checker.sh --group
>>> argyle-streams --topic topic_name --zookeeper $ZOOKEEPERS
>>> [2017-02-01 12:08:56,115] WARN WARNING: ConsumerOffsetChecker is
>>> deprecated and will be dropped in releases following 0.9.0. Use
>>> ConsumerGroupCommand instead. (kafka.tools.ConsumerOffsetChecker$)
>>> Exiting due to: org.apache.zookeeper.KeeperException$NoNodeException:
>>> KeeperErrorCode = NoNode for
>>> /consumers/streams-app/offsets/topic_name/2.
>>>
>>> All topics are created via the same process but a few of them report
>>> this error.
>>>
>>> Why I check in zk there’s noting under /consumers:
>>>
>>> zookeeper-client -server $ZOOKEEPERS -cmd ls /consumers
>>>
>>> WATCHER::
>>>
>>> WatchedEvent state:SyncConnected type:None path:null
>>> []
>>>
>>> But the kafka-consumer-offset-checker does work for many topics
>>> anyway, and it fails for a few.
>>>
>>> Why does this happen? How can I fix it?
>>>
>>> Thanks,
>>> Ara.
>>>
>>>
>>>
>>> ________________________________
>>>
>>> This message is for the designated recipient only and may contain
>>> privileged, proprietary, or otherwise confidential information. If
>>> you have received it in error, please notify the sender immediately
>>> and delete the original. Any other use of the e-mail by you is
>>> prohibited. Thank you in advance for your cooperation.
>>>
>>> ________________________________
>>
>
>
>
>
> ________________________________
>
> This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Thank you in advance for your cooperation.
>
> ________________________________
________________________________
This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Thank you in advance for your cooperation.
________________________________
Re: kafka-consumer-offset-checker complaining about NoNode for X
in zk
Posted by Jan Filipiak <Ja...@trivago.com>.
Hi,
sorry and using the consumer group tool, instead of the offset checker
On 02.02.2017 20:08, Jan Filipiak wrote:
> Hi,
>
> if its a kafka stream app, its most likely going to store its offsets
> in kafka rather than zookeeper.
> You can use the --new-consumer option to check for kafka stored offsets.
>
> Best Jan
>
>
> On 01.02.2017 21:14, Ara Ebrahimi wrote:
>> Hi,
>>
>> For a subset of our topics we get this error:
>>
>> $KAFKA_HOME/bin/kafka-consumer-offset-checker.sh --group
>> argyle-streams --topic topic_name --zookeeper $ZOOKEEPERS
>> [2017-02-01 12:08:56,115] WARN WARNING: ConsumerOffsetChecker is
>> deprecated and will be dropped in releases following 0.9.0. Use
>> ConsumerGroupCommand instead. (kafka.tools.ConsumerOffsetChecker$)
>> Exiting due to: org.apache.zookeeper.KeeperException$NoNodeException:
>> KeeperErrorCode = NoNode for
>> /consumers/streams-app/offsets/topic_name/2.
>>
>> All topics are created via the same process but a few of them report
>> this error.
>>
>> Why I check in zk there’s noting under /consumers:
>>
>> zookeeper-client -server $ZOOKEEPERS -cmd ls /consumers
>>
>> WATCHER::
>>
>> WatchedEvent state:SyncConnected type:None path:null
>> []
>>
>> But the kafka-consumer-offset-checker does work for many topics
>> anyway, and it fails for a few.
>>
>> Why does this happen? How can I fix it?
>>
>> Thanks,
>> Ara.
>>
>>
>>
>> ________________________________
>>
>> This message is for the designated recipient only and may contain
>> privileged, proprietary, or otherwise confidential information. If
>> you have received it in error, please notify the sender immediately
>> and delete the original. Any other use of the e-mail by you is
>> prohibited. Thank you in advance for your cooperation.
>>
>> ________________________________
>
Re: kafka-consumer-offset-checker complaining about NoNode for X
in zk
Posted by Jan Filipiak <Ja...@trivago.com>.
Hi,
if its a kafka stream app, its most likely going to store its offsets
in kafka rather than zookeeper.
You can use the --new-consumer option to check for kafka stored offsets.
Best Jan
On 01.02.2017 21:14, Ara Ebrahimi wrote:
> Hi,
>
> For a subset of our topics we get this error:
>
> $KAFKA_HOME/bin/kafka-consumer-offset-checker.sh --group argyle-streams --topic topic_name --zookeeper $ZOOKEEPERS
> [2017-02-01 12:08:56,115] WARN WARNING: ConsumerOffsetChecker is deprecated and will be dropped in releases following 0.9.0. Use ConsumerGroupCommand instead. (kafka.tools.ConsumerOffsetChecker$)
> Exiting due to: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /consumers/streams-app/offsets/topic_name/2.
>
> All topics are created via the same process but a few of them report this error.
>
> Why I check in zk there’s noting under /consumers:
>
> zookeeper-client -server $ZOOKEEPERS -cmd ls /consumers
>
> WATCHER::
>
> WatchedEvent state:SyncConnected type:None path:null
> []
>
> But the kafka-consumer-offset-checker does work for many topics anyway, and it fails for a few.
>
> Why does this happen? How can I fix it?
>
> Thanks,
> Ara.
>
>
>
> ________________________________
>
> This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Thank you in advance for your cooperation.
>
> ________________________________