You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Nitin Gupta <Ni...@e-zest.in> on 2016/06/02 14:01:56 UTC
Offset not updated in Zookeeper
Hi Guys,
I am facing a strange issue. I am using KafkaSpout and BaseBasicBolt to process messages from the Kafka.
There are around 1600 messages in the queue at a given point. From the worker log it seems the messages are being picked but when I use the Zookeeper shell to check the offset being consumed by the topology it gives the same offset(148 ) for a long period of time (checked for 1 hour).
The average latency time being shown on the Storm UI is 10 seconds.
I would like to know after what duration the KafkaSpout would write the offset being consumed back to the Zookeeper. Should I move to BaseRickBolt and do an explicit ack so that the offset are written back to the Zookeeper.
Thanks & Regards,
Nitin Gupta