Kafka Consumer stops receiving messages.

[Nikhil Bansal <ni...@paytm.com>]

Hi All,

My kafka consumer suddenly stops receiving messages and lags keep on
 increasing.
Stack trace shows me the following for all the consumer threads.

*"pool-43-thread-20" prio=10 tid=0x00007f9a1d9d5000 nid=0x17888 waiting on
condition [0x00007f95d8e0d000]*

*   java.lang.Thread.State: WAITING (parking)*

*        at sun.misc.Unsafe.park(Native Method)*

*        - parking to wait for  <0x0000000781d1f6e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)*

*        at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)*

*        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)*

*        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)*

*        at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:63)*

*        at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)*

*        at
kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)*

*        at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)*

*        at
com.paytm.wallet.consumer.EmailConsumerThread.run(EmailConsumerThread.java:32)*

*        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)*

*        at java.util.concurrent.FutureTask.run(FutureTask.java:262)*

*        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)*

*        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*

*        at java.lang.Thread.run(Thread.java:744).*


I am using kafka version *kafka_2.10-0.8.2.0*.


Please let me know the reason for the same.


-- 

*Regards,*

*Nikhil Bansal*
*Software Engineer*
+91-9582090567