You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "Siyuan Hua (JIRA)" <ji...@apache.org> on 2016/07/06 18:29:11 UTC
[jira] [Created] (APEXMALHAR-2134) Catch NullPointerException if
some Kafka partition has no leader broker
Siyuan Hua created APEXMALHAR-2134:
--------------------------------------
Summary: Catch NullPointerException if some Kafka partition has no leader broker
Key: APEXMALHAR-2134
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2134
Project: Apache Apex Malhar
Issue Type: Bug
Reporter: Siyuan Hua
Assignee: Siyuan Hua
Fix For: 3.5.0, 3.4.1
Kafka partition could have no leader broker some time and we need to catch exception and skip that partition for the time until new leader is elected
Here is the exception we see in the stacktrace
2016-07-05 14:00:46,087 ERROR kafka.SimpleKafkaConsumer (SimpleKafkaConsumer.java:run(481)) - Exception {}
java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at com.datatorrent.contrib.kafka.SimpleKafkaConsumer$MetaDataMonitorTask.monitorMetadata(SimpleKafkaConsumer.java:511)
at com.datatorrent.contrib.kafka.SimpleKafkaConsumer$MetaDataMonitorTask.run(SimpleKafkaConsumer.java:477)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2016-07-05 14:01:15,999 ERROR kafka.SimpleKafkaConsumer (SimpleKafkaConsumer.java:run(481)) - Exception {}
java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at com.datatorrent.contrib.kafka.SimpleKafkaConsumer$MetaDataMonitorTask.monitorMetadata(SimpleKafkaConsumer.java:511)
at com.datatorrent.contrib.kafka.SimpleKafkaConsumer$MetaDataMonitorTask.run(SimpleKafkaConsumer.java:477)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)