Question on recommended Storm Version (for using kafkaspout with kerberized Kafka)

[Sreeram <sr...@gmail.com>]

 Hi,

 I am currently using Storm version 1.0.2 and trying to connect to
Kerberized Kafka (version 0.9.0 on CDH 5.8.2).

 I have been getting issues with connection and I get below error as
given below this mail.

 I would like to know from the community if the storm-kafka-client for
1.0.2 in an external package
(https://github.com/apache/storm/tree/1.0.x-branch/external/storm-kafka-client)
is safe to be used in production.

 Or does the community recommend that I upgrade Storm to version 1.1.0
and Kafka to 0.10.0 (since 1.1.0 has Kafka 0.10.0 as one of its
dependencies) ?

 Kindly let me know.

Thanks,
Sreeram

A: Error Stack trace when connecting to Kerberized Kafka (0.9.0 on CDH
5.8.2) from Storm (1.0.2)
=================================================================================================

java.lang.NullPointerException
        at org.apache.kafka.common.utils.Utils.formatAddress(Utils.java:407)
~[stormjar.jar:?]
        at kafka.consumer.SimpleConsumer$$anonfun$disconnect$1.apply(SimpleConsumer.scala:54)
~[stormjar.jar:?]
        at kafka.consumer.SimpleConsumer$$anonfun$disconnect$1.apply(SimpleConsumer.scala:54)
~[stormjar.jar:?]
        at kafka.utils.Logging$class.debug(Logging.scala:52) [stormjar.jar:?]
        at kafka.consumer.SimpleConsumer.debug(SimpleConsumer.scala:35)
~[stormjar.jar:?]
        at kafka.consumer.SimpleConsumer.disconnect(SimpleConsumer.scala:54)
~[stormjar.jar:?]
        at kafka.consumer.SimpleConsumer.close(SimpleConsumer.scala:75)
~[stormjar.jar:?]
        at kafka.consumer.SimpleConsumer.connect(SimpleConsumer.scala:48)
~[stormjar.jar:?]
        at kafka.consumer.SimpleConsumer.getOrMakeConnection(SimpleConsumer.scala:173)
[stormjar.jar:?]
        at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:84)
[stormjar.jar:?]
        at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:83)
[stormjar.jar:?]
        at kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:149)
[stormjar.jar:?]
        at kafka.javaapi.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:79)
[stormjar.jar:?]
        at org.apache.storm.kafka.KafkaUtils.getOffset(KafkaUtils.java:75)
[stormjar.jar:?]
        at org.apache.storm.kafka.KafkaUtils.getOffset(KafkaUtils.java:65)
[stormjar.jar:?]
        at org.apache.storm.kafka.PartitionManager.<init>(PartitionManager.java:103)
[stormjar.jar:?]
        at org.apache.storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98)
[stormjar.jar:?]
        at org.apache.storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69)
[stormjar.jar:?]
        at org.apache.storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:129)
[stormjar.jar:?]
        at org.gst.topology.spouts.MyKafkaSpout.nextTuple(MyKafkaSpout.java:30)
[stormjar.jar:?]
        at org.apache.storm.daemon.executor$fn__7990$fn__8005$fn__8036.invoke(executor.clj:648)
[storm-core-1.0.2.jar:1.0.2]
        at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484)
[storm-core-1.0.2.jar:1.0.2]
        at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102]

I could also see that Storm was reading null values for partition
information from zookeeper.

2017-06-06 14:39:03.910 o.a.s.k.PartitionManager [INFO] Read partition
information from: /path/partition_4  --> null
2017-06-06 14:39:03.910 o.a.s.k.PartitionManager [INFO] Read partition
information from: /path/partition_0  --> null
2017-06-06 14:39:03.911 o.a.s.k.PartitionManager [INFO] Read partition
information from: /path/partition_2  --> null