0.9.0.0 and 0.9.0.1 - Metadata fetching from remote server continuously fails - "Failed to find leader"

[Muthukumaran K <mu...@ericsson.com>]

Hi,

I tried 0.9.0.0 as well as 0.9.0.1 client and server combinations. Broker + Zookeeper runs on VM (Ubuntu 14.04) and consumer (console-consumer) as well as producer (Java client) runs on host (windows)

Changed advertised.host.name to reflect the VM's hostname - kafka-zook. Due to firewall issues, I had to adjust ZK port to 80 and broker port to 25. Added few messages to the topic using a Java producer (in fact, this was way too slow - 1 message sent every 30 seconds - again due to failure to fetch metadata while running producer).

On console-consumer, I see following exception - especially "Failed to find leader for Set([test,0], [test,2], [test,1]) (kafka.consumer.ConherManager$LeaderFinderThread)" continuously.

Both ZK port and broker ports are reachable from host machine

Any clue on what I might be missing ?


c:\Adventures\kafka_2.11-0.9.0.0\kafka_2.11-0.9.0.0\kafka_2.11-0.9.0.0\bin\windows> kafka-console-consumer.bat --topic test --zookeeper kafka-zook:80
[2016-03-17 06:39:18,436] WARN Fetching topic metadata with correlation id 0 for topics [Set(test)] from broker [BrokerEndPoint(0,kafka-zook,25)] failed (kafka.client.ClientUtils$)
java.nio.channels.ClosedChannelException
        at kafka.network.BlockingChannel.send(BlockingChannel.scala:110)
        at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:75)
        at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:74)
        at kafka.producer.SyncProducer.send(SyncProducer.scala:119)
        at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)
        at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:94)
        at kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66)
        at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
[2016-03-17 06:39:18,439] WARN [console-consumer-85209_IN00106404-1458176937011-687fb3e8-leader-finder-thread], Failed to find leader for Set([test,0], [test,2], [test,1]) (kafka.consumer.Con
herManager$LeaderFinderThread)
kafka.common.KafkaException: fetching topic metadata for topics [Set(test)] from broker [ArrayBuffer(BrokerEndPoint(0,kafka-zook,25))] failed
        at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:73)
        at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:94)
        at kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66)
        at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
Caused by: java.nio.channels.ClosedChannelException
        at kafka.network.BlockingChannel.send(BlockingChannel.scala:110)
        at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:75)
        at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:74)
        at kafka.producer.SyncProducer.send(SyncProducer.scala:119)
        at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)
        ... 3 more
[2016-03-17 06:39:39,661] WARN Fetching topic metadata with correlation id 1 for topics [Set(test)] from broker [BrokerEndPoint(0,kafka-zook,25)] failed (kafka.client.ClientUtils$)
java.nio.channels.ClosedChannelException
        at kafka.network.BlockingChannel.send(BlockingChannel.scala:110)
        at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:75)
        at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:74)
        at kafka.producer.SyncProducer.send(SyncProducer.scala:119)
        at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)
        at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:94)
        at kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66)
        at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
Processed a total of 1 messages
Terminate batch job (Y/N)? y


Regards
Muthu