Something Bad Happened

[Chris Barlock <ba...@us.ibm.com>]

I started getting the following errors on all topics:

root@kafka-1-bw3ys:/opt/kafka/bin# ./kafka-console-consumer.sh --topic 
systemconfig --from-beginning --zookeeper $ZOOKEEPER_URL
[2016-06-20 23:43:27,460] WARN Fetching topic metadata with correlation id 
0 for topics [Set(systemconfig)] from broker 
[id:1,host:10.0.0.188,port:9092] failed (kafka.client.ClientUtils$)
java.io.EOFException: Received -1 when reading from channel, socket has 
likely been closed.
        at kafka.utils.Utils$.read(Utils.scala:381)
        at 
kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
        at 
kafka.network.Receive$class.readCompletely(Transmission.scala:56)
        at 
kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
        at 
kafka.network.BlockingChannel.receive(BlockingChannel.scala:111)
        at 
kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:75)
        at 
kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:72)
        at kafka.producer.SyncProducer.send(SyncProducer.scala:113)
        at 
kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:58)
        at 
kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:93)
        at 
kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66)
        at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
[2016-06-20 23:43:27,464] WARN 
[console-consumer-58602_kafka-1-bw3ys-1466466206807-f78e50cd-leader-finder-thread], 
Failed to find leader for Set([systemconfig,1], [systemconfig,3], 
[systemconfig,0], [systemconfig,2], [systemconfig,4]) 
(kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
kafka.common.KafkaException: fetching topic metadata for topics 
[Set(systemconfig)] from broker 
[ArrayBuffer(id:1,host:10.0.0.188,port:9092)] failed
        at 
kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:72)
        at 
kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:93)
        at 
kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66)
        at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
Caused by: java.io.EOFException: Received -1 when reading from channel, 
socket has likely been closed.
        at kafka.utils.Utils$.read(Utils.scala:381)
        at 
kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
        at 
kafka.network.Receive$class.readCompletely(Transmission.scala:56)
        at 
kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
        at 
kafka.network.BlockingChannel.receive(BlockingChannel.scala:111)
        at 
kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:75)
        at 
kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:72)
        at kafka.producer.SyncProducer.send(SyncProducer.scala:113)
        at 
kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:58)
        ... 3 more

This is with Kafka 0.8.2.1, but it also happens with 0.10.0.0.  Kafka and 
ZooKeeper are running in separate Docker containers.  I'm leaning toward a 
problem with my environment, but would love suggestions as to what might 
be causing this.

Thanks!

Chris