Kafka performance test failed

[Bhuvana Baskar <bh...@gmail.com>]

Hi,

I am using kafka_2.9.2-0.8.1.1
Intended to run performance test using run-simulator.sh file.

I started zookeeper and kafka server and finally run the below command

/run-simulator.sh -kafkaServer=localhost -numTopic=10
 -reportFile=report-html/data -time=15 -numConsumer=20 -numProducer=40
-xaxis=numTopic

But the test failed with

Exception in thread "-Consumer-0" java.io.EOFException: Received -1 when
reading from channel, socket has likely been closed.
        at kafka.utils.Utils$.read(Utils.scala:486)
        at
kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
        at kafka.network.Receive$class.readCompletely(Transmission.scala:57)
        at
kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
        at
kafka.consumer.SimpleConsumer.getResponse(SimpleConsumer.scala:184)
        at
kafka.consumer.SimpleConsumer.liftedTree2$1(SimpleConsumer.scala:132)
        at
kafka.consumer.SimpleConsumer.multifetch(SimpleConsumer.scala:122)
        at
kafka.javaapi.consumer.SimpleConsumer.multifetch(SimpleConsumer.scala:55)
        at
kafka.perf.consumer.SimplePerfConsumer.run(SimplePerfConsumer.java:75)
java.io.IOException: Failed to retrieve RMIServer stub:
javax.naming.ServiceUnavailableException [Root exception is
java.rmi.ConnectException: Connection refused to host: localhost; nested
exception is:
        java.net.ConnectException: Connection refused]
        at
javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:338)
        at
javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:248)
        at
kafka.perf.jmx.BrokerJmxClient.getMbeanConnection(BrokerJmxClient.java:29)
        at
kafka.perf.jmx.BrokerJmxClient.createSocketMbean(BrokerJmxClient.java:38)
        at
kafka.perf.jmx.BrokerJmxClient.getBrokerStats(BrokerJmxClient.java:45)
        at kafka.perf.PerfTimer.printReport(PerfTimer.java:93)
        at kafka.perf.PerfTimer.run(PerfTimer.java:141)
Caused by: javax.naming.ServiceUnavailableException [Root exception is
java.rmi.ConnectException: Connection refused to host: localhost; nested
exception is:
        java.net.ConnectException: Connection refused]
        at
com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:101)
        at
com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:185)
        at javax.naming.InitialContext.lookup(InitialContext.java:392)
        at
javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1886)
        at
javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1856)
        at
javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:257)
        ... 6 more
Caused by: java.rmi.ConnectException: Connection refused to host:
localhost; nested exception is:
        java.net.ConnectException: Connection refused
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:601)
        at
sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198)
        at
sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
        at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
        at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
        at
com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:97)
        ... 11 more
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
        at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at java.net.Socket.connect(Socket.java:478)
        at java.net.Socket.<init>(Socket.java:375)
        at java.net.Socket.<init>(Socket.java:189)
        at
sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:22)
        at
sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:128)
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595)

and in server.log

 ERROR Closing socket for /127.0.0.1 because of error
(kafka.network.Processor)
java.nio.BufferUnderflowException
at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:127)
at java.nio.ByteBuffer.get(ByteBuffer.java:675)
at kafka.api.ApiUtils$.readShortString(ApiUtils.scala:38)
at kafka.api.OffsetRequest$.readFrom(OffsetRequest.scala:39)
at kafka.api.RequestKeys$$anonfun$3.apply(RequestKeys.scala:38)
at kafka.api.RequestKeys$$anonfun$3.apply(RequestKeys.scala:38)
at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:53)
at kafka.network.Processor.read(SocketServer.scala:353)
at kafka.network.Processor.run(SocketServer.scala:245)
at java.lang.Thread.run(Thread.java:619)
INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor)

please let me know how to resolve this.

Thanks.