You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Michael Popov <mp...@microsoft.com> on 2014/01/29 22:34:13 UTC

Kafka performance testing

Hi,

I try to run Kafka performance tests on my hosts. I get this error message:

[User@Client1 kafka_2.8.0-0.8.0]$ ./bin/kafka-producer-perf-test.sh
Exception in thread "main" java.lang.NoClassDefFoundError: kafka/perf/ProducerPerformance
Caused by: java.lang.ClassNotFoundException: kafka.perf.ProducerPerformance
        at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
Could not find the main class: kafka.perf.ProducerPerformance. Program will exit.

The command line generated by the script looks like this:

java -Xmx512M -server -XX:+UseCompressedOops -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dlog4j.configuration=file:/home/User/work/kafka_2.8.0-0.8.0/bin/../config/tools-log4j.properties -cp :/home/User/work/kafka_2.8.0-0.8.0/bin/../core/target/scala-2.8.0/*.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../perf/target/scala-2.8.0/kafka*.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/jopt-simple-3.2.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/log4j-1.2.15.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/metrics-annotation-2.2.0.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/metrics-core-2.2.0.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/scala-compiler.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/scala-library.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/slf4j-api-1.7.2.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/slf4j-simple-1.6.4.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/snappy-java-1.0.4.1.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/zkclient-0.3.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/zookeeper-3.3.4.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../kafka_2.8.0-0.8.0.jar kafka.perf.ProducerPerformance

I unzipped kafka_2.8.0-0.8.0.jar and verified that there is no perf subdirectory.
Kafka deployment package was downloaded this morning from the official Apache mirror.

How this problem can be solved?

Thank you,
Michael Popov

Re: Kafka performance testing

Posted by Joe Stein <jo...@stealth.ly>.
Download the source and build from source

wget https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz
tar -xvf kafka-0.8.0-src.tgz
cd kafka-0.8.0-src.tgz
./sbt update
./sbt package
./sbt assembly-package-dependency

/*******************************************
 Joe Stein
 Founder, Principal Consultant
 Big Data Open Source Security LLC
 http://www.stealth.ly
 Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/


On Wed, Jan 29, 2014 at 4:34 PM, Michael Popov <mp...@microsoft.com> wrote:

> Hi,
>
> I try to run Kafka performance tests on my hosts. I get this error message:
>
> [User@Client1 kafka_2.8.0-0.8.0]$ ./bin/kafka-producer-perf-test.sh
> Exception in thread "main" java.lang.NoClassDefFoundError:
> kafka/perf/ProducerPerformance
> Caused by: java.lang.ClassNotFoundException: kafka.perf.ProducerPerformance
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
> Could not find the main class: kafka.perf.ProducerPerformance. Program
> will exit.
>
> The command line generated by the script looks like this:
>
> java -Xmx512M -server -XX:+UseCompressedOops -XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled
> -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC
> -Djava.awt.headless=true -Dcom.sun.management.jmxremote
> -Dcom.sun.management.jmxremote.authenticate=false
> -Dcom.sun.management.jmxremote.ssl=false
> -Dlog4j.configuration=file:/home/User/work/kafka_2.8.0-0.8.0/bin/../config/tools-log4j.properties
> -cp
> :/home/User/work/kafka_2.8.0-0.8.0/bin/../core/target/scala-2.8.0/*.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../perf/target/scala-2.8.0/kafka*.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/jopt-simple-3.2.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/log4j-1.2.15.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/metrics-annotation-2.2.0.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/metrics-core-2.2.0.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/scala-compiler.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/scala-library.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/slf4j-api-1.7.2.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/slf4j-simple-1.6.4.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/snappy-java-1.0.4.1.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/zkclient-0.3.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/zookeeper-3.3.4.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../kafka_2.8.0-0.8.0.jar
> kafka.perf.ProducerPerformance
>
> I unzipped kafka_2.8.0-0.8.0.jar and verified that there is no perf
> subdirectory.
> Kafka deployment package was downloaded this morning from the official
> Apache mirror.
>
> How this problem can be solved?
>
> Thank you,
> Michael Popov
>
>