Performance testing

["Datta, Saurav" <sd...@paypal.com.INVALID>]

Hello,

Is there some documentation on how to run performance tests ?
This link https://gist.github.com/jkreps/c7ddb4041ef62a900e6c lists the commands, but some documentation explaining the usage would be useful.

Regards,
Saurav

Re: Performance testing

[Ewen Cheslack-Postava <ew...@confluent.io>]

We've also converted the benchmarks described in that blog post into a
system test that is now included with the Kafka source code:
https://github.com/apache/kafka/blob/trunk/tests/kafkatest/tests/benchmark_test.py

And Geoff *just* added a wiki page describing how to get up and running
with these tests:
https://cwiki.apache.org/confluence/display/KAFKA/tutorial+-+set+up+and+run+Kafka+system+tests+with+ducktape

So instead of recreating all the tests yourself, you could just use our
system tests to run them on your own hardware. Note that Geoff's
instructions currently cover how to run the tests locally under Virtualbox.
To get real numbers, you might also want to look at the system tests README
to see how you can run them on other systems, such as EC2, for a more
realistic setup: https://github.com/apache/kafka/tree/trunk/tests


On Thu, Aug 13, 2015 at 3:56 PM, Datta, Saurav <sd...@paypal.com.invalid>
wrote:

> Thank you James!
>
>
> Regards,
> Saurav
>
>
> -----Original Message-----
> From: James Cheng <jc...@tivo.com>
> Reply-To: "users@kafka.apache.org" <us...@kafka.apache.org>
> Date: Thursday, August 13, 2015 at 3:42 PM
> To: "users@kafka.apache.org" <us...@kafka.apache.org>
> Subject: Re: Performance testing
>
> >Saurav,
> >
> >Here is the blog post that those commands originally came from:
> >
> >
> http://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-
> >writes-second-three-cheap-machines
> >
> >That post is also linked off of the main kafka pages at:
> >
> >http://kafka.apache.org/performance.html
> >
> >-James
> >
> >On Aug 13, 2015, at 3:36 PM, "Datta, Saurav" <sd...@paypal.com.INVALID>
> >wrote:
> >
> >> Hello,
> >>
> >> Is there some documentation on how to run performance tests ?
> >> This link https://gist.github.com/jkreps/c7ddb4041ef62a900e6c lists the
> >>commands, but some documentation explaining the usage would be useful.
> >>
> >> Regards,
> >> Saurav
> >
>
>


-- 
Thanks,
Ewen

Re: Performance testing

["Datta, Saurav" <sd...@paypal.com.INVALID>]

Thank you James!


Regards,
Saurav


-----Original Message-----
From: James Cheng <jc...@tivo.com>
Reply-To: "users@kafka.apache.org" <us...@kafka.apache.org>
Date: Thursday, August 13, 2015 at 3:42 PM
To: "users@kafka.apache.org" <us...@kafka.apache.org>
Subject: Re: Performance testing

>Saurav,
>
>Here is the blog post that those commands originally came from:
>
>http://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-
>writes-second-three-cheap-machines
>
>That post is also linked off of the main kafka pages at:
>
>http://kafka.apache.org/performance.html
>
>-James
>
>On Aug 13, 2015, at 3:36 PM, "Datta, Saurav" <sd...@paypal.com.INVALID>
>wrote:
>
>> Hello,
>> 
>> Is there some documentation on how to run performance tests ?
>> This link https://gist.github.com/jkreps/c7ddb4041ef62a900e6c lists the
>>commands, but some documentation explaining the usage would be useful.
>> 
>> Regards,
>> Saurav
>

Re: Performance testing

[James Cheng <jc...@tivo.com>]

Saurav,

Here is the blog post that those commands originally came from:

http://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines

That post is also linked off of the main kafka pages at:

http://kafka.apache.org/performance.html

-James

On Aug 13, 2015, at 3:36 PM, "Datta, Saurav" <sd...@paypal.com.INVALID> wrote:

> Hello,
> 
> Is there some documentation on how to run performance tests ?
> This link https://gist.github.com/jkreps/c7ddb4041ef62a900e6c lists the commands, but some documentation explaining the usage would be useful.
> 
> Regards,
> Saurav