You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Alex Cozzi <al...@gmail.com> on 2017/03/09 04:24:14 UTC

performance regression with 0.10.2.0 client talking to 0.10.0.1 servers

I noticed a significant reduction in throughput when I upgraded my app to 0.10.2.0. I am talking to 0.10.0.1 server and I wanted to take advantage of the compatibility of the newest release with old server, but I noticed that my performance went from 20K msg/sec to 2K msg/sec in one case and from 9K msg/sec to 4K msg/sec in another case.
Is this expected or should I file a bug?
Alex

Re: performance regression with 0.10.2.0 client talking to 0.10.0.1 servers

Posted by Ismael Juma <is...@juma.me.uk>.
Sorry, after a second look, that PR only fixes a cosmetic issue, it
shouldn't be the reason for the performance issue you are seeing.

Ismael

On Thu, Mar 16, 2017 at 12:57 PM, Ismael Juma <is...@juma.me.uk> wrote:

> Hi Alex,
>
> The following could be the reason for your performance issue:
>
> https://github.com/apache/kafka/pull/2694
>
> Ismael
>
> On Thu, Mar 9, 2017 at 8:33 AM, Ismael Juma <is...@juma.me.uk> wrote:
>
>> Hi Alex,
>>
>> Yes, please file a JIRA and include as much detail as possible: configs
>> used by the broker and producer/consumer (it wasn't clear which had the
>> issue), message size and a sketch of what the code is doing and what is
>> being measured.
>>
>> Thanks,
>> Ismael
>>
>> On Thu, Mar 9, 2017 at 4:24 AM, Alex Cozzi <al...@gmail.com> wrote:
>>
>>> I noticed a significant reduction in throughput when I upgraded my app
>>> to 0.10.2.0. I am talking to 0.10.0.1 server and I wanted to take advantage
>>> of the compatibility of the newest release with old server, but I noticed
>>> that my performance went from 20K msg/sec to 2K msg/sec in one case and
>>> from 9K msg/sec to 4K msg/sec in another case.
>>> Is this expected or should I file a bug?
>>> Alex
>>
>>
>>
>

Re: performance regression with 0.10.2.0 client talking to 0.10.0.1 servers

Posted by Ismael Juma <is...@juma.me.uk>.
Hi Alex,

The following could be the reason for your performance issue:

https://github.com/apache/kafka/pull/2694

Ismael

On Thu, Mar 9, 2017 at 8:33 AM, Ismael Juma <is...@juma.me.uk> wrote:

> Hi Alex,
>
> Yes, please file a JIRA and include as much detail as possible: configs
> used by the broker and producer/consumer (it wasn't clear which had the
> issue), message size and a sketch of what the code is doing and what is
> being measured.
>
> Thanks,
> Ismael
>
> On Thu, Mar 9, 2017 at 4:24 AM, Alex Cozzi <al...@gmail.com> wrote:
>
>> I noticed a significant reduction in throughput when I upgraded my app to
>> 0.10.2.0. I am talking to 0.10.0.1 server and I wanted to take advantage of
>> the compatibility of the newest release with old server, but I noticed that
>> my performance went from 20K msg/sec to 2K msg/sec in one case and from 9K
>> msg/sec to 4K msg/sec in another case.
>> Is this expected or should I file a bug?
>> Alex
>
>
>

Re: performance regression with 0.10.2.0 client talking to 0.10.0.1 servers

Posted by Ismael Juma <is...@juma.me.uk>.
Hi Alex,

Yes, please file a JIRA and include as much detail as possible: configs
used by the broker and producer/consumer (it wasn't clear which had the
issue), message size and a sketch of what the code is doing and what is
being measured.

Thanks,
Ismael

On Thu, Mar 9, 2017 at 4:24 AM, Alex Cozzi <al...@gmail.com> wrote:

> I noticed a significant reduction in throughput when I upgraded my app to
> 0.10.2.0. I am talking to 0.10.0.1 server and I wanted to take advantage of
> the compatibility of the newest release with old server, but I noticed that
> my performance went from 20K msg/sec to 2K msg/sec in one case and from 9K
> msg/sec to 4K msg/sec in another case.
> Is this expected or should I file a bug?
> Alex