You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kudu.apache.org by 张晓宁 <zh...@jd.com> on 2018/03/11 09:44:24 UTC

Kudu cluster performance cannot grow up with machines added

Hi All:

I am testing kudu cluster performance these days, and found that the performance cannot grow up with machines added. With 1-master and 6-slaves, I got 3.5M TPS(350 million rows inserted per second), while when I add 3 more machines to the cluster, I only got 3.8M TPS. It seems the performance cannot grow up linearly with cluster extension. Why is that? Can anyone give some help? Thanks!

[mail-signature-20171122]


Re: Kudu cluster performance cannot grow up with machines added

Posted by Todd Lipcon <to...@cloudera.com>.
What client are you using to benchmark? You might also be bound by the
client performance.

On Mar 11, 2018 2:04 PM, "Brock Noland" <br...@phdata.io> wrote:

> Hi,
>
> I'd verify that the new nodes are assigned tablets? Along with
> considering an increase the number of partitions on the table being tested.
>
> On Sun, Mar 11, 2018 at 4:44 AM, 张晓宁 <zh...@jd.com> wrote:
>
>> Hi All:
>>
>>
>>
>> I am testing kudu cluster performance these days, and found that the
>> performance cannot grow up with machines added. With 1-master and 6-slaves,
>> I got 3.5M TPS(350 million rows inserted per second), while when I add 3
>> more machines to the cluster, I only got 3.8M TPS. It seems the performance
>> cannot grow up linearly with cluster extension. Why is that? Can anyone
>> give some help? Thanks!
>>
>>
>>
>> [image: mail-signature-20171122]
>>
>>
>>
>
>

Re: Kudu cluster performance cannot grow up with machines added

Posted by Brock Noland <br...@phdata.io>.
Hi,

I'd verify that the new nodes are assigned tablets? Along with considering
an increase the number of partitions on the table being tested.

On Sun, Mar 11, 2018 at 4:44 AM, 张晓宁 <zh...@jd.com> wrote:

> Hi All:
>
>
>
> I am testing kudu cluster performance these days, and found that the
> performance cannot grow up with machines added. With 1-master and 6-slaves,
> I got 3.5M TPS(350 million rows inserted per second), while when I add 3
> more machines to the cluster, I only got 3.8M TPS. It seems the performance
> cannot grow up linearly with cluster extension. Why is that? Can anyone
> give some help? Thanks!
>
>
>
> [image: mail-signature-20171122]
>
>
>