You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Antony A <an...@gmail.com> on 2019/09/27 19:35:24 UTC
Kafka Broker - High CPU
Hi,
I am running Kafka 1.0.1 on a 7 broker cluster. On one of the brokers the
CPU usage is always pegged around 98% utilization. If anyone had similar
issues, please can you comment on it?
Thanks,
AA
Re: Kafka Broker - High CPU
Posted by "M. Manna" <ma...@gmail.com>.
1.0.1 is very old version of Kafka. Is there any chance you would consider
a rolling upgrade ?
Regards,
On Sun, 29 Sep 2019 at 22:43, Jamie <ja...@aol.co.uk.invalid> wrote:
> Have you got any producers using an older version of Kafka? Does the
> broker with high CPU usage contain the leader of any topics which don't
> have leaders on other brokers? Is the server.properties file the same
> across all brokers (minus broker.id etc)?
>
>
> Many Thanks,
> Jamie
>
> -----Original Message-----
> From: Sabarish Sasidharan <sa...@gmail.com>
> To: users <us...@kafka.apache.org>
> Sent: Sat, 28 Sep 2019 1:26
> Subject: Re: Kafka Broker - High CPU
>
> You can do a top -H to see which thread pid(s) is/are contributing to this.
> And then map to hex of that in thread dump to identify the culprits. Might
> lead to some additional clues.
>
> Regards
> Sab
>
>
> On Sat, 28 Sep 2019, 1:38 am Antony A, <an...@gmail.com> wrote:
>
> > Partition Leaders are pretty evenly matched between the brokers around
> 500
> >
> > It is the kafka broker (java) process running at 550% on a 6 core VM. The
> > other brokers are running at 250% on a 4 core VMs.
> >
> > On Fri, Sep 27, 2019 at 1:44 PM Harper Henn
> <harper.henn@datto.com.invalid
> > >
> > wrote:
> >
> > > Is partition leadership spread evenly among the nodes in your cluster?
> > > Since only the leaders of a partition will service reads and writes,
> one
> > > broker could be using more CPU than the others if it was the leader for
> > > more partitions.
> > >
> > > Have you tried using a utility like top or htop? what processes does it
> > > show with the highest CPU?
> > >
> > > On Fri, Sep 27, 2019 at 12:35 PM Antony A <an...@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I am running Kafka 1.0.1 on a 7 broker cluster. On one of the brokers
> > the
> > > > CPU usage is always pegged around 98% utilization. If anyone had
> > similar
> > > > issues, please can you comment on it?
> > > >
> > > > Thanks,
> > > > AA
> > > >
> > >
> >
>
Re: Kafka Broker - High CPU
Posted by Jamie <ja...@aol.co.uk.INVALID>.
Have you got any producers using an older version of Kafka? Does the broker with high CPU usage contain the leader of any topics which don't have leaders on other brokers? Is the server.properties file the same across all brokers (minus broker.id etc)?
Many Thanks,
Jamie
-----Original Message-----
From: Sabarish Sasidharan <sa...@gmail.com>
To: users <us...@kafka.apache.org>
Sent: Sat, 28 Sep 2019 1:26
Subject: Re: Kafka Broker - High CPU
You can do a top -H to see which thread pid(s) is/are contributing to this.
And then map to hex of that in thread dump to identify the culprits. Might
lead to some additional clues.
Regards
Sab
On Sat, 28 Sep 2019, 1:38 am Antony A, <an...@gmail.com> wrote:
> Partition Leaders are pretty evenly matched between the brokers around 500
>
> It is the kafka broker (java) process running at 550% on a 6 core VM. The
> other brokers are running at 250% on a 4 core VMs.
>
> On Fri, Sep 27, 2019 at 1:44 PM Harper Henn <harper.henn@datto.com.invalid
> >
> wrote:
>
> > Is partition leadership spread evenly among the nodes in your cluster?
> > Since only the leaders of a partition will service reads and writes, one
> > broker could be using more CPU than the others if it was the leader for
> > more partitions.
> >
> > Have you tried using a utility like top or htop? what processes does it
> > show with the highest CPU?
> >
> > On Fri, Sep 27, 2019 at 12:35 PM Antony A <an...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I am running Kafka 1.0.1 on a 7 broker cluster. On one of the brokers
> the
> > > CPU usage is always pegged around 98% utilization. If anyone had
> similar
> > > issues, please can you comment on it?
> > >
> > > Thanks,
> > > AA
> > >
> >
>
Re: Kafka Broker - High CPU
Posted by Sabarish Sasidharan <sa...@gmail.com>.
You can do a top -H to see which thread pid(s) is/are contributing to this.
And then map to hex of that in thread dump to identify the culprits. Might
lead to some additional clues.
Regards
Sab
On Sat, 28 Sep 2019, 1:38 am Antony A, <an...@gmail.com> wrote:
> Partition Leaders are pretty evenly matched between the brokers around 500
>
> It is the kafka broker (java) process running at 550% on a 6 core VM. The
> other brokers are running at 250% on a 4 core VMs.
>
> On Fri, Sep 27, 2019 at 1:44 PM Harper Henn <harper.henn@datto.com.invalid
> >
> wrote:
>
> > Is partition leadership spread evenly among the nodes in your cluster?
> > Since only the leaders of a partition will service reads and writes, one
> > broker could be using more CPU than the others if it was the leader for
> > more partitions.
> >
> > Have you tried using a utility like top or htop? what processes does it
> > show with the highest CPU?
> >
> > On Fri, Sep 27, 2019 at 12:35 PM Antony A <an...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I am running Kafka 1.0.1 on a 7 broker cluster. On one of the brokers
> the
> > > CPU usage is always pegged around 98% utilization. If anyone had
> similar
> > > issues, please can you comment on it?
> > >
> > > Thanks,
> > > AA
> > >
> >
>
Re: Kafka Broker - High CPU
Posted by Antony A <an...@gmail.com>.
Partition Leaders are pretty evenly matched between the brokers around 500
It is the kafka broker (java) process running at 550% on a 6 core VM. The
other brokers are running at 250% on a 4 core VMs.
On Fri, Sep 27, 2019 at 1:44 PM Harper Henn <ha...@datto.com.invalid>
wrote:
> Is partition leadership spread evenly among the nodes in your cluster?
> Since only the leaders of a partition will service reads and writes, one
> broker could be using more CPU than the others if it was the leader for
> more partitions.
>
> Have you tried using a utility like top or htop? what processes does it
> show with the highest CPU?
>
> On Fri, Sep 27, 2019 at 12:35 PM Antony A <an...@gmail.com>
> wrote:
>
> > Hi,
> >
> > I am running Kafka 1.0.1 on a 7 broker cluster. On one of the brokers the
> > CPU usage is always pegged around 98% utilization. If anyone had similar
> > issues, please can you comment on it?
> >
> > Thanks,
> > AA
> >
>
Re: Kafka Broker - High CPU
Posted by Harper Henn <ha...@datto.com.INVALID>.
Is partition leadership spread evenly among the nodes in your cluster?
Since only the leaders of a partition will service reads and writes, one
broker could be using more CPU than the others if it was the leader for
more partitions.
Have you tried using a utility like top or htop? what processes does it
show with the highest CPU?
On Fri, Sep 27, 2019 at 12:35 PM Antony A <an...@gmail.com> wrote:
> Hi,
>
> I am running Kafka 1.0.1 on a 7 broker cluster. On one of the brokers the
> CPU usage is always pegged around 98% utilization. If anyone had similar
> issues, please can you comment on it?
>
> Thanks,
> AA
>