回复： How to reduce kafka's rebalance time ?

[堅強de泡沫 <je...@qq.com>]

I modified some consumer configuration items, mainly about the parameters of fetch frequency, heartbeat, and session timeout. The problem of long time rebalance has not been found in the test environment for a long time. The relevant configuration is as follows:fetch-max-wait: 1s
heartbeat-interval: 1s
session.timeout.ms: 10000
metadata.max.age.ms: 6000
max.poll.records: 100
max.poll.interval.ms: 500




------------------ 原始邮件 ------------------
发件人: "Shantanu Deshmukh"<sh...@gmail.com>;
发送时间: 2018年8月16日(星期四) 下午2:25
收件人: "users"<us...@kafka.apache.org>;

主题: Re: How to reduce kafka's rebalance time ?



I am also facing the same issue. Whenever I am restarting my consumers it
is taking upto 10 minutes to start consumption. Also some of the consumers
randomly rebalance and it again takes same amount of time to complete
rebalance.
I haven't been able to figure out any solution for this issue, nor have I
received any help from here.

On Thu, Aug 16, 2018 at 9:56 AM 堅強de泡沫 <je...@qq.com> wrote:

> hello:
> How to reduce kafka's rebalance time ?
> It takes a lot of time to rebalance each time. Why?

Re: How to reduce kafka's rebalance time ?

[Steve Tian <st...@gmail.com>]

Interesting.  Thanks for letting us know.

On Fri, 17 Aug 2018 at 11:22 堅強de泡沫 <je...@qq.com> wrote:

> I modified some consumer configuration items, mainly about the parameters
> of fetch frequency, heartbeat, and session timeout. The problem of long
> time rebalance has not been found in the test environment for a long time.
> The relevant configuration is as follows:fetch-max-wait: 1s
> heartbeat-interval: 1s
> session.timeout.ms: 10000
> metadata.max.age.ms: 6000
> max.poll.records: 100
> max.poll.interval.ms: 500
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Shantanu Deshmukh"<sh...@gmail.com>;
> 发送时间: 2018年8月16日(星期四) 下午2:25
> 收件人: "users"<us...@kafka.apache.org>;
>
> 主题: Re: How to reduce kafka's rebalance time ?
>
>
>
> I am also facing the same issue. Whenever I am restarting my consumers it
> is taking upto 10 minutes to start consumption. Also some of the consumers
> randomly rebalance and it again takes same amount of time to complete
> rebalance.
> I haven't been able to figure out any solution for this issue, nor have I
> received any help from here.
>
> On Thu, Aug 16, 2018 at 9:56 AM 堅強de泡沫 <je...@qq.com> wrote:
>
> > hello:
> > How to reduce kafka's rebalance time ?
> > It takes a lot of time to rebalance each time. Why?