You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by Guozhang Wang <wa...@gmail.com> on 2019/08/05 21:36:23 UTC
Re: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol
Hello folks,
I've also updated the wiki page by making the augmented
`ConsumerPartitionAssignor` out as a public API in `o.a.k.clients.consumer`
and deprecate the old `PartitionAssignor` as in
`o.a.k.clients.consumer.internals`.
Guozhang
On Fri, Jun 28, 2019 at 11:30 AM Sophie Blee-Goldman <so...@confluent.io>
wrote:
> It is now! Also updated the KIP to reflect that we will be adding a new
> CooperativeStickyAssignor rather than making the existing StickyAssignor
> cooperative to prevent users who already use the StickyAssignor from
> blindly upgrading and hitting potential problems during a rolling bounce
>
> On Thu, Jun 27, 2019 at 8:15 PM Boyang Chen <re...@gmail.com>
> wrote:
>
> > Thank you Sophie for the update. Is this also reflected on the KIP?
> >
> > On Thu, Jun 27, 2019 at 3:28 PM Sophie Blee-Goldman <sophie@confluent.io
> >
> > wrote:
> >
> > > We would like to tack on some rebalance-related metrics as part of this
> > KIP
> > > as well. The details can be found in the sub-task JIRA:
> > > https://issues.apache.org/jira/browse/KAFKA-8609
> > >
> > > On Thu, May 30, 2019 at 5:09 PM Guozhang Wang <wa...@gmail.com>
> > wrote:
> > >
> > > > +1 (binding) from me as well.
> > > >
> > > > Thanks to everyone who have voted! I'm closing this vote thread with
> a
> > > > tally:
> > > >
> > > > binding +1: 3 (Guozhang, Harsha, Matthias)
> > > >
> > > > non-binding +1: 2 (Boyang, Liquan)
> > > >
> > > >
> > > > Guozhang
> > > >
> > > > On Wed, May 22, 2019 at 9:22 PM Matthias J. Sax <
> matthias@confluent.io
> > >
> > > > wrote:
> > > >
> > > > > +1 (binding)
> > > > >
> > > > >
> > > > > On 5/22/19 7:37 PM, Harsha wrote:
> > > > > > +1 (binding). Thanks for the KIP looking forward for this to be
> > > > avaiable
> > > > > in consumers.
> > > > > >
> > > > > > Thanks,
> > > > > > Harsha
> > > > > >
> > > > > > On Wed, May 22, 2019, at 12:24 AM, Liquan Pei wrote:
> > > > > >> +1 (non-binding)
> > > > > >>
> > > > > >> On Tue, May 21, 2019 at 11:34 PM Boyang Chen <
> bchen11@outlook.com
> > >
> > > > > wrote:
> > > > > >>
> > > > > >>> Thank you Guozhang for all the hard work.
> > > > > >>>
> > > > > >>> +1 (non-binding)
> > > > > >>>
> > > > > >>> ________________________________
> > > > > >>> From: Guozhang Wang <wa...@gmail.com>
> > > > > >>> Sent: Wednesday, May 22, 2019 1:32 AM
> > > > > >>> To: dev
> > > > > >>> Subject: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance
> > > > Protocol
> > > > > >>>
> > > > > >>> Hello folks,
> > > > > >>>
> > > > > >>> I'd like to start the voting for KIP-429 now, details can be
> > found
> > > > > here:
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-429%3A+Kafka+Consumer+Incremental+Rebalance+Protocol#KIP-429:KafkaConsumerIncrementalRebalanceProtocol-RebalanceCallbackErrorHandling
> > > > > >>>
> > > > > >>> And the on-going PRs available for review:
> > > > > >>>
> > > > > >>> Part I: https://github.com/apache/kafka/pull/6528
> > > > > >>> Part II: https://github.com/apache/kafka/pull/6778
> > > > > >>>
> > > > > >>>
> > > > > >>> Thanks
> > > > > >>> -- Guozhang
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >> --
> > > > > >> Liquan Pei
> > > > > >> Software Engineer, Confluent Inc
> > > > > >>
> > > > >
> > > > >
> > > >
> > > > --
> > > > -- Guozhang
> > > >
> > >
> >
>
--
-- Guozhang
Re: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol
Posted by Guozhang Wang <wa...@gmail.com>.
Hello folks,
One last update on the KIP: we've added a section with a list of newly
added metrics corresponding to consumer rebalance events as part of this
proposal as well, detailed list can be found here:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-429%3A+Kafka+Consumer+Incremental+Rebalance+Protocol#KIP-429:KafkaConsumerIncrementalRebalanceProtocol-ConsumerMetrics
Guozhang
On Mon, Aug 5, 2019 at 2:36 PM Guozhang Wang <wa...@gmail.com> wrote:
> Hello folks,
>
> I've also updated the wiki page by making the augmented
> `ConsumerPartitionAssignor` out as a public API in `o.a.k.clients.consumer`
> and deprecate the old `PartitionAssignor` as in
> `o.a.k.clients.consumer.internals`.
>
>
> Guozhang
>
> On Fri, Jun 28, 2019 at 11:30 AM Sophie Blee-Goldman <so...@confluent.io>
> wrote:
>
>> It is now! Also updated the KIP to reflect that we will be adding a new
>> CooperativeStickyAssignor rather than making the existing StickyAssignor
>> cooperative to prevent users who already use the StickyAssignor from
>> blindly upgrading and hitting potential problems during a rolling bounce
>>
>> On Thu, Jun 27, 2019 at 8:15 PM Boyang Chen <re...@gmail.com>
>> wrote:
>>
>> > Thank you Sophie for the update. Is this also reflected on the KIP?
>> >
>> > On Thu, Jun 27, 2019 at 3:28 PM Sophie Blee-Goldman <
>> sophie@confluent.io>
>> > wrote:
>> >
>> > > We would like to tack on some rebalance-related metrics as part of
>> this
>> > KIP
>> > > as well. The details can be found in the sub-task JIRA:
>> > > https://issues.apache.org/jira/browse/KAFKA-8609
>> > >
>> > > On Thu, May 30, 2019 at 5:09 PM Guozhang Wang <wa...@gmail.com>
>> > wrote:
>> > >
>> > > > +1 (binding) from me as well.
>> > > >
>> > > > Thanks to everyone who have voted! I'm closing this vote thread
>> with a
>> > > > tally:
>> > > >
>> > > > binding +1: 3 (Guozhang, Harsha, Matthias)
>> > > >
>> > > > non-binding +1: 2 (Boyang, Liquan)
>> > > >
>> > > >
>> > > > Guozhang
>> > > >
>> > > > On Wed, May 22, 2019 at 9:22 PM Matthias J. Sax <
>> matthias@confluent.io
>> > >
>> > > > wrote:
>> > > >
>> > > > > +1 (binding)
>> > > > >
>> > > > >
>> > > > > On 5/22/19 7:37 PM, Harsha wrote:
>> > > > > > +1 (binding). Thanks for the KIP looking forward for this to be
>> > > > avaiable
>> > > > > in consumers.
>> > > > > >
>> > > > > > Thanks,
>> > > > > > Harsha
>> > > > > >
>> > > > > > On Wed, May 22, 2019, at 12:24 AM, Liquan Pei wrote:
>> > > > > >> +1 (non-binding)
>> > > > > >>
>> > > > > >> On Tue, May 21, 2019 at 11:34 PM Boyang Chen <
>> bchen11@outlook.com
>> > >
>> > > > > wrote:
>> > > > > >>
>> > > > > >>> Thank you Guozhang for all the hard work.
>> > > > > >>>
>> > > > > >>> +1 (non-binding)
>> > > > > >>>
>> > > > > >>> ________________________________
>> > > > > >>> From: Guozhang Wang <wa...@gmail.com>
>> > > > > >>> Sent: Wednesday, May 22, 2019 1:32 AM
>> > > > > >>> To: dev
>> > > > > >>> Subject: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance
>> > > > Protocol
>> > > > > >>>
>> > > > > >>> Hello folks,
>> > > > > >>>
>> > > > > >>> I'd like to start the voting for KIP-429 now, details can be
>> > found
>> > > > > here:
>> > > > > >>>
>> > > > > >>>
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-429%3A+Kafka+Consumer+Incremental+Rebalance+Protocol#KIP-429:KafkaConsumerIncrementalRebalanceProtocol-RebalanceCallbackErrorHandling
>> > > > > >>>
>> > > > > >>> And the on-going PRs available for review:
>> > > > > >>>
>> > > > > >>> Part I: https://github.com/apache/kafka/pull/6528
>> > > > > >>> Part II: https://github.com/apache/kafka/pull/6778
>> > > > > >>>
>> > > > > >>>
>> > > > > >>> Thanks
>> > > > > >>> -- Guozhang
>> > > > > >>>
>> > > > > >>
>> > > > > >>
>> > > > > >> --
>> > > > > >> Liquan Pei
>> > > > > >> Software Engineer, Confluent Inc
>> > > > > >>
>> > > > >
>> > > > >
>> > > >
>> > > > --
>> > > > -- Guozhang
>> > > >
>> > >
>> >
>>
>
>
> --
> -- Guozhang
>
--
-- Guozhang