You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jun Rao <ju...@confluent.io> on 2017/11/06 17:24:39 UTC
[ANNOUNCE] New committer: Onur Karaman
Hi, everyone,
The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
Karaman.
Onur's most significant work is the improvement of Kafka controller, which
is the brain of a Kafka cluster. Over time, we have accumulated quite a few
correctness and performance issues in the controller. There have been
attempts to fix controller issues in isolation, which would make the code
base more complicated without a clear path of solving all problems. Onur is
the one who took a holistic approach, by first documenting all known
issues, writing down a new design, coming up with a plan to deliver the
changes in phases and executing on it. At this point, Onur has completed
the two most important phases: making the controller single threaded and
changing the controller to use the async ZK api. The former fixed multiple
deadlocks and race conditions. The latter significantly improved the
performance when there are many partitions. Experimental results show that
Onur's work reduced the controlled shutdown time by a factor of 100 times
and the controller failover time by a factor of 3 times.
Congratulations, Onur!
Thanks,
Jun (on behalf of the Apache Kafka PMC)
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Ismael Juma <is...@juma.me.uk>.
Congratulations Onur!
Ismael
On Mon, Nov 6, 2017 at 5:24 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Jason Gustafson <ja...@confluent.io>.
Sorry for being late to the party, but congratulations Onur!
On Wed, Nov 8, 2017 at 1:47 AM, Sandeep Nemuri <nh...@gmail.com> wrote:
> Congratulations Onur!!
>
> On Wed, Nov 8, 2017 at 9:19 AM, UMESH CHAUDHARY <um...@gmail.com>
> wrote:
>
> > Congratulations Onur!
> >
> > On Tue, 7 Nov 2017 at 21:44 Jun Rao <ju...@confluent.io> wrote:
> >
> > > Affan,
> > >
> > > All known problems in the controller are described in the doc linked
> from
> > > https://issues.apache.org/jira/browse/KAFKA-5027.
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > > On Mon, Nov 6, 2017 at 11:00 PM, Affan Syed <as...@an10.io> wrote:
> > >
> > > > Congrats Onur,
> > > >
> > > > Can you also share the document where all known problems are listed;
> I
> > am
> > > > assuming these bugs are still valid for the current stable release.
> > > >
> > > > Affan
> > > >
> > > > - Affan
> > > >
> > > > On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
> > > >
> > > > > Hi, everyone,
> > > > >
> > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> committer
> > > Onur
> > > > > Karaman.
> > > > >
> > > > > Onur's most significant work is the improvement of Kafka
> controller,
> > > > which
> > > > > is the brain of a Kafka cluster. Over time, we have accumulated
> > quite a
> > > > few
> > > > > correctness and performance issues in the controller. There have
> been
> > > > > attempts to fix controller issues in isolation, which would make
> the
> > > code
> > > > > base more complicated without a clear path of solving all problems.
> > > Onur
> > > > is
> > > > > the one who took a holistic approach, by first documenting all
> known
> > > > > issues, writing down a new design, coming up with a plan to deliver
> > the
> > > > > changes in phases and executing on it. At this point, Onur has
> > > completed
> > > > > the two most important phases: making the controller single
> threaded
> > > and
> > > > > changing the controller to use the async ZK api. The former fixed
> > > > multiple
> > > > > deadlocks and race conditions. The latter significantly improved
> the
> > > > > performance when there are many partitions. Experimental results
> show
> > > > that
> > > > > Onur's work reduced the controlled shutdown time by a factor of 100
> > > times
> > > > > and the controller failover time by a factor of 3 times.
> > > > >
> > > > > Congratulations, Onur!
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Jun (on behalf of the Apache Kafka PMC)
> > > > >
> > > >
> > >
> >
>
>
>
> --
> * Regards*
> * Sandeep Nemuri*
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Jason Gustafson <ja...@confluent.io>.
Sorry for being late to the party, but congratulations Onur!
On Wed, Nov 8, 2017 at 1:47 AM, Sandeep Nemuri <nh...@gmail.com> wrote:
> Congratulations Onur!!
>
> On Wed, Nov 8, 2017 at 9:19 AM, UMESH CHAUDHARY <um...@gmail.com>
> wrote:
>
> > Congratulations Onur!
> >
> > On Tue, 7 Nov 2017 at 21:44 Jun Rao <ju...@confluent.io> wrote:
> >
> > > Affan,
> > >
> > > All known problems in the controller are described in the doc linked
> from
> > > https://issues.apache.org/jira/browse/KAFKA-5027.
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > > On Mon, Nov 6, 2017 at 11:00 PM, Affan Syed <as...@an10.io> wrote:
> > >
> > > > Congrats Onur,
> > > >
> > > > Can you also share the document where all known problems are listed;
> I
> > am
> > > > assuming these bugs are still valid for the current stable release.
> > > >
> > > > Affan
> > > >
> > > > - Affan
> > > >
> > > > On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
> > > >
> > > > > Hi, everyone,
> > > > >
> > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> committer
> > > Onur
> > > > > Karaman.
> > > > >
> > > > > Onur's most significant work is the improvement of Kafka
> controller,
> > > > which
> > > > > is the brain of a Kafka cluster. Over time, we have accumulated
> > quite a
> > > > few
> > > > > correctness and performance issues in the controller. There have
> been
> > > > > attempts to fix controller issues in isolation, which would make
> the
> > > code
> > > > > base more complicated without a clear path of solving all problems.
> > > Onur
> > > > is
> > > > > the one who took a holistic approach, by first documenting all
> known
> > > > > issues, writing down a new design, coming up with a plan to deliver
> > the
> > > > > changes in phases and executing on it. At this point, Onur has
> > > completed
> > > > > the two most important phases: making the controller single
> threaded
> > > and
> > > > > changing the controller to use the async ZK api. The former fixed
> > > > multiple
> > > > > deadlocks and race conditions. The latter significantly improved
> the
> > > > > performance when there are many partitions. Experimental results
> show
> > > > that
> > > > > Onur's work reduced the controlled shutdown time by a factor of 100
> > > times
> > > > > and the controller failover time by a factor of 3 times.
> > > > >
> > > > > Congratulations, Onur!
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Jun (on behalf of the Apache Kafka PMC)
> > > > >
> > > >
> > >
> >
>
>
>
> --
> * Regards*
> * Sandeep Nemuri*
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Sandeep Nemuri <nh...@gmail.com>.
Congratulations Onur!!
On Wed, Nov 8, 2017 at 9:19 AM, UMESH CHAUDHARY <um...@gmail.com> wrote:
> Congratulations Onur!
>
> On Tue, 7 Nov 2017 at 21:44 Jun Rao <ju...@confluent.io> wrote:
>
> > Affan,
> >
> > All known problems in the controller are described in the doc linked from
> > https://issues.apache.org/jira/browse/KAFKA-5027.
> >
> > Thanks,
> >
> > Jun
> >
> > On Mon, Nov 6, 2017 at 11:00 PM, Affan Syed <as...@an10.io> wrote:
> >
> > > Congrats Onur,
> > >
> > > Can you also share the document where all known problems are listed; I
> am
> > > assuming these bugs are still valid for the current stable release.
> > >
> > > Affan
> > >
> > > - Affan
> > >
> > > On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
> > >
> > > > Hi, everyone,
> > > >
> > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > Onur
> > > > Karaman.
> > > >
> > > > Onur's most significant work is the improvement of Kafka controller,
> > > which
> > > > is the brain of a Kafka cluster. Over time, we have accumulated
> quite a
> > > few
> > > > correctness and performance issues in the controller. There have been
> > > > attempts to fix controller issues in isolation, which would make the
> > code
> > > > base more complicated without a clear path of solving all problems.
> > Onur
> > > is
> > > > the one who took a holistic approach, by first documenting all known
> > > > issues, writing down a new design, coming up with a plan to deliver
> the
> > > > changes in phases and executing on it. At this point, Onur has
> > completed
> > > > the two most important phases: making the controller single threaded
> > and
> > > > changing the controller to use the async ZK api. The former fixed
> > > multiple
> > > > deadlocks and race conditions. The latter significantly improved the
> > > > performance when there are many partitions. Experimental results show
> > > that
> > > > Onur's work reduced the controlled shutdown time by a factor of 100
> > times
> > > > and the controller failover time by a factor of 3 times.
> > > >
> > > > Congratulations, Onur!
> > > >
> > > > Thanks,
> > > >
> > > > Jun (on behalf of the Apache Kafka PMC)
> > > >
> > >
> >
>
--
* Regards*
* Sandeep Nemuri*
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Sandeep Nemuri <nh...@gmail.com>.
Congratulations Onur!!
On Wed, Nov 8, 2017 at 9:19 AM, UMESH CHAUDHARY <um...@gmail.com> wrote:
> Congratulations Onur!
>
> On Tue, 7 Nov 2017 at 21:44 Jun Rao <ju...@confluent.io> wrote:
>
> > Affan,
> >
> > All known problems in the controller are described in the doc linked from
> > https://issues.apache.org/jira/browse/KAFKA-5027.
> >
> > Thanks,
> >
> > Jun
> >
> > On Mon, Nov 6, 2017 at 11:00 PM, Affan Syed <as...@an10.io> wrote:
> >
> > > Congrats Onur,
> > >
> > > Can you also share the document where all known problems are listed; I
> am
> > > assuming these bugs are still valid for the current stable release.
> > >
> > > Affan
> > >
> > > - Affan
> > >
> > > On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
> > >
> > > > Hi, everyone,
> > > >
> > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > Onur
> > > > Karaman.
> > > >
> > > > Onur's most significant work is the improvement of Kafka controller,
> > > which
> > > > is the brain of a Kafka cluster. Over time, we have accumulated
> quite a
> > > few
> > > > correctness and performance issues in the controller. There have been
> > > > attempts to fix controller issues in isolation, which would make the
> > code
> > > > base more complicated without a clear path of solving all problems.
> > Onur
> > > is
> > > > the one who took a holistic approach, by first documenting all known
> > > > issues, writing down a new design, coming up with a plan to deliver
> the
> > > > changes in phases and executing on it. At this point, Onur has
> > completed
> > > > the two most important phases: making the controller single threaded
> > and
> > > > changing the controller to use the async ZK api. The former fixed
> > > multiple
> > > > deadlocks and race conditions. The latter significantly improved the
> > > > performance when there are many partitions. Experimental results show
> > > that
> > > > Onur's work reduced the controlled shutdown time by a factor of 100
> > times
> > > > and the controller failover time by a factor of 3 times.
> > > >
> > > > Congratulations, Onur!
> > > >
> > > > Thanks,
> > > >
> > > > Jun (on behalf of the Apache Kafka PMC)
> > > >
> > >
> >
>
--
* Regards*
* Sandeep Nemuri*
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by UMESH CHAUDHARY <um...@gmail.com>.
Congratulations Onur!
On Tue, 7 Nov 2017 at 21:44 Jun Rao <ju...@confluent.io> wrote:
> Affan,
>
> All known problems in the controller are described in the doc linked from
> https://issues.apache.org/jira/browse/KAFKA-5027.
>
> Thanks,
>
> Jun
>
> On Mon, Nov 6, 2017 at 11:00 PM, Affan Syed <as...@an10.io> wrote:
>
> > Congrats Onur,
> >
> > Can you also share the document where all known problems are listed; I am
> > assuming these bugs are still valid for the current stable release.
> >
> > Affan
> >
> > - Affan
> >
> > On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
> >
> > > Hi, everyone,
> > >
> > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Onur
> > > Karaman.
> > >
> > > Onur's most significant work is the improvement of Kafka controller,
> > which
> > > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> > few
> > > correctness and performance issues in the controller. There have been
> > > attempts to fix controller issues in isolation, which would make the
> code
> > > base more complicated without a clear path of solving all problems.
> Onur
> > is
> > > the one who took a holistic approach, by first documenting all known
> > > issues, writing down a new design, coming up with a plan to deliver the
> > > changes in phases and executing on it. At this point, Onur has
> completed
> > > the two most important phases: making the controller single threaded
> and
> > > changing the controller to use the async ZK api. The former fixed
> > multiple
> > > deadlocks and race conditions. The latter significantly improved the
> > > performance when there are many partitions. Experimental results show
> > that
> > > Onur's work reduced the controlled shutdown time by a factor of 100
> times
> > > and the controller failover time by a factor of 3 times.
> > >
> > > Congratulations, Onur!
> > >
> > > Thanks,
> > >
> > > Jun (on behalf of the Apache Kafka PMC)
> > >
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by UMESH CHAUDHARY <um...@gmail.com>.
Congratulations Onur!
On Tue, 7 Nov 2017 at 21:44 Jun Rao <ju...@confluent.io> wrote:
> Affan,
>
> All known problems in the controller are described in the doc linked from
> https://issues.apache.org/jira/browse/KAFKA-5027.
>
> Thanks,
>
> Jun
>
> On Mon, Nov 6, 2017 at 11:00 PM, Affan Syed <as...@an10.io> wrote:
>
> > Congrats Onur,
> >
> > Can you also share the document where all known problems are listed; I am
> > assuming these bugs are still valid for the current stable release.
> >
> > Affan
> >
> > - Affan
> >
> > On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
> >
> > > Hi, everyone,
> > >
> > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Onur
> > > Karaman.
> > >
> > > Onur's most significant work is the improvement of Kafka controller,
> > which
> > > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> > few
> > > correctness and performance issues in the controller. There have been
> > > attempts to fix controller issues in isolation, which would make the
> code
> > > base more complicated without a clear path of solving all problems.
> Onur
> > is
> > > the one who took a holistic approach, by first documenting all known
> > > issues, writing down a new design, coming up with a plan to deliver the
> > > changes in phases and executing on it. At this point, Onur has
> completed
> > > the two most important phases: making the controller single threaded
> and
> > > changing the controller to use the async ZK api. The former fixed
> > multiple
> > > deadlocks and race conditions. The latter significantly improved the
> > > performance when there are many partitions. Experimental results show
> > that
> > > Onur's work reduced the controlled shutdown time by a factor of 100
> times
> > > and the controller failover time by a factor of 3 times.
> > >
> > > Congratulations, Onur!
> > >
> > > Thanks,
> > >
> > > Jun (on behalf of the Apache Kafka PMC)
> > >
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Jun Rao <ju...@confluent.io>.
Affan,
All known problems in the controller are described in the doc linked from
https://issues.apache.org/jira/browse/KAFKA-5027.
Thanks,
Jun
On Mon, Nov 6, 2017 at 11:00 PM, Affan Syed <as...@an10.io> wrote:
> Congrats Onur,
>
> Can you also share the document where all known problems are listed; I am
> assuming these bugs are still valid for the current stable release.
>
> Affan
>
> - Affan
>
> On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
>
> > Hi, everyone,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> > Karaman.
> >
> > Onur's most significant work is the improvement of Kafka controller,
> which
> > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
> > correctness and performance issues in the controller. There have been
> > attempts to fix controller issues in isolation, which would make the code
> > base more complicated without a clear path of solving all problems. Onur
> is
> > the one who took a holistic approach, by first documenting all known
> > issues, writing down a new design, coming up with a plan to deliver the
> > changes in phases and executing on it. At this point, Onur has completed
> > the two most important phases: making the controller single threaded and
> > changing the controller to use the async ZK api. The former fixed
> multiple
> > deadlocks and race conditions. The latter significantly improved the
> > performance when there are many partitions. Experimental results show
> that
> > Onur's work reduced the controlled shutdown time by a factor of 100 times
> > and the controller failover time by a factor of 3 times.
> >
> > Congratulations, Onur!
> >
> > Thanks,
> >
> > Jun (on behalf of the Apache Kafka PMC)
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Jun Rao <ju...@confluent.io>.
Affan,
All known problems in the controller are described in the doc linked from
https://issues.apache.org/jira/browse/KAFKA-5027.
Thanks,
Jun
On Mon, Nov 6, 2017 at 11:00 PM, Affan Syed <as...@an10.io> wrote:
> Congrats Onur,
>
> Can you also share the document where all known problems are listed; I am
> assuming these bugs are still valid for the current stable release.
>
> Affan
>
> - Affan
>
> On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
>
> > Hi, everyone,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> > Karaman.
> >
> > Onur's most significant work is the improvement of Kafka controller,
> which
> > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
> > correctness and performance issues in the controller. There have been
> > attempts to fix controller issues in isolation, which would make the code
> > base more complicated without a clear path of solving all problems. Onur
> is
> > the one who took a holistic approach, by first documenting all known
> > issues, writing down a new design, coming up with a plan to deliver the
> > changes in phases and executing on it. At this point, Onur has completed
> > the two most important phases: making the controller single threaded and
> > changing the controller to use the async ZK api. The former fixed
> multiple
> > deadlocks and race conditions. The latter significantly improved the
> > performance when there are many partitions. Experimental results show
> that
> > Onur's work reduced the controlled shutdown time by a factor of 100 times
> > and the controller failover time by a factor of 3 times.
> >
> > Congratulations, Onur!
> >
> > Thanks,
> >
> > Jun (on behalf of the Apache Kafka PMC)
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Affan Syed <as...@an10.io>.
Congrats Onur,
Can you also share the document where all known problems are listed; I am
assuming these bugs are still valid for the current stable release.
Affan
- Affan
On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Ismael Juma <is...@juma.me.uk>.
Congratulations Onur!
Ismael
On Mon, Nov 6, 2017 at 5:24 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Onur Karaman <on...@gmail.com>.
Thanks everyone!
On Mon, Nov 6, 2017 at 3:31 PM, Becket Qin <be...@gmail.com> wrote:
> Congrats, Onur!
>
> On Mon, Nov 6, 2017 at 2:45 PM, James Cheng <wu...@gmail.com> wrote:
>
> > Congrats Onur! Well deserved!
> >
> > -James
> >
> > > On Nov 6, 2017, at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
> > >
> > > Hi, everyone,
> > >
> > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Onur
> > > Karaman.
> > >
> > > Onur's most significant work is the improvement of Kafka controller,
> > which
> > > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> > few
> > > correctness and performance issues in the controller. There have been
> > > attempts to fix controller issues in isolation, which would make the
> code
> > > base more complicated without a clear path of solving all problems.
> Onur
> > is
> > > the one who took a holistic approach, by first documenting all known
> > > issues, writing down a new design, coming up with a plan to deliver the
> > > changes in phases and executing on it. At this point, Onur has
> completed
> > > the two most important phases: making the controller single threaded
> and
> > > changing the controller to use the async ZK api. The former fixed
> > multiple
> > > deadlocks and race conditions. The latter significantly improved the
> > > performance when there are many partitions. Experimental results show
> > that
> > > Onur's work reduced the controlled shutdown time by a factor of 100
> times
> > > and the controller failover time by a factor of 3 times.
> > >
> > > Congratulations, Onur!
> > >
> > > Thanks,
> > >
> > > Jun (on behalf of the Apache Kafka PMC)
> >
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Onur Karaman <on...@gmail.com>.
Thanks everyone!
On Mon, Nov 6, 2017 at 3:31 PM, Becket Qin <be...@gmail.com> wrote:
> Congrats, Onur!
>
> On Mon, Nov 6, 2017 at 2:45 PM, James Cheng <wu...@gmail.com> wrote:
>
> > Congrats Onur! Well deserved!
> >
> > -James
> >
> > > On Nov 6, 2017, at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
> > >
> > > Hi, everyone,
> > >
> > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Onur
> > > Karaman.
> > >
> > > Onur's most significant work is the improvement of Kafka controller,
> > which
> > > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> > few
> > > correctness and performance issues in the controller. There have been
> > > attempts to fix controller issues in isolation, which would make the
> code
> > > base more complicated without a clear path of solving all problems.
> Onur
> > is
> > > the one who took a holistic approach, by first documenting all known
> > > issues, writing down a new design, coming up with a plan to deliver the
> > > changes in phases and executing on it. At this point, Onur has
> completed
> > > the two most important phases: making the controller single threaded
> and
> > > changing the controller to use the async ZK api. The former fixed
> > multiple
> > > deadlocks and race conditions. The latter significantly improved the
> > > performance when there are many partitions. Experimental results show
> > that
> > > Onur's work reduced the controlled shutdown time by a factor of 100
> times
> > > and the controller failover time by a factor of 3 times.
> > >
> > > Congratulations, Onur!
> > >
> > > Thanks,
> > >
> > > Jun (on behalf of the Apache Kafka PMC)
> >
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Becket Qin <be...@gmail.com>.
Congrats, Onur!
On Mon, Nov 6, 2017 at 2:45 PM, James Cheng <wu...@gmail.com> wrote:
> Congrats Onur! Well deserved!
>
> -James
>
> > On Nov 6, 2017, at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
> >
> > Hi, everyone,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> > Karaman.
> >
> > Onur's most significant work is the improvement of Kafka controller,
> which
> > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
> > correctness and performance issues in the controller. There have been
> > attempts to fix controller issues in isolation, which would make the code
> > base more complicated without a clear path of solving all problems. Onur
> is
> > the one who took a holistic approach, by first documenting all known
> > issues, writing down a new design, coming up with a plan to deliver the
> > changes in phases and executing on it. At this point, Onur has completed
> > the two most important phases: making the controller single threaded and
> > changing the controller to use the async ZK api. The former fixed
> multiple
> > deadlocks and race conditions. The latter significantly improved the
> > performance when there are many partitions. Experimental results show
> that
> > Onur's work reduced the controlled shutdown time by a factor of 100 times
> > and the controller failover time by a factor of 3 times.
> >
> > Congratulations, Onur!
> >
> > Thanks,
> >
> > Jun (on behalf of the Apache Kafka PMC)
>
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Becket Qin <be...@gmail.com>.
Congrats, Onur!
On Mon, Nov 6, 2017 at 2:45 PM, James Cheng <wu...@gmail.com> wrote:
> Congrats Onur! Well deserved!
>
> -James
>
> > On Nov 6, 2017, at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
> >
> > Hi, everyone,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> > Karaman.
> >
> > Onur's most significant work is the improvement of Kafka controller,
> which
> > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
> > correctness and performance issues in the controller. There have been
> > attempts to fix controller issues in isolation, which would make the code
> > base more complicated without a clear path of solving all problems. Onur
> is
> > the one who took a holistic approach, by first documenting all known
> > issues, writing down a new design, coming up with a plan to deliver the
> > changes in phases and executing on it. At this point, Onur has completed
> > the two most important phases: making the controller single threaded and
> > changing the controller to use the async ZK api. The former fixed
> multiple
> > deadlocks and race conditions. The latter significantly improved the
> > performance when there are many partitions. Experimental results show
> that
> > Onur's work reduced the controlled shutdown time by a factor of 100 times
> > and the controller failover time by a factor of 3 times.
> >
> > Congratulations, Onur!
> >
> > Thanks,
> >
> > Jun (on behalf of the Apache Kafka PMC)
>
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by James Cheng <wu...@gmail.com>.
Congrats Onur! Well deserved!
-James
> On Nov 6, 2017, at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
>
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Rajini Sivaram <ra...@gmail.com>.
Congratulations, Onur!
On Mon, Nov 6, 2017 at 8:10 PM, Dong Lin <li...@gmail.com> wrote:
> Congratulations Onur!
>
> On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
>
> > Hi, everyone,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> > Karaman.
> >
> > Onur's most significant work is the improvement of Kafka controller,
> which
> > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
> > correctness and performance issues in the controller. There have been
> > attempts to fix controller issues in isolation, which would make the code
> > base more complicated without a clear path of solving all problems. Onur
> is
> > the one who took a holistic approach, by first documenting all known
> > issues, writing down a new design, coming up with a plan to deliver the
> > changes in phases and executing on it. At this point, Onur has completed
> > the two most important phases: making the controller single threaded and
> > changing the controller to use the async ZK api. The former fixed
> multiple
> > deadlocks and race conditions. The latter significantly improved the
> > performance when there are many partitions. Experimental results show
> that
> > Onur's work reduced the controlled shutdown time by a factor of 100 times
> > and the controller failover time by a factor of 3 times.
> >
> > Congratulations, Onur!
> >
> > Thanks,
> >
> > Jun (on behalf of the Apache Kafka PMC)
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Rajini Sivaram <ra...@gmail.com>.
Congratulations, Onur!
On Mon, Nov 6, 2017 at 8:10 PM, Dong Lin <li...@gmail.com> wrote:
> Congratulations Onur!
>
> On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
>
> > Hi, everyone,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> > Karaman.
> >
> > Onur's most significant work is the improvement of Kafka controller,
> which
> > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
> > correctness and performance issues in the controller. There have been
> > attempts to fix controller issues in isolation, which would make the code
> > base more complicated without a clear path of solving all problems. Onur
> is
> > the one who took a holistic approach, by first documenting all known
> > issues, writing down a new design, coming up with a plan to deliver the
> > changes in phases and executing on it. At this point, Onur has completed
> > the two most important phases: making the controller single threaded and
> > changing the controller to use the async ZK api. The former fixed
> multiple
> > deadlocks and race conditions. The latter significantly improved the
> > performance when there are many partitions. Experimental results show
> that
> > Onur's work reduced the controlled shutdown time by a factor of 100 times
> > and the controller failover time by a factor of 3 times.
> >
> > Congratulations, Onur!
> >
> > Thanks,
> >
> > Jun (on behalf of the Apache Kafka PMC)
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Dong Lin <li...@gmail.com>.
Congratulations Onur!
On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by James Cheng <wu...@gmail.com>.
Congrats Onur! Well deserved!
-James
> On Nov 6, 2017, at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
>
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Dong Lin <li...@gmail.com>.
Congratulations Onur!
On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Abhishek Mendhekar <ab...@gmail.com>.
Congrats Onur!
On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
--
Abhishek Mendhekar
abhishek.mendhekar@gmail.com | 818.263.7030
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Paolo Patierno <pp...@live.com>.
Congrats Onur ! Well deserved !
Paolo Patierno
Senior Software Engineer (IoT) @ Red Hat
Microsoft MVP on Azure & IoT
Microsoft Azure Advisor
Twitter : @ppatierno<http://twitter.com/ppatierno>
Linkedin : paolopatierno<http://it.linkedin.com/in/paolopatierno>
Blog : DevExperience<http://paolopatierno.wordpress.com/>
________________________________
From: Viktor Somogyi <vi...@gmail.com>
Sent: Tuesday, November 7, 2017 11:34 AM
To: dev@kafka.apache.org
Subject: Re: [ANNOUNCE] New committer: Onur Karaman
Congrats Onur!
On Tue, Nov 7, 2017 at 9:17 AM, Tom Bentley <t....@gmail.com> wrote:
> Well done Onur.
>
> On 7 November 2017 at 06:52, Jorge Esteban Quilcate Otoya <
> quilcate.jorge@gmail.com> wrote:
>
> > Congratulations Onur!!
> > On Tue, 7 Nov 2017 at 06:30, Jaikiran Pai <ja...@gmail.com>
> > wrote:
> >
> > > Congratulations Onur!
> > >
> > > -Jaikiran
> > >
> > >
> > > On 06/11/17 10:54 PM, Jun Rao wrote:
> > > > Hi, everyone,
> > > >
> > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > Onur
> > > > Karaman.
> > > >
> > > > Onur's most significant work is the improvement of Kafka controller,
> > > which
> > > > is the brain of a Kafka cluster. Over time, we have accumulated
> quite a
> > > few
> > > > correctness and performance issues in the controller. There have been
> > > > attempts to fix controller issues in isolation, which would make the
> > code
> > > > base more complicated without a clear path of solving all problems.
> > Onur
> > > is
> > > > the one who took a holistic approach, by first documenting all known
> > > > issues, writing down a new design, coming up with a plan to deliver
> the
> > > > changes in phases and executing on it. At this point, Onur has
> > completed
> > > > the two most important phases: making the controller single threaded
> > and
> > > > changing the controller to use the async ZK api. The former fixed
> > > multiple
> > > > deadlocks and race conditions. The latter significantly improved the
> > > > performance when there are many partitions. Experimental results show
> > > that
> > > > Onur's work reduced the controlled shutdown time by a factor of 100
> > times
> > > > and the controller failover time by a factor of 3 times.
> > > >
> > > > Congratulations, Onur!
> > > >
> > > > Thanks,
> > > >
> > > > Jun (on behalf of the Apache Kafka PMC)
> > > >
> > >
> > >
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Viktor Somogyi <vi...@gmail.com>.
Congrats Onur!
On Tue, Nov 7, 2017 at 9:17 AM, Tom Bentley <t....@gmail.com> wrote:
> Well done Onur.
>
> On 7 November 2017 at 06:52, Jorge Esteban Quilcate Otoya <
> quilcate.jorge@gmail.com> wrote:
>
> > Congratulations Onur!!
> > On Tue, 7 Nov 2017 at 06:30, Jaikiran Pai <ja...@gmail.com>
> > wrote:
> >
> > > Congratulations Onur!
> > >
> > > -Jaikiran
> > >
> > >
> > > On 06/11/17 10:54 PM, Jun Rao wrote:
> > > > Hi, everyone,
> > > >
> > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > Onur
> > > > Karaman.
> > > >
> > > > Onur's most significant work is the improvement of Kafka controller,
> > > which
> > > > is the brain of a Kafka cluster. Over time, we have accumulated
> quite a
> > > few
> > > > correctness and performance issues in the controller. There have been
> > > > attempts to fix controller issues in isolation, which would make the
> > code
> > > > base more complicated without a clear path of solving all problems.
> > Onur
> > > is
> > > > the one who took a holistic approach, by first documenting all known
> > > > issues, writing down a new design, coming up with a plan to deliver
> the
> > > > changes in phases and executing on it. At this point, Onur has
> > completed
> > > > the two most important phases: making the controller single threaded
> > and
> > > > changing the controller to use the async ZK api. The former fixed
> > > multiple
> > > > deadlocks and race conditions. The latter significantly improved the
> > > > performance when there are many partitions. Experimental results show
> > > that
> > > > Onur's work reduced the controlled shutdown time by a factor of 100
> > times
> > > > and the controller failover time by a factor of 3 times.
> > > >
> > > > Congratulations, Onur!
> > > >
> > > > Thanks,
> > > >
> > > > Jun (on behalf of the Apache Kafka PMC)
> > > >
> > >
> > >
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Tom Bentley <t....@gmail.com>.
Well done Onur.
On 7 November 2017 at 06:52, Jorge Esteban Quilcate Otoya <
quilcate.jorge@gmail.com> wrote:
> Congratulations Onur!!
> On Tue, 7 Nov 2017 at 06:30, Jaikiran Pai <ja...@gmail.com>
> wrote:
>
> > Congratulations Onur!
> >
> > -Jaikiran
> >
> >
> > On 06/11/17 10:54 PM, Jun Rao wrote:
> > > Hi, everyone,
> > >
> > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Onur
> > > Karaman.
> > >
> > > Onur's most significant work is the improvement of Kafka controller,
> > which
> > > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> > few
> > > correctness and performance issues in the controller. There have been
> > > attempts to fix controller issues in isolation, which would make the
> code
> > > base more complicated without a clear path of solving all problems.
> Onur
> > is
> > > the one who took a holistic approach, by first documenting all known
> > > issues, writing down a new design, coming up with a plan to deliver the
> > > changes in phases and executing on it. At this point, Onur has
> completed
> > > the two most important phases: making the controller single threaded
> and
> > > changing the controller to use the async ZK api. The former fixed
> > multiple
> > > deadlocks and race conditions. The latter significantly improved the
> > > performance when there are many partitions. Experimental results show
> > that
> > > Onur's work reduced the controlled shutdown time by a factor of 100
> times
> > > and the controller failover time by a factor of 3 times.
> > >
> > > Congratulations, Onur!
> > >
> > > Thanks,
> > >
> > > Jun (on behalf of the Apache Kafka PMC)
> > >
> >
> >
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Jorge Esteban Quilcate Otoya <qu...@gmail.com>.
Congratulations Onur!!
On Tue, 7 Nov 2017 at 06:30, Jaikiran Pai <ja...@gmail.com> wrote:
> Congratulations Onur!
>
> -Jaikiran
>
>
> On 06/11/17 10:54 PM, Jun Rao wrote:
> > Hi, everyone,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> > Karaman.
> >
> > Onur's most significant work is the improvement of Kafka controller,
> which
> > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
> > correctness and performance issues in the controller. There have been
> > attempts to fix controller issues in isolation, which would make the code
> > base more complicated without a clear path of solving all problems. Onur
> is
> > the one who took a holistic approach, by first documenting all known
> > issues, writing down a new design, coming up with a plan to deliver the
> > changes in phases and executing on it. At this point, Onur has completed
> > the two most important phases: making the controller single threaded and
> > changing the controller to use the async ZK api. The former fixed
> multiple
> > deadlocks and race conditions. The latter significantly improved the
> > performance when there are many partitions. Experimental results show
> that
> > Onur's work reduced the controlled shutdown time by a factor of 100 times
> > and the controller failover time by a factor of 3 times.
> >
> > Congratulations, Onur!
> >
> > Thanks,
> >
> > Jun (on behalf of the Apache Kafka PMC)
> >
>
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Jaikiran Pai <ja...@gmail.com>.
Congratulations Onur!
-Jaikiran
On 06/11/17 10:54 PM, Jun Rao wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Guozhang Wang <wa...@gmail.com>.
I'd want to add that Onur has also been contributing a lot to the new
consumer development in the past, making it happen in the 0.9 release.
Very well deserved. Congrats, Onur!
Guozhang
On Mon, Nov 6, 2017 at 9:28 AM, Ted Yu <yu...@gmail.com> wrote:
> Congratulations, Onur!
>
> On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
>
> > Hi, everyone,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> > Karaman.
> >
> > Onur's most significant work is the improvement of Kafka controller,
> which
> > is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
> > correctness and performance issues in the controller. There have been
> > attempts to fix controller issues in isolation, which would make the code
> > base more complicated without a clear path of solving all problems. Onur
> is
> > the one who took a holistic approach, by first documenting all known
> > issues, writing down a new design, coming up with a plan to deliver the
> > changes in phases and executing on it. At this point, Onur has completed
> > the two most important phases: making the controller single threaded and
> > changing the controller to use the async ZK api. The former fixed
> multiple
> > deadlocks and race conditions. The latter significantly improved the
> > performance when there are many partitions. Experimental results show
> that
> > Onur's work reduced the controlled shutdown time by a factor of 100 times
> > and the controller failover time by a factor of 3 times.
> >
> > Congratulations, Onur!
> >
> > Thanks,
> >
> > Jun (on behalf of the Apache Kafka PMC)
> >
>
--
-- Guozhang
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Ted Yu <yu...@gmail.com>.
Congratulations, Onur!
On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Affan Syed <as...@an10.io>.
Congrats Onur,
Can you also share the document where all known problems are listed; I am
assuming these bugs are still valid for the current stable release.
Affan
- Affan
On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Abhishek Mendhekar <ab...@gmail.com>.
Congrats Onur!
On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
--
Abhishek Mendhekar
abhishek.mendhekar@gmail.com | 818.263.7030
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Mickael Maison <mi...@gmail.com>.
Congratulations Onur !
On Mon, Nov 6, 2017 at 7:01 PM, Matthias J. Sax <ma...@confluent.io> wrote:
> Congrats!!!
>
>
> On 11/6/17 7:56 PM, Vahid S Hashemian wrote:
>> Congrats Onur!
>>
>> --Vahid
>>
>>
>>
>> From: Ismael Juma <is...@juma.me.uk>
>> To: dev@kafka.apache.org
>> Cc: "users@kafka.apache.org" <us...@kafka.apache.org>
>> Date: 11/06/2017 10:13 AM
>> Subject: Re: [ANNOUNCE] New committer: Onur Karaman
>> Sent by: ismaelj@gmail.com
>>
>>
>>
>> Congratulations Onur!
>>
>> Ismael
>>
>> On Mon, Nov 6, 2017 at 5:24 PM, Jun Rao <ju...@confluent.io> wrote:
>>
>>> Hi, everyone,
>>>
>>> The PMC of Apache Kafka is pleased to announce a new Kafka committer
>> Onur
>>> Karaman.
>>>
>>> Onur's most significant work is the improvement of Kafka controller,
>> which
>>> is the brain of a Kafka cluster. Over time, we have accumulated quite a
>> few
>>> correctness and performance issues in the controller. There have been
>>> attempts to fix controller issues in isolation, which would make the
>> code
>>> base more complicated without a clear path of solving all problems. Onur
>> is
>>> the one who took a holistic approach, by first documenting all known
>>> issues, writing down a new design, coming up with a plan to deliver the
>>> changes in phases and executing on it. At this point, Onur has completed
>>> the two most important phases: making the controller single threaded and
>>> changing the controller to use the async ZK api. The former fixed
>> multiple
>>> deadlocks and race conditions. The latter significantly improved the
>>> performance when there are many partitions. Experimental results show
>> that
>>> Onur's work reduced the controlled shutdown time by a factor of 100
>> times
>>> and the controller failover time by a factor of 3 times.
>>>
>>> Congratulations, Onur!
>>>
>>> Thanks,
>>>
>>> Jun (on behalf of the Apache Kafka PMC)
>>>
>>
>>
>>
>>
>>
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Mickael Maison <mi...@gmail.com>.
Congratulations Onur !
On Mon, Nov 6, 2017 at 7:01 PM, Matthias J. Sax <ma...@confluent.io> wrote:
> Congrats!!!
>
>
> On 11/6/17 7:56 PM, Vahid S Hashemian wrote:
>> Congrats Onur!
>>
>> --Vahid
>>
>>
>>
>> From: Ismael Juma <is...@juma.me.uk>
>> To: dev@kafka.apache.org
>> Cc: "users@kafka.apache.org" <us...@kafka.apache.org>
>> Date: 11/06/2017 10:13 AM
>> Subject: Re: [ANNOUNCE] New committer: Onur Karaman
>> Sent by: ismaelj@gmail.com
>>
>>
>>
>> Congratulations Onur!
>>
>> Ismael
>>
>> On Mon, Nov 6, 2017 at 5:24 PM, Jun Rao <ju...@confluent.io> wrote:
>>
>>> Hi, everyone,
>>>
>>> The PMC of Apache Kafka is pleased to announce a new Kafka committer
>> Onur
>>> Karaman.
>>>
>>> Onur's most significant work is the improvement of Kafka controller,
>> which
>>> is the brain of a Kafka cluster. Over time, we have accumulated quite a
>> few
>>> correctness and performance issues in the controller. There have been
>>> attempts to fix controller issues in isolation, which would make the
>> code
>>> base more complicated without a clear path of solving all problems. Onur
>> is
>>> the one who took a holistic approach, by first documenting all known
>>> issues, writing down a new design, coming up with a plan to deliver the
>>> changes in phases and executing on it. At this point, Onur has completed
>>> the two most important phases: making the controller single threaded and
>>> changing the controller to use the async ZK api. The former fixed
>> multiple
>>> deadlocks and race conditions. The latter significantly improved the
>>> performance when there are many partitions. Experimental results show
>> that
>>> Onur's work reduced the controlled shutdown time by a factor of 100
>> times
>>> and the controller failover time by a factor of 3 times.
>>>
>>> Congratulations, Onur!
>>>
>>> Thanks,
>>>
>>> Jun (on behalf of the Apache Kafka PMC)
>>>
>>
>>
>>
>>
>>
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by "Matthias J. Sax" <ma...@confluent.io>.
Congrats!!!
On 11/6/17 7:56 PM, Vahid S Hashemian wrote:
> Congrats Onur!
>
> --Vahid
>
>
>
> From: Ismael Juma <is...@juma.me.uk>
> To: dev@kafka.apache.org
> Cc: "users@kafka.apache.org" <us...@kafka.apache.org>
> Date: 11/06/2017 10:13 AM
> Subject: Re: [ANNOUNCE] New committer: Onur Karaman
> Sent by: ismaelj@gmail.com
>
>
>
> Congratulations Onur!
>
> Ismael
>
> On Mon, Nov 6, 2017 at 5:24 PM, Jun Rao <ju...@confluent.io> wrote:
>
>> Hi, everyone,
>>
>> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Onur
>> Karaman.
>>
>> Onur's most significant work is the improvement of Kafka controller,
> which
>> is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
>> correctness and performance issues in the controller. There have been
>> attempts to fix controller issues in isolation, which would make the
> code
>> base more complicated without a clear path of solving all problems. Onur
> is
>> the one who took a holistic approach, by first documenting all known
>> issues, writing down a new design, coming up with a plan to deliver the
>> changes in phases and executing on it. At this point, Onur has completed
>> the two most important phases: making the controller single threaded and
>> changing the controller to use the async ZK api. The former fixed
> multiple
>> deadlocks and race conditions. The latter significantly improved the
>> performance when there are many partitions. Experimental results show
> that
>> Onur's work reduced the controlled shutdown time by a factor of 100
> times
>> and the controller failover time by a factor of 3 times.
>>
>> Congratulations, Onur!
>>
>> Thanks,
>>
>> Jun (on behalf of the Apache Kafka PMC)
>>
>
>
>
>
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by "Matthias J. Sax" <ma...@confluent.io>.
Congrats!!!
On 11/6/17 7:56 PM, Vahid S Hashemian wrote:
> Congrats Onur!
>
> --Vahid
>
>
>
> From: Ismael Juma <is...@juma.me.uk>
> To: dev@kafka.apache.org
> Cc: "users@kafka.apache.org" <us...@kafka.apache.org>
> Date: 11/06/2017 10:13 AM
> Subject: Re: [ANNOUNCE] New committer: Onur Karaman
> Sent by: ismaelj@gmail.com
>
>
>
> Congratulations Onur!
>
> Ismael
>
> On Mon, Nov 6, 2017 at 5:24 PM, Jun Rao <ju...@confluent.io> wrote:
>
>> Hi, everyone,
>>
>> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Onur
>> Karaman.
>>
>> Onur's most significant work is the improvement of Kafka controller,
> which
>> is the brain of a Kafka cluster. Over time, we have accumulated quite a
> few
>> correctness and performance issues in the controller. There have been
>> attempts to fix controller issues in isolation, which would make the
> code
>> base more complicated without a clear path of solving all problems. Onur
> is
>> the one who took a holistic approach, by first documenting all known
>> issues, writing down a new design, coming up with a plan to deliver the
>> changes in phases and executing on it. At this point, Onur has completed
>> the two most important phases: making the controller single threaded and
>> changing the controller to use the async ZK api. The former fixed
> multiple
>> deadlocks and race conditions. The latter significantly improved the
>> performance when there are many partitions. Experimental results show
> that
>> Onur's work reduced the controlled shutdown time by a factor of 100
> times
>> and the controller failover time by a factor of 3 times.
>>
>> Congratulations, Onur!
>>
>> Thanks,
>>
>> Jun (on behalf of the Apache Kafka PMC)
>>
>
>
>
>
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Vahid S Hashemian <va...@us.ibm.com>.
Congrats Onur!
--Vahid
From: Ismael Juma <is...@juma.me.uk>
To: dev@kafka.apache.org
Cc: "users@kafka.apache.org" <us...@kafka.apache.org>
Date: 11/06/2017 10:13 AM
Subject: Re: [ANNOUNCE] New committer: Onur Karaman
Sent by: ismaelj@gmail.com
Congratulations Onur!
Ismael
On Mon, Nov 6, 2017 at 5:24 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer
Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller,
which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a
few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the
code
> base more complicated without a clear path of solving all problems. Onur
is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed
multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show
that
> Onur's work reduced the controlled shutdown time by a factor of 100
times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>
Re: [ANNOUNCE] New committer: Onur Karaman
Posted by Vahid S Hashemian <va...@us.ibm.com>.
Congrats Onur!
--Vahid
From: Ismael Juma <is...@juma.me.uk>
To: dev@kafka.apache.org
Cc: "users@kafka.apache.org" <us...@kafka.apache.org>
Date: 11/06/2017 10:13 AM
Subject: Re: [ANNOUNCE] New committer: Onur Karaman
Sent by: ismaelj@gmail.com
Congratulations Onur!
Ismael
On Mon, Nov 6, 2017 at 5:24 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, everyone,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer
Onur
> Karaman.
>
> Onur's most significant work is the improvement of Kafka controller,
which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a
few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the
code
> base more complicated without a clear path of solving all problems. Onur
is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed
multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show
that
> Onur's work reduced the controlled shutdown time by a factor of 100
times
> and the controller failover time by a factor of 3 times.
>
> Congratulations, Onur!
>
> Thanks,
>
> Jun (on behalf of the Apache Kafka PMC)
>