You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jun Rao <ju...@confluent.io> on 2015/10/12 22:31:27 UTC
Kafka 0.9.0 release branch
Hi, Everyone,
As we are getting closer to the 0.9.0 release, we plan to cut an 0.9.0
release branch in about two weeks from now. In the meantime, we will try to
resolve most if not all 0.9.0 blockers listed below.
https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22)%20AND%20priority%20%3D%20Blocker%20AND%20fixVersion%20%3D%200.9.0.0%20ORDER%20BY%20updated%20DESC
Are there any concerns? We will also discuss the 0.9.0 release in
tomorrow's KIP meeting.
Thanks,
Jun
Re: [kafka-clients] Kafka 0.9.0 release branch
Posted by Ewen Cheslack-Postava <ew...@confluent.io>.
Not sure if I'd call it a blocker, but if we can get it in I would *really*
like to see some solution to
https://issues.apache.org/jira/browse/KAFKA-2397 committed. Without an
explicit leave group, even normal operation of groups can leave some
partitions unprocessed for 30-60s at a time under *normal* circumstances
like a graceful shutdown/restart. It might be manageable, but that's a
pretty large availability gap...
Not that the length of tests is critical, but this is also very obvious in
system tests. The copycat tests take about 50% longer than they should
because they have to wait for the session timeout.
-Ewen
On Mon, Oct 12, 2015 at 1:31 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, Everyone,
>
> As we are getting closer to the 0.9.0 release, we plan to cut an 0.9.0
> release branch in about two weeks from now. In the meantime, we will try to
> resolve most if not all 0.9.0 blockers listed below.
>
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22)%20AND%20priority%20%3D%20Blocker%20AND%20fixVersion%20%3D%200.9.0.0%20ORDER%20BY%20updated%20DESC
>
> Are there any concerns? We will also discuss the 0.9.0 release in
> tomorrow's KIP meeting.
>
> Thanks,
>
> Jun
>
> --
> You received this message because you are subscribed to the Google Groups
> "kafka-clients" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kafka-clients+unsubscribe@googlegroups.com.
> To post to this group, send email to kafka-clients@googlegroups.com.
> Visit this group at http://groups.google.com/group/kafka-clients.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/kafka-clients/CAFc58G_4SSzTR%3D0%3DRCVheS_3zfGXfNfqzGPQ2-TvmMT%3Dz0UObQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/kafka-clients/CAFc58G_4SSzTR%3D0%3DRCVheS_3zfGXfNfqzGPQ2-TvmMT%3Dz0UObQ%40mail.gmail.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>
--
Thanks,
Ewen
Re: [kafka-clients] Kafka 0.9.0 release branch
Posted by Ewen Cheslack-Postava <ew...@confluent.io>.
Not sure if I'd call it a blocker, but if we can get it in I would *really*
like to see some solution to
https://issues.apache.org/jira/browse/KAFKA-2397 committed. Without an
explicit leave group, even normal operation of groups can leave some
partitions unprocessed for 30-60s at a time under *normal* circumstances
like a graceful shutdown/restart. It might be manageable, but that's a
pretty large availability gap...
Not that the length of tests is critical, but this is also very obvious in
system tests. The copycat tests take about 50% longer than they should
because they have to wait for the session timeout.
-Ewen
On Mon, Oct 12, 2015 at 1:31 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, Everyone,
>
> As we are getting closer to the 0.9.0 release, we plan to cut an 0.9.0
> release branch in about two weeks from now. In the meantime, we will try to
> resolve most if not all 0.9.0 blockers listed below.
>
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22)%20AND%20priority%20%3D%20Blocker%20AND%20fixVersion%20%3D%200.9.0.0%20ORDER%20BY%20updated%20DESC
>
> Are there any concerns? We will also discuss the 0.9.0 release in
> tomorrow's KIP meeting.
>
> Thanks,
>
> Jun
>
> --
> You received this message because you are subscribed to the Google Groups
> "kafka-clients" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kafka-clients+unsubscribe@googlegroups.com.
> To post to this group, send email to kafka-clients@googlegroups.com.
> Visit this group at http://groups.google.com/group/kafka-clients.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/kafka-clients/CAFc58G_4SSzTR%3D0%3DRCVheS_3zfGXfNfqzGPQ2-TvmMT%3Dz0UObQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/kafka-clients/CAFc58G_4SSzTR%3D0%3DRCVheS_3zfGXfNfqzGPQ2-TvmMT%3Dz0UObQ%40mail.gmail.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>
--
Thanks,
Ewen
Re: Kafka 0.9.0 release branch
Posted by Ewen Cheslack-Postava <ew...@confluent.io>.
Yes, 0.9 will include the new consumer.
On Tue, Oct 13, 2015 at 12:50 PM, Rajiv Kurian <ra...@signalfx.com> wrote:
> A bit off topic but does this release contain the new single threaded
> consumer that supports the poll interface?
>
> Thanks!
>
> On Mon, Oct 12, 2015 at 1:31 PM, Jun Rao <ju...@confluent.io> wrote:
>
> > Hi, Everyone,
> >
> > As we are getting closer to the 0.9.0 release, we plan to cut an 0.9.0
> > release branch in about two weeks from now. In the meantime, we will try
> to
> > resolve most if not all 0.9.0 blockers listed below.
> >
> >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22)%20AND%20priority%20%3D%20Blocker%20AND%20fixVersion%20%3D%200.9.0.0%20ORDER%20BY%20updated%20DESC
> >
> > Are there any concerns? We will also discuss the 0.9.0 release in
> > tomorrow's KIP meeting.
> >
> > Thanks,
> >
> > Jun
> >
>
--
Thanks,
Ewen
Re: Kafka 0.9.0 release branch
Posted by Guozhang Wang <wa...@gmail.com>.
Just assigned reviewers for all the blocker issues. Please always feel free
to reassign, the purpose is to drive the review process towards the release.
On Tue, Oct 13, 2015 at 2:29 PM, Guozhang Wang <wa...@gmail.com> wrote:
> If time permits, it would be great to have both KAFKA-2397 and KAFKA-2017
> in 0.9.0 as both of them are trying to fix some regressions of the new
> consumer compared with the old consumer.
>
> Priority-wise, I think 2017 is higher than 2397 since upon a broker
> shutdown / failure, all connected consumers to this broker will go through
> a full rebalance whereas for 2017, upon a consumer shutdown / failure it
> will only affect the consumers within the same group.
>
> Effort-wise, 2397 is simpler than 2017 since we need to consider what ZK
> data format to achieve good trade-off between storage / efficiency.
>
> For now we can work on both of them in parallel: Onur already has a patch
> for 2397 that Jason is reviewing, I will re-start working on 2017.
>
> Guozhang
>
> On Tue, Oct 13, 2015 at 12:50 PM, Rajiv Kurian <ra...@signalfx.com> wrote:
>
>> A bit off topic but does this release contain the new single threaded
>> consumer that supports the poll interface?
>>
>> Thanks!
>>
>> On Mon, Oct 12, 2015 at 1:31 PM, Jun Rao <ju...@confluent.io> wrote:
>>
>> > Hi, Everyone,
>> >
>> > As we are getting closer to the 0.9.0 release, we plan to cut an 0.9.0
>> > release branch in about two weeks from now. In the meantime, we will
>> try to
>> > resolve most if not all 0.9.0 blockers listed below.
>> >
>> >
>> >
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22)%20AND%20priority%20%3D%20Blocker%20AND%20fixVersion%20%3D%200.9.0.0%20ORDER%20BY%20updated%20DESC
>> >
>> > Are there any concerns? We will also discuss the 0.9.0 release in
>> > tomorrow's KIP meeting.
>> >
>> > Thanks,
>> >
>> > Jun
>> >
>>
>
>
>
> --
> -- Guozhang
>
--
-- Guozhang
Re: Kafka 0.9.0 release branch
Posted by Guozhang Wang <wa...@gmail.com>.
If time permits, it would be great to have both KAFKA-2397 and KAFKA-2017
in 0.9.0 as both of them are trying to fix some regressions of the new
consumer compared with the old consumer.
Priority-wise, I think 2017 is higher than 2397 since upon a broker
shutdown / failure, all connected consumers to this broker will go through
a full rebalance whereas for 2017, upon a consumer shutdown / failure it
will only affect the consumers within the same group.
Effort-wise, 2397 is simpler than 2017 since we need to consider what ZK
data format to achieve good trade-off between storage / efficiency.
For now we can work on both of them in parallel: Onur already has a patch
for 2397 that Jason is reviewing, I will re-start working on 2017.
Guozhang
On Tue, Oct 13, 2015 at 12:50 PM, Rajiv Kurian <ra...@signalfx.com> wrote:
> A bit off topic but does this release contain the new single threaded
> consumer that supports the poll interface?
>
> Thanks!
>
> On Mon, Oct 12, 2015 at 1:31 PM, Jun Rao <ju...@confluent.io> wrote:
>
> > Hi, Everyone,
> >
> > As we are getting closer to the 0.9.0 release, we plan to cut an 0.9.0
> > release branch in about two weeks from now. In the meantime, we will try
> to
> > resolve most if not all 0.9.0 blockers listed below.
> >
> >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22)%20AND%20priority%20%3D%20Blocker%20AND%20fixVersion%20%3D%200.9.0.0%20ORDER%20BY%20updated%20DESC
> >
> > Are there any concerns? We will also discuss the 0.9.0 release in
> > tomorrow's KIP meeting.
> >
> > Thanks,
> >
> > Jun
> >
>
--
-- Guozhang
Re: Kafka 0.9.0 release branch
Posted by Rajiv Kurian <ra...@signalfx.com>.
A bit off topic but does this release contain the new single threaded
consumer that supports the poll interface?
Thanks!
On Mon, Oct 12, 2015 at 1:31 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, Everyone,
>
> As we are getting closer to the 0.9.0 release, we plan to cut an 0.9.0
> release branch in about two weeks from now. In the meantime, we will try to
> resolve most if not all 0.9.0 blockers listed below.
>
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22)%20AND%20priority%20%3D%20Blocker%20AND%20fixVersion%20%3D%200.9.0.0%20ORDER%20BY%20updated%20DESC
>
> Are there any concerns? We will also discuss the 0.9.0 release in
> tomorrow's KIP meeting.
>
> Thanks,
>
> Jun
>