You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by John Roesler <vv...@apache.org> on 2021/02/03 20:18:01 UTC

Re: [DISCUSS] Apache Kafka 2.8.0 release

Hello again, all,

This is a reminder that today is the Feature Freeze
deadline. To avoid any last-minute crunch or time-zone
unfairness, I'll cut the branch toward the end of the week.

Please wrap up your features and transition fully into a
stabilization mode. The next checkpoint is Code Freeze on
Feb 17th.

Thanks as always for all of your contributions,
John

On Wed, 2021-01-27 at 12:17 -0600, John Roesler wrote:
> Hello again, all.
> 
> This is a reminder that *today* is the KIP freeze for Apache
> Kafka 2.8.0.
> 
> The next checkpoint is the Feature Freeze on Feb 3rd.
> 
> When considering any last-minute KIPs today, please be
> mindful of the scope, since we have only one week to merge a
> stable implementation of the KIP.
> 
> For those whose KIPs have been accepted already, please work
> closely with your reviewers so that your features can be
> merged in a stable form in before the Feb 3rd cutoff. Also,
> don't forget to update the documentation as part of your
> feature.
> 
> Finally, as a gentle reminder to all contributors. There
> seems to have been a recent increase in test and system test
> failures. Please take some time starting now to stabilize
> the codebase so we can ensure a high quality and timely
> 2.8.0 release!
> 
> Thanks to all of you for your contributions,
> John
> 
> On Sat, 2021-01-23 at 18:15 +0300, Ivan Ponomarev wrote:
> > Hi John,
> > 
> > KIP-418 is already implemented and reviewed, but I don't see it in the 
> > release plan. Can it be added?
> > 
> > https://cwiki.apache.org/confluence/display/KAFKA/KIP-418%3A+A+method-chaining+way+to+branch+KStream
> > 
> > Regards,
> > 
> > Ivan
> > 
> > 22.01.2021 21:49, John Roesler пишет:
> > > Sure thing, Leah!
> > > -John
> > > On Thu, Jan 21, 2021, at 07:54, Leah Thomas wrote:
> > > > Hi John,
> > > > 
> > > > KIP-659 was just accepted as well, can it be added to the release plan?
> > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size
> > > > 
> > > > Thanks,
> > > > Leah
> > > > 
> > > > On Thu, Jan 14, 2021 at 9:36 AM John Roesler <vv...@apache.org> wrote:
> > > > 
> > > > > Hi David,
> > > > > 
> > > > > Thanks for the heads-up; it's added.
> > > > > 
> > > > > -John
> > > > > 
> > > > > On Thu, 2021-01-14 at 08:43 +0100, David Jacot wrote:
> > > > > > Hi John,
> > > > > > 
> > > > > > KIP-700 just got accepted. Can we add it to the release plan?
> > > > > > 
> > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-700%3A+Add+Describe+Cluster+API
> > > > > > 
> > > > > > Thanks,
> > > > > > David
> > > > > > 
> > > > > > On Wed, Jan 13, 2021 at 11:22 PM John Roesler <vv...@apache.org>
> > > > > wrote:
> > > > > > 
> > > > > > > Thanks, Gary! Sorry for the oversight.
> > > > > > > -John
> > > > > > > 
> > > > > > > On Wed, 2021-01-13 at 21:25 +0000, Gary Russell wrote:
> > > > > > > > Can you add a link to the summary page [1]?
> > > > > > > > 
> > > > > > > > I always start there.
> > > > > > > > 
> > > > > > > > Thanks
> > > > > > > > 
> > > > > > > > [1]:
> > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan
> > > > > > > > Future release plan - Apache Kafka - Apache Software Foundation<
> > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan>
> > > > > > > > Release Plan 0.10.0; Release Plan 0.10.1; Release Plan 0.10.2.0;
> > > > > Release
> > > > > > > Plan 0.10.2.2; Release Plan 0.11.0.0; Release Plan 0.11.0.3; Release
> > > > > Plan
> > > > > > > 1.0.0 (2017 Oct.)
> > > > > > > > cwiki.apache.org
> > > > > > > > 
> > > > > > > > ________________________________
> > > > > > > > From: John Roesler <vv...@apache.org>
> > > > > > > > Sent: Wednesday, January 13, 2021 4:11 PM
> > > > > > > > To: dev@kafka.apache.org <de...@kafka.apache.org>
> > > > > > > > Subject: Re: [DISCUSS] Apache Kafka 2.8.0 release
> > > > > > > > 
> > > > > > > > Hello again, all,
> > > > > > > > 
> > > > > > > > I have published a release plan at
> > > > > > > > 
> > > > > > > 
> > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fpages%2Fviewpage.action%3FpageId%3D173081737&amp;data=04%7C01%7Cgrussell%40vmware.com%7C6bb299de16bf4730c73608d8b8079404%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637461689989420036%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=8RfiDJZRr%2BZ1S46I5ZrHRyNOEKiBzjHYlxD4AnAb8p8%3D&amp;reserved=0
> > > > > > > > 
> > > > > > > > I have included all the KIPs that are currently approved,
> > > > > > > > but I am happy to make adjustments as necessary.
> > > > > > > > 
> > > > > > > > The KIP freeze is Jan 27th.
> > > > > > > > 
> > > > > > > > Please let me know if you have any objections.
> > > > > > > > 
> > > > > > > > Thanks,
> > > > > > > > -John
> > > > > > > > 
> > > > > > > > On Wed, 2021-01-06 at 23:30 -0600, John Roesler wrote:
> > > > > > > > > Hello All,
> > > > > > > > > 
> > > > > > > > > I'd like to volunteer to be the release manager for our next
> > > > > > > > > feature release, 2.8.0. If there are no objections, I'll
> > > > > > > > > send out the release plan soon.
> > > > > > > > > 
> > > > > > > > > Thanks,
> > > > > > > > > John Roesler
> > > > > > > > > 
> > > > > > > > 
> > > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > 
> > > > > 
> > > > > 
> > > > 
> > 
> 
>

Re: [DISCUSS] Apache Kafka 2.8.0 release

Posted by Walker Carlson <wc...@confluent.io.INVALID>.

Hello John,

We merged the fix for the blocker I mentioned earlier
https://issues.apache.org/jira/browse/KAFKA-12462
https://github.com/apache/kafka/pull/10311

best
walker

On Fri, Mar 19, 2021 at 7:09 AM Bruno Cadonna <br...@confluent.io.invalid>
wrote:

> Hi John,
>
> Correction to my last e-mail: The bug does not break eos, but it breaks
> at-least-once.
>
> Bruno
>
>
> On 19.03.21 14:55, Bruno Cadonna wrote:
> > Hi John,
> >
> > Please have a look at the following bug report:
> >
> > https://issues.apache.org/jira/browse/KAFKA-12508
> >
> > I set its priority to blocker since the bug might break at-least-once
> > and exactly-once processing guarantees.
> >
> > Feel free to set it back to major, if you think that it is not a blocker.
> >
> > Best,
> > Bruno
> >
> >
> > On 13.03.21 00:41, Walker Carlson wrote:
> >> Hello John,
> >>
> >> We found a Blocker for 2.8 in our streams soak environment.
> >> https://issues.apache.org/jira/browse/KAFKA-12462
> >>      - We found a case where a StreamThread can try to transition
> >> to PARTITIONS_REVOKED when it was already in PENDING_SHUTDOWN causing an
> >> IllegalStateException.
> >>
> >> Will have a PR for a fix soon
> >>
> >> Walker
> >>
> >> On Tue, Mar 2, 2021 at 2:41 PM Dhruvil Shah <dh...@confluent.io>
> wrote:
> >>
> >>> Thanks, John. The fix for KAFKA-12254 is now merged into 2.8.
> >>>
> >>> On Tue, Mar 2, 2021 at 11:54 AM John Roesler <vv...@apache.org>
> >>> wrote:
> >>>
> >>>> Hi Dhruvil,
> >>>>
> >>>> Thanks for this fix. I agree it would be good to get it in
> >>>> for 2.8.0, so I have added it to the fix versions in KAFKA-
> >>>> 12254.
> >>>>
> >>>> Please go ahead and cherry-pick your fix onto the 2.8
> >>>> branch.
> >>>>
> >>>> Thanks!
> >>>> -John
> >>>>
> >>>> On Mon, 2021-03-01 at 09:36 -0800, Dhruvil Shah wrote:
> >>>>> Hi John,
> >>>>>
> >>>>> I would like to bring up
> >>>> https://issues.apache.org/jira/browse/KAFKA-12254
> >>>>> as a blocker candidate for 2.8.0. While this is not a regression, the
> >>>>> issue could lead to data loss in certain cases. The fix is trivial so
> >>> it
> >>>>> may be worth bringing it into 2.8.0. Let me know what you think.
> >>>>>
> >>>>> - Dhruvil
> >>>>>
> >>>>> On Mon, Feb 22, 2021 at 7:50 AM John Roesler <vv...@apache.org>
> >>>> wrote:
> >>>>>
> >>>>>> Thanks for the heads-up, Chia-Ping,
> >>>>>>
> >>>>>> I agree it would be good to include that fix.
> >>>>>>
> >>>>>> Thanks,
> >>>>>> John
> >>>>>>
> >>>>>> On Mon, 2021-02-22 at 09:48 +0000, Chia-Ping Tsai wrote:
> >>>>>>> hi John,
> >>>>>>>
> >>>>>>> There is a PR (https://github.com/apache/kafka/pull/10024) fixing
> >>>>>> following test error.
> >>>>>>>
> >>>>>>> 14:00:28 Execution failed for task ':core:test'.
> >>>>>>> 14:00:28 > Process 'Gradle Test Executor 24' finished with non-zero
> >>>> exit
> >>>>>> value 1
> >>>>>>> 14:00:28   This problem might be caused by incorrect test process
> >>>>>> configuration.
> >>>>>>> 14:00:28   Please refer to the test execution section in the User
> >>>> Manual
> >>>>>> at
> >>>>>>>
> >>>>>>> This error obstructs us from running integration tests so I'd like
> >>> to
> >>>>>> push it to 2.8 branch after it gets approved.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> Chia-Ping
> >>>>>>>
> >>>>>>> On 2021/02/18 16:23:13, "John Roesler" <vv...@apache.org>
> >>> wrote:
> >>>>>>>> Hello again, all.
> >>>>>>>>
> >>>>>>>> This is a notice that we are now in Code Freeze for the 2.8
> >>> branch.
> >>>>>>>>
> >>>>>>>>  From now until the release, only fixes for blockers should be
> >>>> merged
> >>>>>> to the release branch. Fixes for failing tests are allowed and
> >>>> encouraged.
> >>>>>> Documentation-only commits are also ok, in case you have forgotten
> to
> >>>>>> update the docs for some features in 2.8.0.
> >>>>>>>>
> >>>>>>>> Once we have a green build and passing system tests, I will cut
> >>> the
> >>>>>> first RC.
> >>>>>>>>
> >>>>>>>> Thank you,
> >>>>>>>> John
> >>>>>>>>
> >>>>>>>> On Sun, Feb 7, 2021, at 09:59, John Roesler wrote:
> >>>>>>>>> Hello all,
> >>>>>>>>>
> >>>>>>>>> I have just cut the branch for 2.8 and sent the notification
> >>>>>>>>> email to the dev mailing list.
> >>>>>>>>>
> >>>>>>>>> As a reminder, the next checkpoint toward the 2.8.0 release
> >>>>>>>>> is Code Freeze on Feb 17th.
> >>>>>>>>>
> >>>>>>>>> To ensure a high-quality release, we should now focus our
> >>>>>>>>> efforts on stabilizing the 2.8 branch, including resolving
> >>>>>>>>> failures, writing new tests, and fixing documentation.
> >>>>>>>>>
> >>>>>>>>> Thanks as always for your contributions,
> >>>>>>>>> John
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Wed, 2021-02-03 at 14:18 -0600, John Roesler wrote:
> >>>>>>>>>> Hello again, all,
> >>>>>>>>>>
> >>>>>>>>>> This is a reminder that today is the Feature Freeze
> >>>>>>>>>> deadline. To avoid any last-minute crunch or time-zone
> >>>>>>>>>> unfairness, I'll cut the branch toward the end of the week.
> >>>>>>>>>>
> >>>>>>>>>> Please wrap up your features and transition fully into a
> >>>>>>>>>> stabilization mode. The next checkpoint is Code Freeze on
> >>>>>>>>>> Feb 17th.
> >>>>>>>>>>
> >>>>>>>>>> Thanks as always for all of your contributions,
> >>>>>>>>>> John
> >>>>>>>>>>
> >>>>>>>>>> On Wed, 2021-01-27 at 12:17 -0600, John Roesler wrote:
> >>>>>>>>>>> Hello again, all.
> >>>>>>>>>>>
> >>>>>>>>>>> This is a reminder that *today* is the KIP freeze for
> >>> Apache
> >>>>>>>>>>> Kafka 2.8.0.
> >>>>>>>>>>>
> >>>>>>>>>>> The next checkpoint is the Feature Freeze on Feb 3rd.
> >>>>>>>>>>>
> >>>>>>>>>>> When considering any last-minute KIPs today, please be
> >>>>>>>>>>> mindful of the scope, since we have only one week to merge
> >>> a
> >>>>>>>>>>> stable implementation of the KIP.
> >>>>>>>>>>>
> >>>>>>>>>>> For those whose KIPs have been accepted already, please
> >>> work
> >>>>>>>>>>> closely with your reviewers so that your features can be
> >>>>>>>>>>> merged in a stable form in before the Feb 3rd cutoff. Also,
> >>>>>>>>>>> don't forget to update the documentation as part of your
> >>>>>>>>>>> feature.
> >>>>>>>>>>>
> >>>>>>>>>>> Finally, as a gentle reminder to all contributors. There
> >>>>>>>>>>> seems to have been a recent increase in test and system
> >>> test
> >>>>>>>>>>> failures. Please take some time starting now to stabilize
> >>>>>>>>>>> the codebase so we can ensure a high quality and timely
> >>>>>>>>>>> 2.8.0 release!
> >>>>>>>>>>>
> >>>>>>>>>>> Thanks to all of you for your contributions,
> >>>>>>>>>>> John
> >>>>>>>>>>>
> >>>>>>>>>>> On Sat, 2021-01-23 at 18:15 +0300, Ivan Ponomarev wrote:
> >>>>>>>>>>>> Hi John,
> >>>>>>>>>>>>
> >>>>>>>>>>>> KIP-418 is already implemented and reviewed, but I don't
> >>>> see
> >>>>>> it in the
> >>>>>>>>>>>> release plan. Can it be added?
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>
> >>>>
> >>>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-418%3A+A+method-chaining+way+to+branch+KStream
> >>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> Regards,
> >>>>>>>>>>>>
> >>>>>>>>>>>> Ivan
> >>>>>>>>>>>>
> >>>>>>>>>>>> 22.01.2021 21:49, John Roesler пишет:
> >>>>>>>>>>>>> Sure thing, Leah!
> >>>>>>>>>>>>> -John
> >>>>>>>>>>>>> On Thu, Jan 21, 2021, at 07:54, Leah Thomas wrote:
> >>>>>>>>>>>>>> Hi John,
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> KIP-659 was just accepted as well, can it be added to
> >>>> the
> >>>>>> release plan?
> >>>>>>>>>>>>>>
> >>>>>>
> >>>>
> >>>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size
> >>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks,
> >>>>>>>>>>>>>> Leah
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Thu, Jan 14, 2021 at 9:36 AM John Roesler <
> >>>>>> vvcephei@apache.org> wrote:
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Hi David,
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks for the heads-up; it's added.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> -John
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Thu, 2021-01-14 at 08:43 +0100, David Jacot
> >>> wrote:
> >>>>>>>>>>>>>>>> Hi John,
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> KIP-700 just got accepted. Can we add it to the
> >>>>>> release plan?
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>
> >>>>
> >>>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-700%3A+Add+Describe+Cluster+API
> >>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Thanks,
> >>>>>>>>>>>>>>>> David
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> On Wed, Jan 13, 2021 at 11:22 PM John Roesler <
> >>>>>> vvcephei@apache.org>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Thanks, Gary! Sorry for the oversight.
> >>>>>>>>>>>>>>>>> -John
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> On Wed, 2021-01-13 at 21:25 +0000, Gary Russell
> >>>>>> wrote:
> >>>>>>>>>>>>>>>>>> Can you add a link to the summary page [1]?
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> I always start there.
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> Thanks
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> [1]:
> >>>>>>>>>>>>>>>>>
> >>>>>>
> >>> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan
> >>>>>>>>>>>>>>>>>> Future release plan - Apache Kafka - Apache
> >>>>>> Software Foundation<
> >>>>>>>>>>>>>>>>>
> >>>>>>
> >>> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan>
> >>>>>>>>>>>>>>>>>> Release Plan 0.10.0; Release Plan 0.10.1;
> >>>> Release
> >>>>>> Plan 0.10.2.0;
> >>>>>>>>>>>>>>> Release
> >>>>>>>>>>>>>>>>> Plan 0.10.2.2; Release Plan 0.11.0.0; Release
> >>>> Plan
> >>>>>> 0.11.0.3; Release
> >>>>>>>>>>>>>>> Plan
> >>>>>>>>>>>>>>>>> 1.0.0 (2017 Oct.)
> >>>>>>>>>>>>>>>>>> cwiki.apache.org
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> ________________________________
> >>>>>>>>>>>>>>>>>> From: John Roesler <vv...@apache.org>
> >>>>>>>>>>>>>>>>>> Sent: Wednesday, January 13, 2021 4:11 PM
> >>>>>>>>>>>>>>>>>> To: dev@kafka.apache.org <
> >>> dev@kafka.apache.org
> >>>>>
> >>>>>>>>>>>>>>>>>> Subject: Re: [DISCUSS] Apache Kafka 2.8.0
> >>>> release
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> Hello again, all,
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> I have published a release plan at
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>
> >>>>
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fpages%2Fviewpage.action%3FpageId%3D173081737&data=04%7C01%7Cgrussell%40vmware.com%7C6bb299de16bf4730c73608d8b8079404%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637461689989420036%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=8RfiDJZRr%2BZ1S46I5ZrHRyNOEKiBzjHYlxD4AnAb8p8%3D&reserved=0
> >>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> I have included all the KIPs that are
> >>> currently
> >>>>>> approved,
> >>>>>>>>>>>>>>>>>> but I am happy to make adjustments as
> >>>> necessary.
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> The KIP freeze is Jan 27th.
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> Please let me know if you have any
> >>> objections.
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> Thanks,
> >>>>>>>>>>>>>>>>>> -John
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> On Wed, 2021-01-06 at 23:30 -0600, John
> >>> Roesler
> >>>>>> wrote:
> >>>>>>>>>>>>>>>>>>> Hello All,
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> I'd like to volunteer to be the release
> >>>> manager
> >>>>>> for our next
> >>>>>>>>>>>>>>>>>>> feature release, 2.8.0. If there are no
> >>>>>> objections, I'll
> >>>>>>>>>>>>>>>>>>> send out the release plan soon.
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> Thanks,
> >>>>>>>>>>>>>>>>>>> John Roesler
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>
> >>>>
> >>>>
> >>>
> >>
>

Re: [DISCUSS] Apache Kafka 2.8.0 release

Posted by Bruno Cadonna <br...@confluent.io.INVALID>.

Hi John,

Correction to my last e-mail: The bug does not break eos, but it breaks 
at-least-once.

Bruno


On 19.03.21 14:55, Bruno Cadonna wrote:
> Hi John,
> 
> Please have a look at the following bug report:
> 
> https://issues.apache.org/jira/browse/KAFKA-12508
> 
> I set its priority to blocker since the bug might break at-least-once 
> and exactly-once processing guarantees.
> 
> Feel free to set it back to major, if you think that it is not a blocker.
> 
> Best,
> Bruno
> 
> 
> On 13.03.21 00:41, Walker Carlson wrote:
>> Hello John,
>>
>> We found a Blocker for 2.8 in our streams soak environment.
>> https://issues.apache.org/jira/browse/KAFKA-12462
>>      - We found a case where a StreamThread can try to transition
>> to PARTITIONS_REVOKED when it was already in PENDING_SHUTDOWN causing an
>> IllegalStateException.
>>
>> Will have a PR for a fix soon
>>
>> Walker
>>
>> On Tue, Mar 2, 2021 at 2:41 PM Dhruvil Shah <dh...@confluent.io> wrote:
>>
>>> Thanks, John. The fix for KAFKA-12254 is now merged into 2.8.
>>>
>>> On Tue, Mar 2, 2021 at 11:54 AM John Roesler <vv...@apache.org> 
>>> wrote:
>>>
>>>> Hi Dhruvil,
>>>>
>>>> Thanks for this fix. I agree it would be good to get it in
>>>> for 2.8.0, so I have added it to the fix versions in KAFKA-
>>>> 12254.
>>>>
>>>> Please go ahead and cherry-pick your fix onto the 2.8
>>>> branch.
>>>>
>>>> Thanks!
>>>> -John
>>>>
>>>> On Mon, 2021-03-01 at 09:36 -0800, Dhruvil Shah wrote:
>>>>> Hi John,
>>>>>
>>>>> I would like to bring up
>>>> https://issues.apache.org/jira/browse/KAFKA-12254
>>>>> as a blocker candidate for 2.8.0. While this is not a regression, the
>>>>> issue could lead to data loss in certain cases. The fix is trivial so
>>> it
>>>>> may be worth bringing it into 2.8.0. Let me know what you think.
>>>>>
>>>>> - Dhruvil
>>>>>
>>>>> On Mon, Feb 22, 2021 at 7:50 AM John Roesler <vv...@apache.org>
>>>> wrote:
>>>>>
>>>>>> Thanks for the heads-up, Chia-Ping,
>>>>>>
>>>>>> I agree it would be good to include that fix.
>>>>>>
>>>>>> Thanks,
>>>>>> John
>>>>>>
>>>>>> On Mon, 2021-02-22 at 09:48 +0000, Chia-Ping Tsai wrote:
>>>>>>> hi John,
>>>>>>>
>>>>>>> There is a PR (https://github.com/apache/kafka/pull/10024) fixing
>>>>>> following test error.
>>>>>>>
>>>>>>> 14:00:28 Execution failed for task ':core:test'.
>>>>>>> 14:00:28 > Process 'Gradle Test Executor 24' finished with non-zero
>>>> exit
>>>>>> value 1
>>>>>>> 14:00:28   This problem might be caused by incorrect test process
>>>>>> configuration.
>>>>>>> 14:00:28   Please refer to the test execution section in the User
>>>> Manual
>>>>>> at
>>>>>>>
>>>>>>> This error obstructs us from running integration tests so I'd like
>>> to
>>>>>> push it to 2.8 branch after it gets approved.
>>>>>>>
>>>>>>> Best Regards,
>>>>>>> Chia-Ping
>>>>>>>
>>>>>>> On 2021/02/18 16:23:13, "John Roesler" <vv...@apache.org>
>>> wrote:
>>>>>>>> Hello again, all.
>>>>>>>>
>>>>>>>> This is a notice that we are now in Code Freeze for the 2.8
>>> branch.
>>>>>>>>
>>>>>>>>  From now until the release, only fixes for blockers should be
>>>> merged
>>>>>> to the release branch. Fixes for failing tests are allowed and
>>>> encouraged.
>>>>>> Documentation-only commits are also ok, in case you have forgotten to
>>>>>> update the docs for some features in 2.8.0.
>>>>>>>>
>>>>>>>> Once we have a green build and passing system tests, I will cut
>>> the
>>>>>> first RC.
>>>>>>>>
>>>>>>>> Thank you,
>>>>>>>> John
>>>>>>>>
>>>>>>>> On Sun, Feb 7, 2021, at 09:59, John Roesler wrote:
>>>>>>>>> Hello all,
>>>>>>>>>
>>>>>>>>> I have just cut the branch for 2.8 and sent the notification
>>>>>>>>> email to the dev mailing list.
>>>>>>>>>
>>>>>>>>> As a reminder, the next checkpoint toward the 2.8.0 release
>>>>>>>>> is Code Freeze on Feb 17th.
>>>>>>>>>
>>>>>>>>> To ensure a high-quality release, we should now focus our
>>>>>>>>> efforts on stabilizing the 2.8 branch, including resolving
>>>>>>>>> failures, writing new tests, and fixing documentation.
>>>>>>>>>
>>>>>>>>> Thanks as always for your contributions,
>>>>>>>>> John
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Wed, 2021-02-03 at 14:18 -0600, John Roesler wrote:
>>>>>>>>>> Hello again, all,
>>>>>>>>>>
>>>>>>>>>> This is a reminder that today is the Feature Freeze
>>>>>>>>>> deadline. To avoid any last-minute crunch or time-zone
>>>>>>>>>> unfairness, I'll cut the branch toward the end of the week.
>>>>>>>>>>
>>>>>>>>>> Please wrap up your features and transition fully into a
>>>>>>>>>> stabilization mode. The next checkpoint is Code Freeze on
>>>>>>>>>> Feb 17th.
>>>>>>>>>>
>>>>>>>>>> Thanks as always for all of your contributions,
>>>>>>>>>> John
>>>>>>>>>>
>>>>>>>>>> On Wed, 2021-01-27 at 12:17 -0600, John Roesler wrote:
>>>>>>>>>>> Hello again, all.
>>>>>>>>>>>
>>>>>>>>>>> This is a reminder that *today* is the KIP freeze for
>>> Apache
>>>>>>>>>>> Kafka 2.8.0.
>>>>>>>>>>>
>>>>>>>>>>> The next checkpoint is the Feature Freeze on Feb 3rd.
>>>>>>>>>>>
>>>>>>>>>>> When considering any last-minute KIPs today, please be
>>>>>>>>>>> mindful of the scope, since we have only one week to merge
>>> a
>>>>>>>>>>> stable implementation of the KIP.
>>>>>>>>>>>
>>>>>>>>>>> For those whose KIPs have been accepted already, please
>>> work
>>>>>>>>>>> closely with your reviewers so that your features can be
>>>>>>>>>>> merged in a stable form in before the Feb 3rd cutoff. Also,
>>>>>>>>>>> don't forget to update the documentation as part of your
>>>>>>>>>>> feature.
>>>>>>>>>>>
>>>>>>>>>>> Finally, as a gentle reminder to all contributors. There
>>>>>>>>>>> seems to have been a recent increase in test and system
>>> test
>>>>>>>>>>> failures. Please take some time starting now to stabilize
>>>>>>>>>>> the codebase so we can ensure a high quality and timely
>>>>>>>>>>> 2.8.0 release!
>>>>>>>>>>>
>>>>>>>>>>> Thanks to all of you for your contributions,
>>>>>>>>>>> John
>>>>>>>>>>>
>>>>>>>>>>> On Sat, 2021-01-23 at 18:15 +0300, Ivan Ponomarev wrote:
>>>>>>>>>>>> Hi John,
>>>>>>>>>>>>
>>>>>>>>>>>> KIP-418 is already implemented and reviewed, but I don't
>>>> see
>>>>>> it in the
>>>>>>>>>>>> release plan. Can it be added?
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>
>>>>
>>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-418%3A+A+method-chaining+way+to+branch+KStream 
>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Regards,
>>>>>>>>>>>>
>>>>>>>>>>>> Ivan
>>>>>>>>>>>>
>>>>>>>>>>>> 22.01.2021 21:49, John Roesler пишет:
>>>>>>>>>>>>> Sure thing, Leah!
>>>>>>>>>>>>> -John
>>>>>>>>>>>>> On Thu, Jan 21, 2021, at 07:54, Leah Thomas wrote:
>>>>>>>>>>>>>> Hi John,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> KIP-659 was just accepted as well, can it be added to
>>>> the
>>>>>> release plan?
>>>>>>>>>>>>>>
>>>>>>
>>>>
>>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size 
>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>> Leah
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Thu, Jan 14, 2021 at 9:36 AM John Roesler <
>>>>>> vvcephei@apache.org> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi David,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks for the heads-up; it's added.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> -John
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Thu, 2021-01-14 at 08:43 +0100, David Jacot
>>> wrote:
>>>>>>>>>>>>>>>> Hi John,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> KIP-700 just got accepted. Can we add it to the
>>>>>> release plan?
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>
>>>>
>>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-700%3A+Add+Describe+Cluster+API 
>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>> David
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Wed, Jan 13, 2021 at 11:22 PM John Roesler <
>>>>>> vvcephei@apache.org>
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Thanks, Gary! Sorry for the oversight.
>>>>>>>>>>>>>>>>> -John
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Wed, 2021-01-13 at 21:25 +0000, Gary Russell
>>>>>> wrote:
>>>>>>>>>>>>>>>>>> Can you add a link to the summary page [1]?
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> I always start there.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> [1]:
>>>>>>>>>>>>>>>>>
>>>>>>
>>> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan
>>>>>>>>>>>>>>>>>> Future release plan - Apache Kafka - Apache
>>>>>> Software Foundation<
>>>>>>>>>>>>>>>>>
>>>>>>
>>> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan>
>>>>>>>>>>>>>>>>>> Release Plan 0.10.0; Release Plan 0.10.1;
>>>> Release
>>>>>> Plan 0.10.2.0;
>>>>>>>>>>>>>>> Release
>>>>>>>>>>>>>>>>> Plan 0.10.2.2; Release Plan 0.11.0.0; Release
>>>> Plan
>>>>>> 0.11.0.3; Release
>>>>>>>>>>>>>>> Plan
>>>>>>>>>>>>>>>>> 1.0.0 (2017 Oct.)
>>>>>>>>>>>>>>>>>> cwiki.apache.org
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> ________________________________
>>>>>>>>>>>>>>>>>> From: John Roesler <vv...@apache.org>
>>>>>>>>>>>>>>>>>> Sent: Wednesday, January 13, 2021 4:11 PM
>>>>>>>>>>>>>>>>>> To: dev@kafka.apache.org <
>>> dev@kafka.apache.org
>>>>>
>>>>>>>>>>>>>>>>>> Subject: Re: [DISCUSS] Apache Kafka 2.8.0
>>>> release
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Hello again, all,
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> I have published a release plan at
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>
>>>>
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fpages%2Fviewpage.action%3FpageId%3D173081737&data=04%7C01%7Cgrussell%40vmware.com%7C6bb299de16bf4730c73608d8b8079404%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637461689989420036%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=8RfiDJZRr%2BZ1S46I5ZrHRyNOEKiBzjHYlxD4AnAb8p8%3D&reserved=0 
>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> I have included all the KIPs that are
>>> currently
>>>>>> approved,
>>>>>>>>>>>>>>>>>> but I am happy to make adjustments as
>>>> necessary.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> The KIP freeze is Jan 27th.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Please let me know if you have any
>>> objections.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>> -John
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> On Wed, 2021-01-06 at 23:30 -0600, John
>>> Roesler
>>>>>> wrote:
>>>>>>>>>>>>>>>>>>> Hello All,
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> I'd like to volunteer to be the release
>>>> manager
>>>>>> for our next
>>>>>>>>>>>>>>>>>>> feature release, 2.8.0. If there are no
>>>>>> objections, I'll
>>>>>>>>>>>>>>>>>>> send out the release plan soon.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>>> John Roesler
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>
>>>>
>>>>
>>>
>>

Re: [DISCUSS] Apache Kafka 2.8.0 release

Posted by Bruno Cadonna <br...@confluent.io.INVALID>.

Hi John,

Please have a look at the following bug report:

https://issues.apache.org/jira/browse/KAFKA-12508

I set its priority to blocker since the bug might break at-least-once 
and exactly-once processing guarantees.

Feel free to set it back to major, if you think that it is not a blocker.

Best,
Bruno


On 13.03.21 00:41, Walker Carlson wrote:
> Hello John,
> 
> We found a Blocker for 2.8 in our streams soak environment.
> https://issues.apache.org/jira/browse/KAFKA-12462
>      - We found a case where a StreamThread can try to transition
> to PARTITIONS_REVOKED when it was already in PENDING_SHUTDOWN causing an
> IllegalStateException.
> 
> Will have a PR for a fix soon
> 
> Walker
> 
> On Tue, Mar 2, 2021 at 2:41 PM Dhruvil Shah <dh...@confluent.io> wrote:
> 
>> Thanks, John. The fix for KAFKA-12254 is now merged into 2.8.
>>
>> On Tue, Mar 2, 2021 at 11:54 AM John Roesler <vv...@apache.org> wrote:
>>
>>> Hi Dhruvil,
>>>
>>> Thanks for this fix. I agree it would be good to get it in
>>> for 2.8.0, so I have added it to the fix versions in KAFKA-
>>> 12254.
>>>
>>> Please go ahead and cherry-pick your fix onto the 2.8
>>> branch.
>>>
>>> Thanks!
>>> -John
>>>
>>> On Mon, 2021-03-01 at 09:36 -0800, Dhruvil Shah wrote:
>>>> Hi John,
>>>>
>>>> I would like to bring up
>>> https://issues.apache.org/jira/browse/KAFKA-12254
>>>> as a blocker candidate for 2.8.0. While this is not a regression, the
>>>> issue could lead to data loss in certain cases. The fix is trivial so
>> it
>>>> may be worth bringing it into 2.8.0. Let me know what you think.
>>>>
>>>> - Dhruvil
>>>>
>>>> On Mon, Feb 22, 2021 at 7:50 AM John Roesler <vv...@apache.org>
>>> wrote:
>>>>
>>>>> Thanks for the heads-up, Chia-Ping,
>>>>>
>>>>> I agree it would be good to include that fix.
>>>>>
>>>>> Thanks,
>>>>> John
>>>>>
>>>>> On Mon, 2021-02-22 at 09:48 +0000, Chia-Ping Tsai wrote:
>>>>>> hi John,
>>>>>>
>>>>>> There is a PR (https://github.com/apache/kafka/pull/10024) fixing
>>>>> following test error.
>>>>>>
>>>>>> 14:00:28 Execution failed for task ':core:test'.
>>>>>> 14:00:28 > Process 'Gradle Test Executor 24' finished with non-zero
>>> exit
>>>>> value 1
>>>>>> 14:00:28   This problem might be caused by incorrect test process
>>>>> configuration.
>>>>>> 14:00:28   Please refer to the test execution section in the User
>>> Manual
>>>>> at
>>>>>>
>>>>>> This error obstructs us from running integration tests so I'd like
>> to
>>>>> push it to 2.8 branch after it gets approved.
>>>>>>
>>>>>> Best Regards,
>>>>>> Chia-Ping
>>>>>>
>>>>>> On 2021/02/18 16:23:13, "John Roesler" <vv...@apache.org>
>> wrote:
>>>>>>> Hello again, all.
>>>>>>>
>>>>>>> This is a notice that we are now in Code Freeze for the 2.8
>> branch.
>>>>>>>
>>>>>>>  From now until the release, only fixes for blockers should be
>>> merged
>>>>> to the release branch. Fixes for failing tests are allowed and
>>> encouraged.
>>>>> Documentation-only commits are also ok, in case you have forgotten to
>>>>> update the docs for some features in 2.8.0.
>>>>>>>
>>>>>>> Once we have a green build and passing system tests, I will cut
>> the
>>>>> first RC.
>>>>>>>
>>>>>>> Thank you,
>>>>>>> John
>>>>>>>
>>>>>>> On Sun, Feb 7, 2021, at 09:59, John Roesler wrote:
>>>>>>>> Hello all,
>>>>>>>>
>>>>>>>> I have just cut the branch for 2.8 and sent the notification
>>>>>>>> email to the dev mailing list.
>>>>>>>>
>>>>>>>> As a reminder, the next checkpoint toward the 2.8.0 release
>>>>>>>> is Code Freeze on Feb 17th.
>>>>>>>>
>>>>>>>> To ensure a high-quality release, we should now focus our
>>>>>>>> efforts on stabilizing the 2.8 branch, including resolving
>>>>>>>> failures, writing new tests, and fixing documentation.
>>>>>>>>
>>>>>>>> Thanks as always for your contributions,
>>>>>>>> John
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, 2021-02-03 at 14:18 -0600, John Roesler wrote:
>>>>>>>>> Hello again, all,
>>>>>>>>>
>>>>>>>>> This is a reminder that today is the Feature Freeze
>>>>>>>>> deadline. To avoid any last-minute crunch or time-zone
>>>>>>>>> unfairness, I'll cut the branch toward the end of the week.
>>>>>>>>>
>>>>>>>>> Please wrap up your features and transition fully into a
>>>>>>>>> stabilization mode. The next checkpoint is Code Freeze on
>>>>>>>>> Feb 17th.
>>>>>>>>>
>>>>>>>>> Thanks as always for all of your contributions,
>>>>>>>>> John
>>>>>>>>>
>>>>>>>>> On Wed, 2021-01-27 at 12:17 -0600, John Roesler wrote:
>>>>>>>>>> Hello again, all.
>>>>>>>>>>
>>>>>>>>>> This is a reminder that *today* is the KIP freeze for
>> Apache
>>>>>>>>>> Kafka 2.8.0.
>>>>>>>>>>
>>>>>>>>>> The next checkpoint is the Feature Freeze on Feb 3rd.
>>>>>>>>>>
>>>>>>>>>> When considering any last-minute KIPs today, please be
>>>>>>>>>> mindful of the scope, since we have only one week to merge
>> a
>>>>>>>>>> stable implementation of the KIP.
>>>>>>>>>>
>>>>>>>>>> For those whose KIPs have been accepted already, please
>> work
>>>>>>>>>> closely with your reviewers so that your features can be
>>>>>>>>>> merged in a stable form in before the Feb 3rd cutoff. Also,
>>>>>>>>>> don't forget to update the documentation as part of your
>>>>>>>>>> feature.
>>>>>>>>>>
>>>>>>>>>> Finally, as a gentle reminder to all contributors. There
>>>>>>>>>> seems to have been a recent increase in test and system
>> test
>>>>>>>>>> failures. Please take some time starting now to stabilize
>>>>>>>>>> the codebase so we can ensure a high quality and timely
>>>>>>>>>> 2.8.0 release!
>>>>>>>>>>
>>>>>>>>>> Thanks to all of you for your contributions,
>>>>>>>>>> John
>>>>>>>>>>
>>>>>>>>>> On Sat, 2021-01-23 at 18:15 +0300, Ivan Ponomarev wrote:
>>>>>>>>>>> Hi John,
>>>>>>>>>>>
>>>>>>>>>>> KIP-418 is already implemented and reviewed, but I don't
>>> see
>>>>> it in the
>>>>>>>>>>> release plan. Can it be added?
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>
>>>
>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-418%3A+A+method-chaining+way+to+branch+KStream
>>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>>
>>>>>>>>>>> Ivan
>>>>>>>>>>>
>>>>>>>>>>> 22.01.2021 21:49, John Roesler пишет:
>>>>>>>>>>>> Sure thing, Leah!
>>>>>>>>>>>> -John
>>>>>>>>>>>> On Thu, Jan 21, 2021, at 07:54, Leah Thomas wrote:
>>>>>>>>>>>>> Hi John,
>>>>>>>>>>>>>
>>>>>>>>>>>>> KIP-659 was just accepted as well, can it be added to
>>> the
>>>>> release plan?
>>>>>>>>>>>>>
>>>>>
>>>
>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>> Leah
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Thu, Jan 14, 2021 at 9:36 AM John Roesler <
>>>>> vvcephei@apache.org> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi David,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks for the heads-up; it's added.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> -John
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Thu, 2021-01-14 at 08:43 +0100, David Jacot
>> wrote:
>>>>>>>>>>>>>>> Hi John,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> KIP-700 just got accepted. Can we add it to the
>>>>> release plan?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>
>>>
>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-700%3A+Add+Describe+Cluster+API
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>> David
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Wed, Jan 13, 2021 at 11:22 PM John Roesler <
>>>>> vvcephei@apache.org>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Thanks, Gary! Sorry for the oversight.
>>>>>>>>>>>>>>>> -John
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Wed, 2021-01-13 at 21:25 +0000, Gary Russell
>>>>> wrote:
>>>>>>>>>>>>>>>>> Can you add a link to the summary page [1]?
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> I always start there.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> [1]:
>>>>>>>>>>>>>>>>
>>>>>
>> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan
>>>>>>>>>>>>>>>>> Future release plan - Apache Kafka - Apache
>>>>> Software Foundation<
>>>>>>>>>>>>>>>>
>>>>>
>> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan>
>>>>>>>>>>>>>>>>> Release Plan 0.10.0; Release Plan 0.10.1;
>>> Release
>>>>> Plan 0.10.2.0;
>>>>>>>>>>>>>> Release
>>>>>>>>>>>>>>>> Plan 0.10.2.2; Release Plan 0.11.0.0; Release
>>> Plan
>>>>> 0.11.0.3; Release
>>>>>>>>>>>>>> Plan
>>>>>>>>>>>>>>>> 1.0.0 (2017 Oct.)
>>>>>>>>>>>>>>>>> cwiki.apache.org
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> ________________________________
>>>>>>>>>>>>>>>>> From: John Roesler <vv...@apache.org>
>>>>>>>>>>>>>>>>> Sent: Wednesday, January 13, 2021 4:11 PM
>>>>>>>>>>>>>>>>> To: dev@kafka.apache.org <
>> dev@kafka.apache.org
>>>>
>>>>>>>>>>>>>>>>> Subject: Re: [DISCUSS] Apache Kafka 2.8.0
>>> release
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Hello again, all,
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> I have published a release plan at
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>
>>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fpages%2Fviewpage.action%3FpageId%3D173081737&data=04%7C01%7Cgrussell%40vmware.com%7C6bb299de16bf4730c73608d8b8079404%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637461689989420036%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=8RfiDJZRr%2BZ1S46I5ZrHRyNOEKiBzjHYlxD4AnAb8p8%3D&reserved=0
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> I have included all the KIPs that are
>> currently
>>>>> approved,
>>>>>>>>>>>>>>>>> but I am happy to make adjustments as
>>> necessary.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> The KIP freeze is Jan 27th.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Please let me know if you have any
>> objections.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>> -John
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Wed, 2021-01-06 at 23:30 -0600, John
>> Roesler
>>>>> wrote:
>>>>>>>>>>>>>>>>>> Hello All,
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> I'd like to volunteer to be the release
>>> manager
>>>>> for our next
>>>>>>>>>>>>>>>>>> feature release, 2.8.0. If there are no
>>>>> objections, I'll
>>>>>>>>>>>>>>>>>> send out the release plan soon.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>> John Roesler
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>
>>>>>
>>>>>
>>>
>>>
>>>
>>
>

Re: [DISCUSS] Apache Kafka 2.8.0 release

Posted by Walker Carlson <wc...@confluent.io.INVALID>.

Hello John,

We found a Blocker for 2.8 in our streams soak environment.
https://issues.apache.org/jira/browse/KAFKA-12462
    - We found a case where a StreamThread can try to transition
to PARTITIONS_REVOKED when it was already in PENDING_SHUTDOWN causing an
IllegalStateException.

Will have a PR for a fix soon

Walker

On Tue, Mar 2, 2021 at 2:41 PM Dhruvil Shah <dh...@confluent.io> wrote:

> Thanks, John. The fix for KAFKA-12254 is now merged into 2.8.
>
> On Tue, Mar 2, 2021 at 11:54 AM John Roesler <vv...@apache.org> wrote:
>
> > Hi Dhruvil,
> >
> > Thanks for this fix. I agree it would be good to get it in
> > for 2.8.0, so I have added it to the fix versions in KAFKA-
> > 12254.
> >
> > Please go ahead and cherry-pick your fix onto the 2.8
> > branch.
> >
> > Thanks!
> > -John
> >
> > On Mon, 2021-03-01 at 09:36 -0800, Dhruvil Shah wrote:
> > > Hi John,
> > >
> > > I would like to bring up
> > https://issues.apache.org/jira/browse/KAFKA-12254
> > > as a blocker candidate for 2.8.0. While this is not a regression, the
> > > issue could lead to data loss in certain cases. The fix is trivial so
> it
> > > may be worth bringing it into 2.8.0. Let me know what you think.
> > >
> > > - Dhruvil
> > >
> > > On Mon, Feb 22, 2021 at 7:50 AM John Roesler <vv...@apache.org>
> > wrote:
> > >
> > > > Thanks for the heads-up, Chia-Ping,
> > > >
> > > > I agree it would be good to include that fix.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Mon, 2021-02-22 at 09:48 +0000, Chia-Ping Tsai wrote:
> > > > > hi John,
> > > > >
> > > > > There is a PR (https://github.com/apache/kafka/pull/10024) fixing
> > > > following test error.
> > > > >
> > > > > 14:00:28 Execution failed for task ':core:test'.
> > > > > 14:00:28 > Process 'Gradle Test Executor 24' finished with non-zero
> > exit
> > > > value 1
> > > > > 14:00:28   This problem might be caused by incorrect test process
> > > > configuration.
> > > > > 14:00:28   Please refer to the test execution section in the User
> > Manual
> > > > at
> > > > >
> > > > > This error obstructs us from running integration tests so I'd like
> to
> > > > push it to 2.8 branch after it gets approved.
> > > > >
> > > > > Best Regards,
> > > > > Chia-Ping
> > > > >
> > > > > On 2021/02/18 16:23:13, "John Roesler" <vv...@apache.org>
> wrote:
> > > > > > Hello again, all.
> > > > > >
> > > > > > This is a notice that we are now in Code Freeze for the 2.8
> branch.
> > > > > >
> > > > > > From now until the release, only fixes for blockers should be
> > merged
> > > > to the release branch. Fixes for failing tests are allowed and
> > encouraged.
> > > > Documentation-only commits are also ok, in case you have forgotten to
> > > > update the docs for some features in 2.8.0.
> > > > > >
> > > > > > Once we have a green build and passing system tests, I will cut
> the
> > > > first RC.
> > > > > >
> > > > > > Thank you,
> > > > > > John
> > > > > >
> > > > > > On Sun, Feb 7, 2021, at 09:59, John Roesler wrote:
> > > > > > > Hello all,
> > > > > > >
> > > > > > > I have just cut the branch for 2.8 and sent the notification
> > > > > > > email to the dev mailing list.
> > > > > > >
> > > > > > > As a reminder, the next checkpoint toward the 2.8.0 release
> > > > > > > is Code Freeze on Feb 17th.
> > > > > > >
> > > > > > > To ensure a high-quality release, we should now focus our
> > > > > > > efforts on stabilizing the 2.8 branch, including resolving
> > > > > > > failures, writing new tests, and fixing documentation.
> > > > > > >
> > > > > > > Thanks as always for your contributions,
> > > > > > > John
> > > > > > >
> > > > > > >
> > > > > > > On Wed, 2021-02-03 at 14:18 -0600, John Roesler wrote:
> > > > > > > > Hello again, all,
> > > > > > > >
> > > > > > > > This is a reminder that today is the Feature Freeze
> > > > > > > > deadline. To avoid any last-minute crunch or time-zone
> > > > > > > > unfairness, I'll cut the branch toward the end of the week.
> > > > > > > >
> > > > > > > > Please wrap up your features and transition fully into a
> > > > > > > > stabilization mode. The next checkpoint is Code Freeze on
> > > > > > > > Feb 17th.
> > > > > > > >
> > > > > > > > Thanks as always for all of your contributions,
> > > > > > > > John
> > > > > > > >
> > > > > > > > On Wed, 2021-01-27 at 12:17 -0600, John Roesler wrote:
> > > > > > > > > Hello again, all.
> > > > > > > > >
> > > > > > > > > This is a reminder that *today* is the KIP freeze for
> Apache
> > > > > > > > > Kafka 2.8.0.
> > > > > > > > >
> > > > > > > > > The next checkpoint is the Feature Freeze on Feb 3rd.
> > > > > > > > >
> > > > > > > > > When considering any last-minute KIPs today, please be
> > > > > > > > > mindful of the scope, since we have only one week to merge
> a
> > > > > > > > > stable implementation of the KIP.
> > > > > > > > >
> > > > > > > > > For those whose KIPs have been accepted already, please
> work
> > > > > > > > > closely with your reviewers so that your features can be
> > > > > > > > > merged in a stable form in before the Feb 3rd cutoff. Also,
> > > > > > > > > don't forget to update the documentation as part of your
> > > > > > > > > feature.
> > > > > > > > >
> > > > > > > > > Finally, as a gentle reminder to all contributors. There
> > > > > > > > > seems to have been a recent increase in test and system
> test
> > > > > > > > > failures. Please take some time starting now to stabilize
> > > > > > > > > the codebase so we can ensure a high quality and timely
> > > > > > > > > 2.8.0 release!
> > > > > > > > >
> > > > > > > > > Thanks to all of you for your contributions,
> > > > > > > > > John
> > > > > > > > >
> > > > > > > > > On Sat, 2021-01-23 at 18:15 +0300, Ivan Ponomarev wrote:
> > > > > > > > > > Hi John,
> > > > > > > > > >
> > > > > > > > > > KIP-418 is already implemented and reviewed, but I don't
> > see
> > > > it in the
> > > > > > > > > > release plan. Can it be added?
> > > > > > > > > >
> > > > > > > > > >
> > > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-418%3A+A+method-chaining+way+to+branch+KStream
> > > > > > > > > >
> > > > > > > > > > Regards,
> > > > > > > > > >
> > > > > > > > > > Ivan
> > > > > > > > > >
> > > > > > > > > > 22.01.2021 21:49, John Roesler пишет:
> > > > > > > > > > > Sure thing, Leah!
> > > > > > > > > > > -John
> > > > > > > > > > > On Thu, Jan 21, 2021, at 07:54, Leah Thomas wrote:
> > > > > > > > > > > > Hi John,
> > > > > > > > > > > >
> > > > > > > > > > > > KIP-659 was just accepted as well, can it be added to
> > the
> > > > release plan?
> > > > > > > > > > > >
> > > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > > > Leah
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, Jan 14, 2021 at 9:36 AM John Roesler <
> > > > vvcephei@apache.org> wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > Hi David,
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks for the heads-up; it's added.
> > > > > > > > > > > > >
> > > > > > > > > > > > > -John
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, 2021-01-14 at 08:43 +0100, David Jacot
> wrote:
> > > > > > > > > > > > > > Hi John,
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > KIP-700 just got accepted. Can we add it to the
> > > > release plan?
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-700%3A+Add+Describe+Cluster+API
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Thanks,
> > > > > > > > > > > > > > David
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Wed, Jan 13, 2021 at 11:22 PM John Roesler <
> > > > vvcephei@apache.org>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Thanks, Gary! Sorry for the oversight.
> > > > > > > > > > > > > > > -John
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Wed, 2021-01-13 at 21:25 +0000, Gary Russell
> > > > wrote:
> > > > > > > > > > > > > > > > Can you add a link to the summary page [1]?
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > I always start there.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Thanks
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > [1]:
> > > > > > > > > > > > > > >
> > > >
> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan
> > > > > > > > > > > > > > > > Future release plan - Apache Kafka - Apache
> > > > Software Foundation<
> > > > > > > > > > > > > > >
> > > >
> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan>
> > > > > > > > > > > > > > > > Release Plan 0.10.0; Release Plan 0.10.1;
> > Release
> > > > Plan 0.10.2.0;
> > > > > > > > > > > > > Release
> > > > > > > > > > > > > > > Plan 0.10.2.2; Release Plan 0.11.0.0; Release
> > Plan
> > > > 0.11.0.3; Release
> > > > > > > > > > > > > Plan
> > > > > > > > > > > > > > > 1.0.0 (2017 Oct.)
> > > > > > > > > > > > > > > > cwiki.apache.org
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > ________________________________
> > > > > > > > > > > > > > > > From: John Roesler <vv...@apache.org>
> > > > > > > > > > > > > > > > Sent: Wednesday, January 13, 2021 4:11 PM
> > > > > > > > > > > > > > > > To: dev@kafka.apache.org <
> dev@kafka.apache.org
> > >
> > > > > > > > > > > > > > > > Subject: Re: [DISCUSS] Apache Kafka 2.8.0
> > release
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Hello again, all,
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > I have published a release plan at
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fpages%2Fviewpage.action%3FpageId%3D173081737&data=04%7C01%7Cgrussell%40vmware.com%7C6bb299de16bf4730c73608d8b8079404%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637461689989420036%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=8RfiDJZRr%2BZ1S46I5ZrHRyNOEKiBzjHYlxD4AnAb8p8%3D&reserved=0
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > I have included all the KIPs that are
> currently
> > > > approved,
> > > > > > > > > > > > > > > > but I am happy to make adjustments as
> > necessary.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > The KIP freeze is Jan 27th.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Please let me know if you have any
> objections.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Thanks,
> > > > > > > > > > > > > > > > -John
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Wed, 2021-01-06 at 23:30 -0600, John
> Roesler
> > > > wrote:
> > > > > > > > > > > > > > > > > Hello All,
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > I'd like to volunteer to be the release
> > manager
> > > > for our next
> > > > > > > > > > > > > > > > > feature release, 2.8.0. If there are no
> > > > objections, I'll
> > > > > > > > > > > > > > > > > send out the release plan soon.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > Thanks,
> > > > > > > > > > > > > > > > > John Roesler
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > >
> > > >
> > > >
> >
> >
> >
>