You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Luke Chen <sh...@gmail.com> on 2023/05/24 10:11:24 UTC
[VOTE] 3.4.1 RC2
Hello Kafka users, developers and client-developers,
This is the 3rd candidate for release of Apache Kafka 3.4.1.
This is a bugfix release with several fixes since the release of 3.4.0. A
few of the major issues include:
- core
KAFKA-14644 <https://issues.apache.org/jira/browse/KAFKA-14644> Process
should stop after failure in raft IO thread
KAFKA-14946 <https://issues.apache.org/jira/browse/KAFKA-14946> KRaft
controller node shutting down while renouncing leadership
KAFKA-14887 <https://issues.apache.org/jira/browse/KAFKA-14887> ZK session
timeout can cause broker to shutdown
- client
KAFKA-14639 <https://issues.apache.org/jira/browse/KAFKA-14639> Kafka
CooperativeStickyAssignor revokes/assigns partition in one rebalance cycle
- connect
KAFKA-12558 <https://issues.apache.org/jira/browse/KAFKA-12558> MM2 may not
sync partition offsets correctly
KAFKA-14666 <https://issues.apache.org/jira/browse/KAFKA-14666> MM2 should
translate consumer group offsets behind replication flow
- stream
KAFKA-14172 <https://issues.apache.org/jira/browse/KAFKA-14172> bug: State
stores lose state when tasks are reassigned under EOS
Release notes for the 3.4.1 release:
https://home.apache.org/~showuon/kafka-3.4.1-rc2/RELEASE_NOTES.html
*** Please download, test and vote by May 31, 2023
Kafka's KEYS file containing PGP keys we use to sign the release:
https://kafka.apache.org/KEYS
* Release artifacts to be voted upon (source and binary):
https://home.apache.org/~showuon/kafka-3.4.1-rc2/
* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/org/apache/kafka/
* Javadoc:
https://home.apache.org/~showuon/kafka-3.4.1-rc2/javadoc/
* Tag to be voted upon (off 3.4 branch) is the 3.4.1 tag:
https://github.com/apache/kafka/releases/tag/3.4.1-rc2
* Documentation: (will be updated after released)
https://kafka.apache.org/34/documentation.html
* Protocol: (will be updated after released)
https://kafka.apache.org/34/protocol.html
The most recent build has had test failures. These all appear to be due to
flakiness, but it would be nice if someone more familiar with the failed
tests could confirm this. I may update this thread with passing build links
if I can get one, or start a new release vote thread if test failures must
be addressed beyond re-running builds until they pass.
Unit/integration tests:
https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.4/138/
System tests:
Will update the results later
Hope this will be the final RC for v3.4.1!
Thank you.
Luke
Re: [VOTE] 3.4.1 RC2
Posted by Luke Chen <sh...@gmail.com>.
Thanks all for helping verify the RC2.
But my team member found a bug that in KRaft mode, we'll log every commit
message in info level, with `handleSnapshot: xxx`.
That means, in KRaft mode, the active controller log will be flooded with
this message every 500ms (default no-op message commit interval).
I've opened a PR to fix it: https://github.com/apache/kafka/pull/13763.
After this PR merged, I'll create another RC.
Thank you.
Luke
On Thu, May 25, 2023 at 2:53 AM Josep Prat <jo...@aiven.io.invalid>
wrote:
> Hi Luke,
>
> Thanks for your patience during this release.
>
> I ran the following validation steps:
> - Built from source with Java 11 and Scala 2.13
> - Signatures and hashes of the artifacts generated
> - Navigated through Javadoc including links to JDK classes
> - Run the unit tests
> - Run integration tests
> - Run the quickstart in KRaft and Zookeeper mode
> - Checked that the diff in LICENSE-binary (between this and previous RC) is
> correct
> -- For each difference I checked the binary on the scala 2.13 package had
> the version specified in the file
>
> This gets a +1 from me.
>
>
> Best,
>
> On Wed, May 24, 2023 at 6:48 PM Federico Valeri <fe...@gmail.com>
> wrote:
>
> > Hi Luke, these are the things I checked:
> >
> > - Source signature, checksum and license file
> > - Build from source with Java 17 and Scala 2.13
> > - Unit and integration test suites
> > - Java app with staging Maven artifacts
> >
> > +1 (non binding)
> >
> > Thanks
> > Fede
> >
> >
> > On Wed, May 24, 2023 at 6:36 PM Chris Egerton <ch...@aiven.io.invalid>
> > wrote:
> > >
> > > Hi Luke,
> > >
> > > Thanks again for running this release! Echoing your hopes that this
> will
> > be
> > > the final 3.4.1 release candidate :)
> > >
> > > To verify, I:
> > > - Built from source with Java 11 with both:
> > > - - the 3.4.1-rc2 tag on GitHub
> > > - - the kafka-3.4.1-src.tgz artifact from
> > > https://home.apache.org/~showuon/kafka-3.4.1-rc2/
> > > - Checked signatures and checksums
> > > - Ran the quickstart using the kafka_2.13-3.4.1.tgz artifact from
> > > https://home.apache.org/~showuon/kafka-3.4.1-rc2/ with Java 11 and
> > Scala 13
> > > in KRaft mode
> > > - Ran all unit tests
> > > - - No failures this time! 🙌
> > > - Ran all integration tests for Connect and MM2
> > >
> > > +1 (binding)
> > >
> > > Cheers,
> > >
> > > Chris
> > >
> > > On Wed, May 24, 2023 at 6:12 AM Luke Chen <sh...@gmail.com> wrote:
> > >
> > > > Hello Kafka users, developers and client-developers,
> > > >
> > > > This is the 3rd candidate for release of Apache Kafka 3.4.1.
> > > >
> > > > This is a bugfix release with several fixes since the release of
> > 3.4.0. A
> > > > few of the major issues include:
> > > > - core
> > > > KAFKA-14644 <https://issues.apache.org/jira/browse/KAFKA-14644>
> > Process
> > > > should stop after failure in raft IO thread
> > > > KAFKA-14946 <https://issues.apache.org/jira/browse/KAFKA-14946>
> KRaft
> > > > controller node shutting down while renouncing leadership
> > > > KAFKA-14887 <https://issues.apache.org/jira/browse/KAFKA-14887> ZK
> > session
> > > > timeout can cause broker to shutdown
> > > > - client
> > > > KAFKA-14639 <https://issues.apache.org/jira/browse/KAFKA-14639>
> Kafka
> > > > CooperativeStickyAssignor revokes/assigns partition in one rebalance
> > cycle
> > > > - connect
> > > > KAFKA-12558 <https://issues.apache.org/jira/browse/KAFKA-12558> MM2
> > may
> > > > not
> > > > sync partition offsets correctly
> > > > KAFKA-14666 <https://issues.apache.org/jira/browse/KAFKA-14666> MM2
> > should
> > > > translate consumer group offsets behind replication flow
> > > > - stream
> > > > KAFKA-14172 <https://issues.apache.org/jira/browse/KAFKA-14172> bug:
> > State
> > > > stores lose state when tasks are reassigned under EOS
> > > >
> > > >
> > > > Release notes for the 3.4.1 release:
> > > > https://home.apache.org/~showuon/kafka-3.4.1-rc2/RELEASE_NOTES.html
> > > >
> > > > *** Please download, test and vote by May 31, 2023
> > > >
> > > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > > https://kafka.apache.org/KEYS
> > > >
> > > > * Release artifacts to be voted upon (source and binary):
> > > > https://home.apache.org/~showuon/kafka-3.4.1-rc2/
> > > >
> > > > * Maven artifacts to be voted upon:
> > > >
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
> > > >
> > > > * Javadoc:
> > > > https://home.apache.org/~showuon/kafka-3.4.1-rc2/javadoc/
> > > >
> > > > * Tag to be voted upon (off 3.4 branch) is the 3.4.1 tag:
> > > > https://github.com/apache/kafka/releases/tag/3.4.1-rc2
> > > >
> > > > * Documentation: (will be updated after released)
> > > > https://kafka.apache.org/34/documentation.html
> > > >
> > > > * Protocol: (will be updated after released)
> > > > https://kafka.apache.org/34/protocol.html
> > > > The most recent build has had test failures. These all appear to be
> > due to
> > > > flakiness, but it would be nice if someone more familiar with the
> > failed
> > > > tests could confirm this. I may update this thread with passing build
> > links
> > > > if I can get one, or start a new release vote thread if test failures
> > must
> > > > be addressed beyond re-running builds until they pass.
> > > >
> > > > Unit/integration tests:
> > > > https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.4/138/
> > > >
> > > > System tests:
> > > > Will update the results later
> > > >
> > > > Hope this will be the final RC for v3.4.1!
> > > >
> > > > Thank you.
> > > > Luke
> > > >
> >
>
>
> --
> [image: Aiven] <https://www.aiven.io>
>
> *Josep Prat*
> Open Source Engineering Director, *Aiven*
> josep.prat@aiven.io | +491715557497
> aiven.io <https://www.aiven.io> | <https://www.facebook.com/aivencloud
> >
> <https://www.linkedin.com/company/aiven/> <
> https://twitter.com/aiven_io>
> *Aiven Deutschland GmbH*
> Alexanderufer 3-7, 10117 Berlin
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> Amtsgericht Charlottenburg, HRB 209739 B
>
Re: [VOTE] 3.4.1 RC2
Posted by Josep Prat <jo...@aiven.io.INVALID>.
Hi Luke,
Thanks for your patience during this release.
I ran the following validation steps:
- Built from source with Java 11 and Scala 2.13
- Signatures and hashes of the artifacts generated
- Navigated through Javadoc including links to JDK classes
- Run the unit tests
- Run integration tests
- Run the quickstart in KRaft and Zookeeper mode
- Checked that the diff in LICENSE-binary (between this and previous RC) is
correct
-- For each difference I checked the binary on the scala 2.13 package had
the version specified in the file
This gets a +1 from me.
Best,
On Wed, May 24, 2023 at 6:48 PM Federico Valeri <fe...@gmail.com>
wrote:
> Hi Luke, these are the things I checked:
>
> - Source signature, checksum and license file
> - Build from source with Java 17 and Scala 2.13
> - Unit and integration test suites
> - Java app with staging Maven artifacts
>
> +1 (non binding)
>
> Thanks
> Fede
>
>
> On Wed, May 24, 2023 at 6:36 PM Chris Egerton <ch...@aiven.io.invalid>
> wrote:
> >
> > Hi Luke,
> >
> > Thanks again for running this release! Echoing your hopes that this will
> be
> > the final 3.4.1 release candidate :)
> >
> > To verify, I:
> > - Built from source with Java 11 with both:
> > - - the 3.4.1-rc2 tag on GitHub
> > - - the kafka-3.4.1-src.tgz artifact from
> > https://home.apache.org/~showuon/kafka-3.4.1-rc2/
> > - Checked signatures and checksums
> > - Ran the quickstart using the kafka_2.13-3.4.1.tgz artifact from
> > https://home.apache.org/~showuon/kafka-3.4.1-rc2/ with Java 11 and
> Scala 13
> > in KRaft mode
> > - Ran all unit tests
> > - - No failures this time! 🙌
> > - Ran all integration tests for Connect and MM2
> >
> > +1 (binding)
> >
> > Cheers,
> >
> > Chris
> >
> > On Wed, May 24, 2023 at 6:12 AM Luke Chen <sh...@gmail.com> wrote:
> >
> > > Hello Kafka users, developers and client-developers,
> > >
> > > This is the 3rd candidate for release of Apache Kafka 3.4.1.
> > >
> > > This is a bugfix release with several fixes since the release of
> 3.4.0. A
> > > few of the major issues include:
> > > - core
> > > KAFKA-14644 <https://issues.apache.org/jira/browse/KAFKA-14644>
> Process
> > > should stop after failure in raft IO thread
> > > KAFKA-14946 <https://issues.apache.org/jira/browse/KAFKA-14946> KRaft
> > > controller node shutting down while renouncing leadership
> > > KAFKA-14887 <https://issues.apache.org/jira/browse/KAFKA-14887> ZK
> session
> > > timeout can cause broker to shutdown
> > > - client
> > > KAFKA-14639 <https://issues.apache.org/jira/browse/KAFKA-14639> Kafka
> > > CooperativeStickyAssignor revokes/assigns partition in one rebalance
> cycle
> > > - connect
> > > KAFKA-12558 <https://issues.apache.org/jira/browse/KAFKA-12558> MM2
> may
> > > not
> > > sync partition offsets correctly
> > > KAFKA-14666 <https://issues.apache.org/jira/browse/KAFKA-14666> MM2
> should
> > > translate consumer group offsets behind replication flow
> > > - stream
> > > KAFKA-14172 <https://issues.apache.org/jira/browse/KAFKA-14172> bug:
> State
> > > stores lose state when tasks are reassigned under EOS
> > >
> > >
> > > Release notes for the 3.4.1 release:
> > > https://home.apache.org/~showuon/kafka-3.4.1-rc2/RELEASE_NOTES.html
> > >
> > > *** Please download, test and vote by May 31, 2023
> > >
> > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > https://kafka.apache.org/KEYS
> > >
> > > * Release artifacts to be voted upon (source and binary):
> > > https://home.apache.org/~showuon/kafka-3.4.1-rc2/
> > >
> > > * Maven artifacts to be voted upon:
> > > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> > >
> > > * Javadoc:
> > > https://home.apache.org/~showuon/kafka-3.4.1-rc2/javadoc/
> > >
> > > * Tag to be voted upon (off 3.4 branch) is the 3.4.1 tag:
> > > https://github.com/apache/kafka/releases/tag/3.4.1-rc2
> > >
> > > * Documentation: (will be updated after released)
> > > https://kafka.apache.org/34/documentation.html
> > >
> > > * Protocol: (will be updated after released)
> > > https://kafka.apache.org/34/protocol.html
> > > The most recent build has had test failures. These all appear to be
> due to
> > > flakiness, but it would be nice if someone more familiar with the
> failed
> > > tests could confirm this. I may update this thread with passing build
> links
> > > if I can get one, or start a new release vote thread if test failures
> must
> > > be addressed beyond re-running builds until they pass.
> > >
> > > Unit/integration tests:
> > > https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.4/138/
> > >
> > > System tests:
> > > Will update the results later
> > >
> > > Hope this will be the final RC for v3.4.1!
> > >
> > > Thank you.
> > > Luke
> > >
>
--
[image: Aiven] <https://www.aiven.io>
*Josep Prat*
Open Source Engineering Director, *Aiven*
josep.prat@aiven.io | +491715557497
aiven.io <https://www.aiven.io> | <https://www.facebook.com/aivencloud>
<https://www.linkedin.com/company/aiven/> <https://twitter.com/aiven_io>
*Aiven Deutschland GmbH*
Alexanderufer 3-7, 10117 Berlin
Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
Amtsgericht Charlottenburg, HRB 209739 B
Re: [VOTE] 3.4.1 RC2
Posted by Federico Valeri <fe...@gmail.com>.
Hi Luke, these are the things I checked:
- Source signature, checksum and license file
- Build from source with Java 17 and Scala 2.13
- Unit and integration test suites
- Java app with staging Maven artifacts
+1 (non binding)
Thanks
Fede
On Wed, May 24, 2023 at 6:36 PM Chris Egerton <ch...@aiven.io.invalid> wrote:
>
> Hi Luke,
>
> Thanks again for running this release! Echoing your hopes that this will be
> the final 3.4.1 release candidate :)
>
> To verify, I:
> - Built from source with Java 11 with both:
> - - the 3.4.1-rc2 tag on GitHub
> - - the kafka-3.4.1-src.tgz artifact from
> https://home.apache.org/~showuon/kafka-3.4.1-rc2/
> - Checked signatures and checksums
> - Ran the quickstart using the kafka_2.13-3.4.1.tgz artifact from
> https://home.apache.org/~showuon/kafka-3.4.1-rc2/ with Java 11 and Scala 13
> in KRaft mode
> - Ran all unit tests
> - - No failures this time! 🙌
> - Ran all integration tests for Connect and MM2
>
> +1 (binding)
>
> Cheers,
>
> Chris
>
> On Wed, May 24, 2023 at 6:12 AM Luke Chen <sh...@gmail.com> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the 3rd candidate for release of Apache Kafka 3.4.1.
> >
> > This is a bugfix release with several fixes since the release of 3.4.0. A
> > few of the major issues include:
> > - core
> > KAFKA-14644 <https://issues.apache.org/jira/browse/KAFKA-14644> Process
> > should stop after failure in raft IO thread
> > KAFKA-14946 <https://issues.apache.org/jira/browse/KAFKA-14946> KRaft
> > controller node shutting down while renouncing leadership
> > KAFKA-14887 <https://issues.apache.org/jira/browse/KAFKA-14887> ZK session
> > timeout can cause broker to shutdown
> > - client
> > KAFKA-14639 <https://issues.apache.org/jira/browse/KAFKA-14639> Kafka
> > CooperativeStickyAssignor revokes/assigns partition in one rebalance cycle
> > - connect
> > KAFKA-12558 <https://issues.apache.org/jira/browse/KAFKA-12558> MM2 may
> > not
> > sync partition offsets correctly
> > KAFKA-14666 <https://issues.apache.org/jira/browse/KAFKA-14666> MM2 should
> > translate consumer group offsets behind replication flow
> > - stream
> > KAFKA-14172 <https://issues.apache.org/jira/browse/KAFKA-14172> bug: State
> > stores lose state when tasks are reassigned under EOS
> >
> >
> > Release notes for the 3.4.1 release:
> > https://home.apache.org/~showuon/kafka-3.4.1-rc2/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by May 31, 2023
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~showuon/kafka-3.4.1-rc2/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~showuon/kafka-3.4.1-rc2/javadoc/
> >
> > * Tag to be voted upon (off 3.4 branch) is the 3.4.1 tag:
> > https://github.com/apache/kafka/releases/tag/3.4.1-rc2
> >
> > * Documentation: (will be updated after released)
> > https://kafka.apache.org/34/documentation.html
> >
> > * Protocol: (will be updated after released)
> > https://kafka.apache.org/34/protocol.html
> > The most recent build has had test failures. These all appear to be due to
> > flakiness, but it would be nice if someone more familiar with the failed
> > tests could confirm this. I may update this thread with passing build links
> > if I can get one, or start a new release vote thread if test failures must
> > be addressed beyond re-running builds until they pass.
> >
> > Unit/integration tests:
> > https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.4/138/
> >
> > System tests:
> > Will update the results later
> >
> > Hope this will be the final RC for v3.4.1!
> >
> > Thank you.
> > Luke
> >
Re: [VOTE] 3.4.1 RC2
Posted by Chris Egerton <ch...@aiven.io.INVALID>.
Hi Luke,
Thanks again for running this release! Echoing your hopes that this will be
the final 3.4.1 release candidate :)
To verify, I:
- Built from source with Java 11 with both:
- - the 3.4.1-rc2 tag on GitHub
- - the kafka-3.4.1-src.tgz artifact from
https://home.apache.org/~showuon/kafka-3.4.1-rc2/
- Checked signatures and checksums
- Ran the quickstart using the kafka_2.13-3.4.1.tgz artifact from
https://home.apache.org/~showuon/kafka-3.4.1-rc2/ with Java 11 and Scala 13
in KRaft mode
- Ran all unit tests
- - No failures this time! 🙌
- Ran all integration tests for Connect and MM2
+1 (binding)
Cheers,
Chris
On Wed, May 24, 2023 at 6:12 AM Luke Chen <sh...@gmail.com> wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the 3rd candidate for release of Apache Kafka 3.4.1.
>
> This is a bugfix release with several fixes since the release of 3.4.0. A
> few of the major issues include:
> - core
> KAFKA-14644 <https://issues.apache.org/jira/browse/KAFKA-14644> Process
> should stop after failure in raft IO thread
> KAFKA-14946 <https://issues.apache.org/jira/browse/KAFKA-14946> KRaft
> controller node shutting down while renouncing leadership
> KAFKA-14887 <https://issues.apache.org/jira/browse/KAFKA-14887> ZK session
> timeout can cause broker to shutdown
> - client
> KAFKA-14639 <https://issues.apache.org/jira/browse/KAFKA-14639> Kafka
> CooperativeStickyAssignor revokes/assigns partition in one rebalance cycle
> - connect
> KAFKA-12558 <https://issues.apache.org/jira/browse/KAFKA-12558> MM2 may
> not
> sync partition offsets correctly
> KAFKA-14666 <https://issues.apache.org/jira/browse/KAFKA-14666> MM2 should
> translate consumer group offsets behind replication flow
> - stream
> KAFKA-14172 <https://issues.apache.org/jira/browse/KAFKA-14172> bug: State
> stores lose state when tasks are reassigned under EOS
>
>
> Release notes for the 3.4.1 release:
> https://home.apache.org/~showuon/kafka-3.4.1-rc2/RELEASE_NOTES.html
>
> *** Please download, test and vote by May 31, 2023
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~showuon/kafka-3.4.1-rc2/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~showuon/kafka-3.4.1-rc2/javadoc/
>
> * Tag to be voted upon (off 3.4 branch) is the 3.4.1 tag:
> https://github.com/apache/kafka/releases/tag/3.4.1-rc2
>
> * Documentation: (will be updated after released)
> https://kafka.apache.org/34/documentation.html
>
> * Protocol: (will be updated after released)
> https://kafka.apache.org/34/protocol.html
> The most recent build has had test failures. These all appear to be due to
> flakiness, but it would be nice if someone more familiar with the failed
> tests could confirm this. I may update this thread with passing build links
> if I can get one, or start a new release vote thread if test failures must
> be addressed beyond re-running builds until they pass.
>
> Unit/integration tests:
> https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.4/138/
>
> System tests:
> Will update the results later
>
> Hope this will be the final RC for v3.4.1!
>
> Thank you.
> Luke
>