You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Manikumar <ma...@gmail.com> on 2019/11/30 17:48:57 UTC
[VOTE] 2.4.0 RC2
Hello Kafka users, developers and client-developers,
This is the third candidate for release of Apache Kafka 2.4.0.
This release includes many new features, including:
- Allow consumers to fetch from closest replica
- Support for incremental cooperative rebalancing to the consumer rebalance
protocol
- MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
engine
- New Java authorizer Interface
- Support for non-key joining in KTable
- Administrative API for replica reassignment
- Sticky partitioner
- Return topic metadata and configs in CreateTopics response
- Securing Internal connect REST endpoints
- API to delete consumer offsets and expose it via the AdminClient.
Release notes for the 2.4.0 release:
https://home.apache.org/~manikumar/kafka-2.4.0-rc2/RELEASE_NOTES.html
*** Please download, test and vote by Thursday, December 5th, 9am PT
Kafka's KEYS file containing PGP keys we use to sign the release:
https://kafka.apache.org/KEYS
* Release artifacts to be voted upon (source and binary):
https://home.apache.org/~manikumar/kafka-2.4.0-rc2/
* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/org/apache/kafka/
* Javadoc:
https://home.apache.org/~manikumar/kafka-2.4.0-rc2/javadoc/
* Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
https://github.com/apache/kafka/releases/tag/2.4.0-rc2
* Documentation:
https://kafka.apache.org/24/documentation.html
* Protocol:
https://kafka.apache.org/24/protocol.html
Thanks,
Manikumar
Re: [VOTE] 2.4.0 RC2
Posted by John Roesler <vv...@apache.org>.
Hi Manikumar,
I've just resolved https://issues.apache.org/jira/browse/KAFKA-9231 . Sorry for the hold-up.
Thanks,
-John
On Tue, Dec 3, 2019, at 10:27, Manikumar wrote:
> Hi,
>
> Thank you all for reporting the issues.
>
> We'll consider the below JIRAs as blockers for 2.4.0 release.
> https://issues.apache.org/jira/browse/KAFKA-9231
> https://issues.apache.org/jira/browse/KAFKA-9258
> https://issues.apache.org/jira/browse/KAFKA-9156
>
> I will create new release candidate after merging the PRs for above JIRAs.
>
> @Eric
> Thanks for actively verifying the releases. I'll will run the failed test
> locally.
>
> Thanks,
>
> On Tue, Dec 3, 2019 at 3:01 AM Eric Lalonde <er...@autonomic.ai> wrote:
>
> > Hi all,
> >
> > I ran the following:
> >
> > $ git clone https://github.com/elalonde/kafka <
> > https://github.com/elalonde/kafka>
> > $ ./kafka/bin/verifykafka-rc.sh 2.4.0
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc2 <
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc2>
> >
> > - All sha1, sha256 and md5 sums look good
> > - pgp signatures look good
> > - unit tests pass
> > - Integration tests pass with the following issue:
> >
> > <=------------> 12% EXECUTING [30m 21s]
> > <=------------> 12% EXECUTING [30m 22s]mpleted, 16 skipped
> > > IDLE
> > <=------------> 12% EXECUTING [30m 27s]
> > > IDLE
> > > IDLE
> > > IDLE
> > > :core:integrationTest > Executing test
> > kafka.api.AuthorizerIntegrationTest
> > > IDLE
> > > IDLE
> >
> >
> > After 30 minutes the above test had not finished, seemed stalled, so I
> > cancelled it. LMK if I am overly impatient.
> >
> >
>
Re: [VOTE] 2.4.0 RC2
Posted by Manikumar <ma...@gmail.com>.
Hi all,
We merged all the blockers and released a new release candidate RC3.
Hopefully this will be a final RC for 2.4 release.
Thanks,
On Thu, Dec 5, 2019 at 6:56 AM Israel Ekpo <is...@gmail.com> wrote:
> Thanks @Randall for the update. I will run the tests on RC3 when it becomes
> available.
>
> On Wed, Dec 4, 2019 at 12:42 PM Randall Hauch <rh...@gmail.com> wrote:
>
> > Ah, I merged https://issues.apache.org/jira/browse/KAFKA-9258 last night
> > and forgot to send an email to this thread.
> >
> > Thanks!
> >
> > Randall
> >
> > On Wed, Dec 4, 2019 at 10:42 AM Eric Lalonde <er...@autonomic.ai> wrote:
> >
> > > > I have also shared a pull request for the changes I have made to the
> > test
> > > > script
> > > >
> > > > https://github.com/elalonde/kafka/pull/2
> > >
> > >
> > > Thanks, this has been merged.
> > >
> >
>
Re: [VOTE] 2.4.0 RC2
Posted by Manikumar <ma...@gmail.com>.
Hi all,
We merged all the blockers and released a new release candidate RC3.
Hopefully this will be a final RC for 2.4 release.
Thanks,
On Thu, Dec 5, 2019 at 6:56 AM Israel Ekpo <is...@gmail.com> wrote:
> Thanks @Randall for the update. I will run the tests on RC3 when it becomes
> available.
>
> On Wed, Dec 4, 2019 at 12:42 PM Randall Hauch <rh...@gmail.com> wrote:
>
> > Ah, I merged https://issues.apache.org/jira/browse/KAFKA-9258 last night
> > and forgot to send an email to this thread.
> >
> > Thanks!
> >
> > Randall
> >
> > On Wed, Dec 4, 2019 at 10:42 AM Eric Lalonde <er...@autonomic.ai> wrote:
> >
> > > > I have also shared a pull request for the changes I have made to the
> > test
> > > > script
> > > >
> > > > https://github.com/elalonde/kafka/pull/2
> > >
> > >
> > > Thanks, this has been merged.
> > >
> >
>
Re: [VOTE] 2.4.0 RC2
Posted by Israel Ekpo <is...@gmail.com>.
Thanks @Randall for the update. I will run the tests on RC3 when it becomes
available.
On Wed, Dec 4, 2019 at 12:42 PM Randall Hauch <rh...@gmail.com> wrote:
> Ah, I merged https://issues.apache.org/jira/browse/KAFKA-9258 last night
> and forgot to send an email to this thread.
>
> Thanks!
>
> Randall
>
> On Wed, Dec 4, 2019 at 10:42 AM Eric Lalonde <er...@autonomic.ai> wrote:
>
> > > I have also shared a pull request for the changes I have made to the
> test
> > > script
> > >
> > > https://github.com/elalonde/kafka/pull/2
> >
> >
> > Thanks, this has been merged.
> >
>
Re: [VOTE] 2.4.0 RC2
Posted by Israel Ekpo <is...@gmail.com>.
Thanks @Randall for the update. I will run the tests on RC3 when it becomes
available.
On Wed, Dec 4, 2019 at 12:42 PM Randall Hauch <rh...@gmail.com> wrote:
> Ah, I merged https://issues.apache.org/jira/browse/KAFKA-9258 last night
> and forgot to send an email to this thread.
>
> Thanks!
>
> Randall
>
> On Wed, Dec 4, 2019 at 10:42 AM Eric Lalonde <er...@autonomic.ai> wrote:
>
> > > I have also shared a pull request for the changes I have made to the
> test
> > > script
> > >
> > > https://github.com/elalonde/kafka/pull/2
> >
> >
> > Thanks, this has been merged.
> >
>
Re: [VOTE] 2.4.0 RC2
Posted by Randall Hauch <rh...@gmail.com>.
Ah, I merged https://issues.apache.org/jira/browse/KAFKA-9258 last night
and forgot to send an email to this thread.
Thanks!
Randall
On Wed, Dec 4, 2019 at 10:42 AM Eric Lalonde <er...@autonomic.ai> wrote:
> > I have also shared a pull request for the changes I have made to the test
> > script
> >
> > https://github.com/elalonde/kafka/pull/2
>
>
> Thanks, this has been merged.
>
Re: [VOTE] 2.4.0 RC2
Posted by Randall Hauch <rh...@gmail.com>.
Ah, I merged https://issues.apache.org/jira/browse/KAFKA-9258 last night
and forgot to send an email to this thread.
Thanks!
Randall
On Wed, Dec 4, 2019 at 10:42 AM Eric Lalonde <er...@autonomic.ai> wrote:
> > I have also shared a pull request for the changes I have made to the test
> > script
> >
> > https://github.com/elalonde/kafka/pull/2
>
>
> Thanks, this has been merged.
>
Re: [VOTE] 2.4.0 RC2
Posted by Eric Lalonde <er...@autonomic.ai>.
> I have also shared a pull request for the changes I have made to the test
> script
>
> https://github.com/elalonde/kafka/pull/2
Thanks, this has been merged.
Re: [VOTE] 2.4.0 RC2
Posted by Eric Lalonde <er...@autonomic.ai>.
> I have also shared a pull request for the changes I have made to the test
> script
>
> https://github.com/elalonde/kafka/pull/2
Thanks, this has been merged.
Re: [VOTE] 2.4.0 RC2
Posted by Israel Ekpo <is...@gmail.com>.
Thanks Eric for sharing this test script. It simplifies the process for me.
https://github.com/elalonde/kafka/blob/master/bin/verify-kafka-rc.sh
I am in the process of setting up my local environment to start running the
tests on 2.4.0 RC2 as well and I noticed the following artifacts are being
validated
- RELEASE_NOTES.html
- kafka-$VERSION-src.tgz
- kafka_2.11-$VERSION-site-docs.tgz
- kafka_2.11-$VERSION.tgz
- kafka_2.12-$VERSION-site-docs.tgz
- kafka_2.12-$VERSION.tgz
It looks like the Scala 2.13 artifacts were accidentally left out of the
validation sequence.
KAFKA-7197 added support for Scala 2.13, so those artifacts should be
validated as well in the automation script.
https://issues.apache.org/jira/browse/KAFKA-7197
These two artifacts* (kafka_2.13-2.4.0.tgz and
kafka_2.13-2.4.0-site-docs.tgz)* were not included in the loop on line 79
and 89, where the gpg signatures and checksums are verified for validity
https://github.com/elalonde/kafka/blob/master/bin/verify-kafka-rc.sh#L79
I have adjusted my version to add these two artifacts to the checks
RELEASE_NOTES.html
kafka-$VERSION-src.tgz
kafka_2.11-$VERSION-site-docs.tgz
kafka_2.11-$VERSION.tgz
kafka_2.12-$VERSION-site-docs.tgz
kafka_2.12-$VERSION.tgz
*kafka_2.13-$VERSION-site-docs.tgzkafka_2.13-$VERSION.tgz*
I have also shared a pull request for the changes I have made to the test
script
https://github.com/elalonde/kafka/pull/2
Sincerely,
Israel
On Tue, Dec 3, 2019 at 11:28 AM Manikumar <ma...@gmail.com> wrote:
> Hi,
>
> Thank you all for reporting the issues.
>
> We'll consider the below JIRAs as blockers for 2.4.0 release.
> https://issues.apache.org/jira/browse/KAFKA-9231
> https://issues.apache.org/jira/browse/KAFKA-9258
> https://issues.apache.org/jira/browse/KAFKA-9156
>
> I will create new release candidate after merging the PRs for above JIRAs.
>
> @Eric
> Thanks for actively verifying the releases. I'll will run the failed test
> locally.
>
> Thanks,
>
> On Tue, Dec 3, 2019 at 3:01 AM Eric Lalonde <er...@autonomic.ai> wrote:
>
> > Hi all,
> >
> > I ran the following:
> >
> > $ git clone https://github.com/elalonde/kafka <
> > https://github.com/elalonde/kafka>
> > $ ./kafka/bin/verifykafka-rc.sh 2.4.0
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc2 <
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc2>
> >
> > - All sha1, sha256 and md5 sums look good
> > - pgp signatures look good
> > - unit tests pass
> > - Integration tests pass with the following issue:
> >
> > <=------------> 12% EXECUTING [30m 21s]
> > <=------------> 12% EXECUTING [30m 22s]mpleted, 16 skipped
> > > IDLE
> > <=------------> 12% EXECUTING [30m 27s]
> > > IDLE
> > > IDLE
> > > IDLE
> > > :core:integrationTest > Executing test
> > kafka.api.AuthorizerIntegrationTest
> > > IDLE
> > > IDLE
> >
> >
> > After 30 minutes the above test had not finished, seemed stalled, so I
> > cancelled it. LMK if I am overly impatient.
> >
> >
>
Re: [VOTE] 2.4.0 RC2
Posted by Israel Ekpo <is...@gmail.com>.
Thanks Eric for sharing this test script. It simplifies the process for me.
https://github.com/elalonde/kafka/blob/master/bin/verify-kafka-rc.sh
I am in the process of setting up my local environment to start running the
tests on 2.4.0 RC2 as well and I noticed the following artifacts are being
validated
- RELEASE_NOTES.html
- kafka-$VERSION-src.tgz
- kafka_2.11-$VERSION-site-docs.tgz
- kafka_2.11-$VERSION.tgz
- kafka_2.12-$VERSION-site-docs.tgz
- kafka_2.12-$VERSION.tgz
It looks like the Scala 2.13 artifacts were accidentally left out of the
validation sequence.
KAFKA-7197 added support for Scala 2.13, so those artifacts should be
validated as well in the automation script.
https://issues.apache.org/jira/browse/KAFKA-7197
These two artifacts* (kafka_2.13-2.4.0.tgz and
kafka_2.13-2.4.0-site-docs.tgz)* were not included in the loop on line 79
and 89, where the gpg signatures and checksums are verified for validity
https://github.com/elalonde/kafka/blob/master/bin/verify-kafka-rc.sh#L79
I have adjusted my version to add these two artifacts to the checks
RELEASE_NOTES.html
kafka-$VERSION-src.tgz
kafka_2.11-$VERSION-site-docs.tgz
kafka_2.11-$VERSION.tgz
kafka_2.12-$VERSION-site-docs.tgz
kafka_2.12-$VERSION.tgz
*kafka_2.13-$VERSION-site-docs.tgzkafka_2.13-$VERSION.tgz*
I have also shared a pull request for the changes I have made to the test
script
https://github.com/elalonde/kafka/pull/2
Sincerely,
Israel
On Tue, Dec 3, 2019 at 11:28 AM Manikumar <ma...@gmail.com> wrote:
> Hi,
>
> Thank you all for reporting the issues.
>
> We'll consider the below JIRAs as blockers for 2.4.0 release.
> https://issues.apache.org/jira/browse/KAFKA-9231
> https://issues.apache.org/jira/browse/KAFKA-9258
> https://issues.apache.org/jira/browse/KAFKA-9156
>
> I will create new release candidate after merging the PRs for above JIRAs.
>
> @Eric
> Thanks for actively verifying the releases. I'll will run the failed test
> locally.
>
> Thanks,
>
> On Tue, Dec 3, 2019 at 3:01 AM Eric Lalonde <er...@autonomic.ai> wrote:
>
> > Hi all,
> >
> > I ran the following:
> >
> > $ git clone https://github.com/elalonde/kafka <
> > https://github.com/elalonde/kafka>
> > $ ./kafka/bin/verifykafka-rc.sh 2.4.0
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc2 <
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc2>
> >
> > - All sha1, sha256 and md5 sums look good
> > - pgp signatures look good
> > - unit tests pass
> > - Integration tests pass with the following issue:
> >
> > <=------------> 12% EXECUTING [30m 21s]
> > <=------------> 12% EXECUTING [30m 22s]mpleted, 16 skipped
> > > IDLE
> > <=------------> 12% EXECUTING [30m 27s]
> > > IDLE
> > > IDLE
> > > IDLE
> > > :core:integrationTest > Executing test
> > kafka.api.AuthorizerIntegrationTest
> > > IDLE
> > > IDLE
> >
> >
> > After 30 minutes the above test had not finished, seemed stalled, so I
> > cancelled it. LMK if I am overly impatient.
> >
> >
>
Re: [VOTE] 2.4.0 RC2
Posted by Manikumar <ma...@gmail.com>.
Hi,
Thank you all for reporting the issues.
We'll consider the below JIRAs as blockers for 2.4.0 release.
https://issues.apache.org/jira/browse/KAFKA-9231
https://issues.apache.org/jira/browse/KAFKA-9258
https://issues.apache.org/jira/browse/KAFKA-9156
I will create new release candidate after merging the PRs for above JIRAs.
@Eric
Thanks for actively verifying the releases. I'll will run the failed test
locally.
Thanks,
On Tue, Dec 3, 2019 at 3:01 AM Eric Lalonde <er...@autonomic.ai> wrote:
> Hi all,
>
> I ran the following:
>
> $ git clone https://github.com/elalonde/kafka <
> https://github.com/elalonde/kafka>
> $ ./kafka/bin/verifykafka-rc.sh 2.4.0
> https://home.apache.org/~manikumar/kafka-2.4.0-rc2 <
> https://home.apache.org/~manikumar/kafka-2.4.0-rc2>
>
> - All sha1, sha256 and md5 sums look good
> - pgp signatures look good
> - unit tests pass
> - Integration tests pass with the following issue:
>
> <=------------> 12% EXECUTING [30m 21s]
> <=------------> 12% EXECUTING [30m 22s]mpleted, 16 skipped
> > IDLE
> <=------------> 12% EXECUTING [30m 27s]
> > IDLE
> > IDLE
> > IDLE
> > :core:integrationTest > Executing test
> kafka.api.AuthorizerIntegrationTest
> > IDLE
> > IDLE
>
>
> After 30 minutes the above test had not finished, seemed stalled, so I
> cancelled it. LMK if I am overly impatient.
>
>
Re: [VOTE] 2.4.0 RC2
Posted by Christopher Egerton <ch...@confluent.io>.
Hi all,
I'd like to submit https://issues.apache.org/jira/browse/KAFKA-9258 for
blocker consideration. This issue affects the Connect framework and causes
a 500 error to be thrown from the REST API when restarting a task that has
failed during startup, even after the connector has been reconfigured. This
is a regression and does not occur in any versions of Connect prior to 2.4
release candidates. There is a PR already opened for this issue that I've
tested and verified so we should be able to merge quickly if this is
approved as a blocker.
Cheers,
Chris
On Mon, Dec 2, 2019 at 1:31 PM Eric Lalonde <er...@autonomic.ai> wrote:
> Hi all,
>
> I ran the following:
>
> $ git clone https://github.com/elalonde/kafka <
> https://github.com/elalonde/kafka>
> $ ./kafka/bin/verifykafka-rc.sh 2.4.0
> https://home.apache.org/~manikumar/kafka-2.4.0-rc2 <
> https://home.apache.org/~manikumar/kafka-2.4.0-rc2>
>
> - All sha1, sha256 and md5 sums look good
> - pgp signatures look good
> - unit tests pass
> - Integration tests pass with the following issue:
>
> <=------------> 12% EXECUTING [30m 21s]
> <=------------> 12% EXECUTING [30m 22s]mpleted, 16 skipped
> > IDLE
> <=------------> 12% EXECUTING [30m 27s]
> > IDLE
> > IDLE
> > IDLE
> > :core:integrationTest > Executing test
> kafka.api.AuthorizerIntegrationTest
> > IDLE
> > IDLE
>
>
> After 30 minutes the above test had not finished, seemed stalled, so I
> cancelled it. LMK if I am overly impatient.
>
>
Re: [VOTE] 2.4.0 RC2
Posted by Manikumar <ma...@gmail.com>.
Hi,
Thank you all for reporting the issues.
We'll consider the below JIRAs as blockers for 2.4.0 release.
https://issues.apache.org/jira/browse/KAFKA-9231
https://issues.apache.org/jira/browse/KAFKA-9258
https://issues.apache.org/jira/browse/KAFKA-9156
I will create new release candidate after merging the PRs for above JIRAs.
@Eric
Thanks for actively verifying the releases. I'll will run the failed test
locally.
Thanks,
On Tue, Dec 3, 2019 at 3:01 AM Eric Lalonde <er...@autonomic.ai> wrote:
> Hi all,
>
> I ran the following:
>
> $ git clone https://github.com/elalonde/kafka <
> https://github.com/elalonde/kafka>
> $ ./kafka/bin/verifykafka-rc.sh 2.4.0
> https://home.apache.org/~manikumar/kafka-2.4.0-rc2 <
> https://home.apache.org/~manikumar/kafka-2.4.0-rc2>
>
> - All sha1, sha256 and md5 sums look good
> - pgp signatures look good
> - unit tests pass
> - Integration tests pass with the following issue:
>
> <=------------> 12% EXECUTING [30m 21s]
> <=------------> 12% EXECUTING [30m 22s]mpleted, 16 skipped
> > IDLE
> <=------------> 12% EXECUTING [30m 27s]
> > IDLE
> > IDLE
> > IDLE
> > :core:integrationTest > Executing test
> kafka.api.AuthorizerIntegrationTest
> > IDLE
> > IDLE
>
>
> After 30 minutes the above test had not finished, seemed stalled, so I
> cancelled it. LMK if I am overly impatient.
>
>
Re: [VOTE] 2.4.0 RC2
Posted by Eric Lalonde <er...@autonomic.ai>.
Hi all,
I ran the following:
$ git clone https://github.com/elalonde/kafka <https://github.com/elalonde/kafka>
$ ./kafka/bin/verifykafka-rc.sh 2.4.0 https://home.apache.org/~manikumar/kafka-2.4.0-rc2 <https://home.apache.org/~manikumar/kafka-2.4.0-rc2>
- All sha1, sha256 and md5 sums look good
- pgp signatures look good
- unit tests pass
- Integration tests pass with the following issue:
<=------------> 12% EXECUTING [30m 21s]
<=------------> 12% EXECUTING [30m 22s]mpleted, 16 skipped
> IDLE
<=------------> 12% EXECUTING [30m 27s]
> IDLE
> IDLE
> IDLE
> :core:integrationTest > Executing test kafka.api.AuthorizerIntegrationTest
> IDLE
> IDLE
After 30 minutes the above test had not finished, seemed stalled, so I cancelled it. LMK if I am overly impatient.
Re: [VOTE] 2.4.0 RC2
Posted by Eric Lalonde <er...@autonomic.ai>.
Hi all,
I ran the following:
$ git clone https://github.com/elalonde/kafka <https://github.com/elalonde/kafka>
$ ./kafka/bin/verifykafka-rc.sh 2.4.0 https://home.apache.org/~manikumar/kafka-2.4.0-rc2 <https://home.apache.org/~manikumar/kafka-2.4.0-rc2>
- All sha1, sha256 and md5 sums look good
- pgp signatures look good
- unit tests pass
- Integration tests pass with the following issue:
<=------------> 12% EXECUTING [30m 21s]
<=------------> 12% EXECUTING [30m 22s]mpleted, 16 skipped
> IDLE
<=------------> 12% EXECUTING [30m 27s]
> IDLE
> IDLE
> IDLE
> :core:integrationTest > Executing test kafka.api.AuthorizerIntegrationTest
> IDLE
> IDLE
After 30 minutes the above test had not finished, seemed stalled, so I cancelled it. LMK if I am overly impatient.
Re: [VOTE] 2.4.0 RC2
Posted by Ismael Juma <is...@juma.me.uk>.
We have a pull request for KAFKA-9156, which fixes a critical regression
introduced in 2.3.0. I think we should include this in the next (and
hopefully final) 2.4.0 RC.
Ismael
On Sat, Nov 30, 2019 at 12:31 PM John Roesler <vv...@apache.org> wrote:
> Hello all,
>
> I hate to do this, but I've been running a soak test of Kafka Streams on
> 2.4 and uncovered a number of small bugs that lead to Streams losing
> threads until there are none left. This condition only arises when using
> EOS in a highly flaky networking environment.
>
> I've included a lot of details in KAFKA-9231, in particular my last
> comment:
>
> https://issues.apache.org/jira/browse/KAFKA-9231?focusedCommentId=16985429&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16985429
>
> Please take a look and see if you agree whether it warrants cutting a new
> RC early next week once the fix is merged.
>
> Thanks,
> -John
>
> On Sat, Nov 30, 2019, at 11:48 AM, Manikumar wrote:
> > Hello Kafka users, developers and client-developers,
> >
> > This is the third candidate for release of Apache Kafka 2.4.0.
> >
> > This release includes many new features, including:
> > - Allow consumers to fetch from closest replica
> > - Support for incremental cooperative rebalancing to the consumer
> rebalance
> > protocol
> > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter
> replication
> > engine
> > - New Java authorizer Interface
> > - Support for non-key joining in KTable
> > - Administrative API for replica reassignment
> > - Sticky partitioner
> > - Return topic metadata and configs in CreateTopics response
> > - Securing Internal connect REST endpoints
> > - API to delete consumer offsets and expose it via the AdminClient.
> >
> > Release notes for the 2.4.0 release:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc2/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Thursday, December 5th, 9am PT
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc2/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc2/javadoc/
> >
> > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> > https://github.com/apache/kafka/releases/tag/2.4.0-rc2
> >
> > * Documentation:
> > https://kafka.apache.org/24/documentation.html
> >
> > * Protocol:
> > https://kafka.apache.org/24/protocol.html
> >
> > Thanks,
> > Manikumar
> >
>
Re: [VOTE] 2.4.0 RC2
Posted by John Roesler <vv...@apache.org>.
Hello all,
I hate to do this, but I've been running a soak test of Kafka Streams on 2.4 and uncovered a number of small bugs that lead to Streams losing threads until there are none left. This condition only arises when using EOS in a highly flaky networking environment.
I've included a lot of details in KAFKA-9231, in particular my last comment:
https://issues.apache.org/jira/browse/KAFKA-9231?focusedCommentId=16985429&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16985429
Please take a look and see if you agree whether it warrants cutting a new RC early next week once the fix is merged.
Thanks,
-John
On Sat, Nov 30, 2019, at 11:48 AM, Manikumar wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the third candidate for release of Apache Kafka 2.4.0.
>
> This release includes many new features, including:
> - Allow consumers to fetch from closest replica
> - Support for incremental cooperative rebalancing to the consumer rebalance
> protocol
> - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
> engine
> - New Java authorizer Interface
> - Support for non-key joining in KTable
> - Administrative API for replica reassignment
> - Sticky partitioner
> - Return topic metadata and configs in CreateTopics response
> - Securing Internal connect REST endpoints
> - API to delete consumer offsets and expose it via the AdminClient.
>
> Release notes for the 2.4.0 release:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc2/RELEASE_NOTES.html
>
> *** Please download, test and vote by Thursday, December 5th, 9am PT
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~manikumar/kafka-2.4.0-rc2/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc2/javadoc/
>
> * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> https://github.com/apache/kafka/releases/tag/2.4.0-rc2
>
> * Documentation:
> https://kafka.apache.org/24/documentation.html
>
> * Protocol:
> https://kafka.apache.org/24/protocol.html
>
> Thanks,
> Manikumar
>