You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Manikumar <ma...@gmail.com> on 2019/12/09 17:32:40 UTC
[VOTE] 2.4.0 RC4
Hello Kafka users, developers and client-developers,
This is the fifth candidate for release of Apache Kafka 2.4.0.
This release includes many new features, including:
- Allow consumers to fetch from closest replica
- Support for incremental cooperative rebalancing to the consumer rebalance
protocol
- MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
engine
- New Java authorizer Interface
- Support for non-key joining in KTable
- Administrative API for replica reassignment
- Sticky partitioner
- Return topic metadata and configs in CreateTopics response
- Securing Internal connect REST endpoints
- API to delete consumer offsets and expose it via the AdminClient.
Release notes for the 2.4.0 release:
https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
*** Please download, test and vote by Thursday, December 12, 9am PT
Kafka's KEYS file containing PGP keys we use to sign the release:
https://kafka.apache.org/KEYS
* Release artifacts to be voted upon (source and binary):
https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/org/apache/kafka/
* Javadoc:
https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
* Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
https://github.com/apache/kafka/releases/tag/2.4.0-rc4
* Documentation:
https://kafka.apache.org/24/documentation.html
* Protocol:
https://kafka.apache.org/24/protocol.html
Thanks,
Manikumar
Re: [VOTE] 2.4.0 RC4
Posted by Manikumar <ma...@gmail.com>.
Hi Israel,
Thanks for testing the release candidate.
We can use https://issues.apache.org/jira/browse/KAFKA-9283 for fixing the
flaky test.
Thanks,
On Thu, Dec 12, 2019 at 8:18 PM Israel Ekpo <is...@gmail.com> wrote:
>
> @Manikumar <ma...@gmail.com>, I have rerun the latest release
> candidate (RC4) and all the tests have passed with no errors.
>
> Should we go ahead and close this issue regarding the Flaky test? -
> https://issues.apache.org/jira/browse/KAFKA-9283
>
>
> On Tue, Dec 10, 2019 at 11:11 AM Adam Bellemare <ad...@gmail.com>
> wrote:
>
>> - All PGP signatures are good
>> - All md5, sha1sums and sha512sums pass
>>
>> Initial test results:
>> 1310 tests completed, 2 failed, 17 skipped
>>
>> > Task :core:integrationTest FAILED
>>
>> The failed tests:
>> SaslSslAdminClientIntegrationTest. testElectPreferredLeaders
>> SslAdminClientIntegrationTest.
>> testSynchronousAuthorizerAclUpdatesBlockRequestThreads
>>
>> Both failed due to timeout:
>>
>> java.util.concurrent.ExecutionException:
>> org.apache.kafka.common.errors.TimeoutException: Aborted due to
>> timeout.
>>
>> Reran the tests and both passed.
>>
>> +1 from me.
>>
>>
>>
>>
>>
>> On Mon, Dec 9, 2019 at 12:32 PM Manikumar <ma...@gmail.com>
>> wrote:
>>
>> > Hello Kafka users, developers and client-developers,
>> >
>> > This is the fifth candidate for release of Apache Kafka 2.4.0.
>> >
>> > This release includes many new features, including:
>> > - Allow consumers to fetch from closest replica
>> > - Support for incremental cooperative rebalancing to the consumer
>> rebalance
>> > protocol
>> > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter
>> replication
>> > engine
>> > - New Java authorizer Interface
>> > - Support for non-key joining in KTable
>> > - Administrative API for replica reassignment
>> > - Sticky partitioner
>> > - Return topic metadata and configs in CreateTopics response
>> > - Securing Internal connect REST endpoints
>> > - API to delete consumer offsets and expose it via the AdminClient.
>> >
>> > Release notes for the 2.4.0 release:
>> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
>> >
>> > *** Please download, test and vote by Thursday, December 12, 9am PT
>> >
>> > Kafka's KEYS file containing PGP keys we use to sign the release:
>> > https://kafka.apache.org/KEYS
>> >
>> > * Release artifacts to be voted upon (source and binary):
>> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
>> >
>> > * Maven artifacts to be voted upon:
>> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
>> >
>> > * Javadoc:
>> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
>> >
>> > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
>> > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
>> >
>> > * Documentation:
>> > https://kafka.apache.org/24/documentation.html
>> >
>> > * Protocol:
>> > https://kafka.apache.org/24/protocol.html
>> >
>> > Thanks,
>> > Manikumar
>> >
>>
>
Re: [VOTE] 2.4.0 RC4
Posted by Manikumar <ma...@gmail.com>.
Hi Israel,
Thanks for testing the release candidate.
We can use https://issues.apache.org/jira/browse/KAFKA-9283 for fixing the
flaky test.
Thanks,
On Thu, Dec 12, 2019 at 8:18 PM Israel Ekpo <is...@gmail.com> wrote:
>
> @Manikumar <ma...@gmail.com>, I have rerun the latest release
> candidate (RC4) and all the tests have passed with no errors.
>
> Should we go ahead and close this issue regarding the Flaky test? -
> https://issues.apache.org/jira/browse/KAFKA-9283
>
>
> On Tue, Dec 10, 2019 at 11:11 AM Adam Bellemare <ad...@gmail.com>
> wrote:
>
>> - All PGP signatures are good
>> - All md5, sha1sums and sha512sums pass
>>
>> Initial test results:
>> 1310 tests completed, 2 failed, 17 skipped
>>
>> > Task :core:integrationTest FAILED
>>
>> The failed tests:
>> SaslSslAdminClientIntegrationTest. testElectPreferredLeaders
>> SslAdminClientIntegrationTest.
>> testSynchronousAuthorizerAclUpdatesBlockRequestThreads
>>
>> Both failed due to timeout:
>>
>> java.util.concurrent.ExecutionException:
>> org.apache.kafka.common.errors.TimeoutException: Aborted due to
>> timeout.
>>
>> Reran the tests and both passed.
>>
>> +1 from me.
>>
>>
>>
>>
>>
>> On Mon, Dec 9, 2019 at 12:32 PM Manikumar <ma...@gmail.com>
>> wrote:
>>
>> > Hello Kafka users, developers and client-developers,
>> >
>> > This is the fifth candidate for release of Apache Kafka 2.4.0.
>> >
>> > This release includes many new features, including:
>> > - Allow consumers to fetch from closest replica
>> > - Support for incremental cooperative rebalancing to the consumer
>> rebalance
>> > protocol
>> > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter
>> replication
>> > engine
>> > - New Java authorizer Interface
>> > - Support for non-key joining in KTable
>> > - Administrative API for replica reassignment
>> > - Sticky partitioner
>> > - Return topic metadata and configs in CreateTopics response
>> > - Securing Internal connect REST endpoints
>> > - API to delete consumer offsets and expose it via the AdminClient.
>> >
>> > Release notes for the 2.4.0 release:
>> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
>> >
>> > *** Please download, test and vote by Thursday, December 12, 9am PT
>> >
>> > Kafka's KEYS file containing PGP keys we use to sign the release:
>> > https://kafka.apache.org/KEYS
>> >
>> > * Release artifacts to be voted upon (source and binary):
>> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
>> >
>> > * Maven artifacts to be voted upon:
>> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
>> >
>> > * Javadoc:
>> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
>> >
>> > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
>> > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
>> >
>> > * Documentation:
>> > https://kafka.apache.org/24/documentation.html
>> >
>> > * Protocol:
>> > https://kafka.apache.org/24/protocol.html
>> >
>> > Thanks,
>> > Manikumar
>> >
>>
>
Re: [VOTE] 2.4.0 RC4
Posted by Israel Ekpo <is...@gmail.com>.
@Manikumar <ma...@gmail.com>, I have rerun the latest release
candidate (RC4) and all the tests have passed with no errors.
Should we go ahead and close this issue regarding the Flaky test? -
https://issues.apache.org/jira/browse/KAFKA-9283
On Tue, Dec 10, 2019 at 11:11 AM Adam Bellemare <ad...@gmail.com>
wrote:
> - All PGP signatures are good
> - All md5, sha1sums and sha512sums pass
>
> Initial test results:
> 1310 tests completed, 2 failed, 17 skipped
>
> > Task :core:integrationTest FAILED
>
> The failed tests:
> SaslSslAdminClientIntegrationTest. testElectPreferredLeaders
> SslAdminClientIntegrationTest.
> testSynchronousAuthorizerAclUpdatesBlockRequestThreads
>
> Both failed due to timeout:
>
> java.util.concurrent.ExecutionException:
> org.apache.kafka.common.errors.TimeoutException: Aborted due to
> timeout.
>
> Reran the tests and both passed.
>
> +1 from me.
>
>
>
>
>
> On Mon, Dec 9, 2019 at 12:32 PM Manikumar <ma...@gmail.com>
> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the fifth candidate for release of Apache Kafka 2.4.0.
> >
> > This release includes many new features, including:
> > - Allow consumers to fetch from closest replica
> > - Support for incremental cooperative rebalancing to the consumer
> rebalance
> > protocol
> > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter
> replication
> > engine
> > - New Java authorizer Interface
> > - Support for non-key joining in KTable
> > - Administrative API for replica reassignment
> > - Sticky partitioner
> > - Return topic metadata and configs in CreateTopics response
> > - Securing Internal connect REST endpoints
> > - API to delete consumer offsets and expose it via the AdminClient.
> >
> > Release notes for the 2.4.0 release:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Thursday, December 12, 9am PT
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
> >
> > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
> >
> > * Documentation:
> > https://kafka.apache.org/24/documentation.html
> >
> > * Protocol:
> > https://kafka.apache.org/24/protocol.html
> >
> > Thanks,
> > Manikumar
> >
>
Re: [VOTE] 2.4.0 RC4
Posted by Israel Ekpo <is...@gmail.com>.
@Manikumar <ma...@gmail.com>, I have rerun the latest release
candidate (RC4) and all the tests have passed with no errors.
Should we go ahead and close this issue regarding the Flaky test? -
https://issues.apache.org/jira/browse/KAFKA-9283
On Tue, Dec 10, 2019 at 11:11 AM Adam Bellemare <ad...@gmail.com>
wrote:
> - All PGP signatures are good
> - All md5, sha1sums and sha512sums pass
>
> Initial test results:
> 1310 tests completed, 2 failed, 17 skipped
>
> > Task :core:integrationTest FAILED
>
> The failed tests:
> SaslSslAdminClientIntegrationTest. testElectPreferredLeaders
> SslAdminClientIntegrationTest.
> testSynchronousAuthorizerAclUpdatesBlockRequestThreads
>
> Both failed due to timeout:
>
> java.util.concurrent.ExecutionException:
> org.apache.kafka.common.errors.TimeoutException: Aborted due to
> timeout.
>
> Reran the tests and both passed.
>
> +1 from me.
>
>
>
>
>
> On Mon, Dec 9, 2019 at 12:32 PM Manikumar <ma...@gmail.com>
> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the fifth candidate for release of Apache Kafka 2.4.0.
> >
> > This release includes many new features, including:
> > - Allow consumers to fetch from closest replica
> > - Support for incremental cooperative rebalancing to the consumer
> rebalance
> > protocol
> > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter
> replication
> > engine
> > - New Java authorizer Interface
> > - Support for non-key joining in KTable
> > - Administrative API for replica reassignment
> > - Sticky partitioner
> > - Return topic metadata and configs in CreateTopics response
> > - Securing Internal connect REST endpoints
> > - API to delete consumer offsets and expose it via the AdminClient.
> >
> > Release notes for the 2.4.0 release:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Thursday, December 12, 9am PT
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
> >
> > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
> >
> > * Documentation:
> > https://kafka.apache.org/24/documentation.html
> >
> > * Protocol:
> > https://kafka.apache.org/24/protocol.html
> >
> > Thanks,
> > Manikumar
> >
>
Re: [VOTE] 2.4.0 RC4
Posted by Adam Bellemare <ad...@gmail.com>.
- All PGP signatures are good
- All md5, sha1sums and sha512sums pass
Initial test results:
1310 tests completed, 2 failed, 17 skipped
> Task :core:integrationTest FAILED
The failed tests:
SaslSslAdminClientIntegrationTest. testElectPreferredLeaders
SslAdminClientIntegrationTest.
testSynchronousAuthorizerAclUpdatesBlockRequestThreads
Both failed due to timeout:
java.util.concurrent.ExecutionException:
org.apache.kafka.common.errors.TimeoutException: Aborted due to
timeout.
Reran the tests and both passed.
+1 from me.
On Mon, Dec 9, 2019 at 12:32 PM Manikumar <ma...@gmail.com> wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the fifth candidate for release of Apache Kafka 2.4.0.
>
> This release includes many new features, including:
> - Allow consumers to fetch from closest replica
> - Support for incremental cooperative rebalancing to the consumer rebalance
> protocol
> - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
> engine
> - New Java authorizer Interface
> - Support for non-key joining in KTable
> - Administrative API for replica reassignment
> - Sticky partitioner
> - Return topic metadata and configs in CreateTopics response
> - Securing Internal connect REST endpoints
> - API to delete consumer offsets and expose it via the AdminClient.
>
> Release notes for the 2.4.0 release:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
>
> *** Please download, test and vote by Thursday, December 12, 9am PT
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
>
> * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> https://github.com/apache/kafka/releases/tag/2.4.0-rc4
>
> * Documentation:
> https://kafka.apache.org/24/documentation.html
>
> * Protocol:
> https://kafka.apache.org/24/protocol.html
>
> Thanks,
> Manikumar
>
Re: [VOTE] 2.4.0 RC4
Posted by Israel Ekpo <is...@gmail.com>.
Thanks @Manikumar <ma...@gmail.com> for running the release as
well.
In my latest run, all signature validations and tests passed successfully
without any issues.
+1 (non-binding)
On Thu, Dec 12, 2019 at 10:25 AM Mickael Maison <mi...@gmail.com>
wrote:
> Thanks Manikumar for running this release
>
> I verified the signatures
> All tests passed without failures.
> We've also been running this release for a few days in a couple of
> environments without any issues.
>
> +1 (binding)
>
> On Thu, Dec 12, 2019 at 3:14 PM Manikumar <ma...@gmail.com>
> wrote:
> >
> > Hi all,
> >
> > Successful Jenkins builds for the 2.4 branch:
> > Unit/integration tests:
> >
> https://builds.apache.org/blue/organizations/jenkins/kafka-2.4-jdk8/detail/kafka-2.4-jdk8/106/
> > System tests:
> >
> http://confluent-kafka-2-4-system-test-results.s3-us-west-2.amazonaws.com/2019-12-12--001.1576143096--confluentinc--2.4--9a7f26d/report.html
> >
> >
> >
> > On Mon, Dec 9, 2019 at 11:02 PM Manikumar <ma...@gmail.com>
> wrote:
> >
> > > Hello Kafka users, developers and client-developers,
> > >
> > > This is the fifth candidate for release of Apache Kafka 2.4.0.
> > >
> > > This release includes many new features, including:
> > > - Allow consumers to fetch from closest replica
> > > - Support for incremental cooperative rebalancing to the consumer
> > > rebalance protocol
> > > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter
> replication
> > > engine
> > > - New Java authorizer Interface
> > > - Support for non-key joining in KTable
> > > - Administrative API for replica reassignment
> > > - Sticky partitioner
> > > - Return topic metadata and configs in CreateTopics response
> > > - Securing Internal connect REST endpoints
> > > - API to delete consumer offsets and expose it via the AdminClient.
> > >
> > > Release notes for the 2.4.0 release:
> > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
> > >
> > > *** Please download, test and vote by Thursday, December 12, 9am PT
> > >
> > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > https://kafka.apache.org/KEYS
> > >
> > > * Release artifacts to be voted upon (source and binary):
> > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
> > >
> > > * Maven artifacts to be voted upon:
> > > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> > >
> > > * Javadoc:
> > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
> > >
> > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> > > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
> > >
> > > * Documentation:
> > > https://kafka.apache.org/24/documentation.html
> > >
> > > * Protocol:
> > > https://kafka.apache.org/24/protocol.html
> > >
> > > Thanks,
> > > Manikumar
> > >
>
Re: [VOTE] 2.4.0 RC4
Posted by Israel Ekpo <is...@gmail.com>.
Thanks @Manikumar <ma...@gmail.com> for running the release as
well.
In my latest run, all signature validations and tests passed successfully
without any issues.
+1 (non-binding)
On Thu, Dec 12, 2019 at 10:25 AM Mickael Maison <mi...@gmail.com>
wrote:
> Thanks Manikumar for running this release
>
> I verified the signatures
> All tests passed without failures.
> We've also been running this release for a few days in a couple of
> environments without any issues.
>
> +1 (binding)
>
> On Thu, Dec 12, 2019 at 3:14 PM Manikumar <ma...@gmail.com>
> wrote:
> >
> > Hi all,
> >
> > Successful Jenkins builds for the 2.4 branch:
> > Unit/integration tests:
> >
> https://builds.apache.org/blue/organizations/jenkins/kafka-2.4-jdk8/detail/kafka-2.4-jdk8/106/
> > System tests:
> >
> http://confluent-kafka-2-4-system-test-results.s3-us-west-2.amazonaws.com/2019-12-12--001.1576143096--confluentinc--2.4--9a7f26d/report.html
> >
> >
> >
> > On Mon, Dec 9, 2019 at 11:02 PM Manikumar <ma...@gmail.com>
> wrote:
> >
> > > Hello Kafka users, developers and client-developers,
> > >
> > > This is the fifth candidate for release of Apache Kafka 2.4.0.
> > >
> > > This release includes many new features, including:
> > > - Allow consumers to fetch from closest replica
> > > - Support for incremental cooperative rebalancing to the consumer
> > > rebalance protocol
> > > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter
> replication
> > > engine
> > > - New Java authorizer Interface
> > > - Support for non-key joining in KTable
> > > - Administrative API for replica reassignment
> > > - Sticky partitioner
> > > - Return topic metadata and configs in CreateTopics response
> > > - Securing Internal connect REST endpoints
> > > - API to delete consumer offsets and expose it via the AdminClient.
> > >
> > > Release notes for the 2.4.0 release:
> > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
> > >
> > > *** Please download, test and vote by Thursday, December 12, 9am PT
> > >
> > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > https://kafka.apache.org/KEYS
> > >
> > > * Release artifacts to be voted upon (source and binary):
> > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
> > >
> > > * Maven artifacts to be voted upon:
> > > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> > >
> > > * Javadoc:
> > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
> > >
> > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> > > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
> > >
> > > * Documentation:
> > > https://kafka.apache.org/24/documentation.html
> > >
> > > * Protocol:
> > > https://kafka.apache.org/24/protocol.html
> > >
> > > Thanks,
> > > Manikumar
> > >
>
Re: [VOTE] 2.4.0 RC4
Posted by Mickael Maison <mi...@gmail.com>.
Thanks Manikumar for running this release
I verified the signatures
All tests passed without failures.
We've also been running this release for a few days in a couple of
environments without any issues.
+1 (binding)
On Thu, Dec 12, 2019 at 3:14 PM Manikumar <ma...@gmail.com> wrote:
>
> Hi all,
>
> Successful Jenkins builds for the 2.4 branch:
> Unit/integration tests:
> https://builds.apache.org/blue/organizations/jenkins/kafka-2.4-jdk8/detail/kafka-2.4-jdk8/106/
> System tests:
> http://confluent-kafka-2-4-system-test-results.s3-us-west-2.amazonaws.com/2019-12-12--001.1576143096--confluentinc--2.4--9a7f26d/report.html
>
>
>
> On Mon, Dec 9, 2019 at 11:02 PM Manikumar <ma...@gmail.com> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the fifth candidate for release of Apache Kafka 2.4.0.
> >
> > This release includes many new features, including:
> > - Allow consumers to fetch from closest replica
> > - Support for incremental cooperative rebalancing to the consumer
> > rebalance protocol
> > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
> > engine
> > - New Java authorizer Interface
> > - Support for non-key joining in KTable
> > - Administrative API for replica reassignment
> > - Sticky partitioner
> > - Return topic metadata and configs in CreateTopics response
> > - Securing Internal connect REST endpoints
> > - API to delete consumer offsets and expose it via the AdminClient.
> >
> > Release notes for the 2.4.0 release:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Thursday, December 12, 9am PT
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
> >
> > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
> >
> > * Documentation:
> > https://kafka.apache.org/24/documentation.html
> >
> > * Protocol:
> > https://kafka.apache.org/24/protocol.html
> >
> > Thanks,
> > Manikumar
> >
Re: [VOTE] 2.4.0 RC4
Posted by Mickael Maison <mi...@gmail.com>.
Thanks Manikumar for running this release
I verified the signatures
All tests passed without failures.
We've also been running this release for a few days in a couple of
environments without any issues.
+1 (binding)
On Thu, Dec 12, 2019 at 3:14 PM Manikumar <ma...@gmail.com> wrote:
>
> Hi all,
>
> Successful Jenkins builds for the 2.4 branch:
> Unit/integration tests:
> https://builds.apache.org/blue/organizations/jenkins/kafka-2.4-jdk8/detail/kafka-2.4-jdk8/106/
> System tests:
> http://confluent-kafka-2-4-system-test-results.s3-us-west-2.amazonaws.com/2019-12-12--001.1576143096--confluentinc--2.4--9a7f26d/report.html
>
>
>
> On Mon, Dec 9, 2019 at 11:02 PM Manikumar <ma...@gmail.com> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the fifth candidate for release of Apache Kafka 2.4.0.
> >
> > This release includes many new features, including:
> > - Allow consumers to fetch from closest replica
> > - Support for incremental cooperative rebalancing to the consumer
> > rebalance protocol
> > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
> > engine
> > - New Java authorizer Interface
> > - Support for non-key joining in KTable
> > - Administrative API for replica reassignment
> > - Sticky partitioner
> > - Return topic metadata and configs in CreateTopics response
> > - Securing Internal connect REST endpoints
> > - API to delete consumer offsets and expose it via the AdminClient.
> >
> > Release notes for the 2.4.0 release:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Thursday, December 12, 9am PT
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
> >
> > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
> >
> > * Documentation:
> > https://kafka.apache.org/24/documentation.html
> >
> > * Protocol:
> > https://kafka.apache.org/24/protocol.html
> >
> > Thanks,
> > Manikumar
> >
Re: [VOTE] 2.4.0 RC4
Posted by Manikumar <ma...@gmail.com>.
Hi all,
Successful Jenkins builds for the 2.4 branch:
Unit/integration tests:
https://builds.apache.org/blue/organizations/jenkins/kafka-2.4-jdk8/detail/kafka-2.4-jdk8/106/
System tests:
http://confluent-kafka-2-4-system-test-results.s3-us-west-2.amazonaws.com/2019-12-12--001.1576143096--confluentinc--2.4--9a7f26d/report.html
On Mon, Dec 9, 2019 at 11:02 PM Manikumar <ma...@gmail.com> wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the fifth candidate for release of Apache Kafka 2.4.0.
>
> This release includes many new features, including:
> - Allow consumers to fetch from closest replica
> - Support for incremental cooperative rebalancing to the consumer
> rebalance protocol
> - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
> engine
> - New Java authorizer Interface
> - Support for non-key joining in KTable
> - Administrative API for replica reassignment
> - Sticky partitioner
> - Return topic metadata and configs in CreateTopics response
> - Securing Internal connect REST endpoints
> - API to delete consumer offsets and expose it via the AdminClient.
>
> Release notes for the 2.4.0 release:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
>
> *** Please download, test and vote by Thursday, December 12, 9am PT
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
>
> * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> https://github.com/apache/kafka/releases/tag/2.4.0-rc4
>
> * Documentation:
> https://kafka.apache.org/24/documentation.html
>
> * Protocol:
> https://kafka.apache.org/24/protocol.html
>
> Thanks,
> Manikumar
>
Re: [VOTE] 2.4.0 RC4
Posted by Guozhang Wang <wa...@gmail.com>.
Hello Manikumar,
I verified the unit tests on scala 2.13 binary, web docs and java docs. +1
(binding).
Guozhang
On Fri, Dec 13, 2019 at 10:11 AM Jun Rao <ju...@confluent.io> wrote:
> Hi, Manikumar,
>
> Thanks for preparing the release. Verified quickstart on scala 2.13
> binary. +1 from me.
>
> Jun
>
> On Thu, Dec 12, 2019 at 10:30 PM Gwen Shapira <gw...@confluent.io> wrote:
>
> > +1 (binding)
> >
> > Validated signatures, tests and ran some test workloads.
> >
> > Thank you so much for driving this. Mani.
> >
> > On Mon, Dec 9, 2019 at 9:32 AM Manikumar <ma...@gmail.com>
> > wrote:
> > >
> > > Hello Kafka users, developers and client-developers,
> > >
> > > This is the fifth candidate for release of Apache Kafka 2.4.0.
> > >
> > > This release includes many new features, including:
> > > - Allow consumers to fetch from closest replica
> > > - Support for incremental cooperative rebalancing to the consumer
> > rebalance
> > > protocol
> > > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter
> > replication
> > > engine
> > > - New Java authorizer Interface
> > > - Support for non-key joining in KTable
> > > - Administrative API for replica reassignment
> > > - Sticky partitioner
> > > - Return topic metadata and configs in CreateTopics response
> > > - Securing Internal connect REST endpoints
> > > - API to delete consumer offsets and expose it via the AdminClient.
> > >
> > > Release notes for the 2.4.0 release:
> > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
> > >
> > > *** Please download, test and vote by Thursday, December 12, 9am PT
> > >
> > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > https://kafka.apache.org/KEYS
> > >
> > > * Release artifacts to be voted upon (source and binary):
> > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
> > >
> > > * Maven artifacts to be voted upon:
> > > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> > >
> > > * Javadoc:
> > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
> > >
> > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> > > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
> > >
> > > * Documentation:
> > > https://kafka.apache.org/24/documentation.html
> > >
> > > * Protocol:
> > > https://kafka.apache.org/24/protocol.html
> > >
> > > Thanks,
> > > Manikumar
> >
>
--
-- Guozhang
Re: [VOTE] 2.4.0 RC4
Posted by Jun Rao <ju...@confluent.io>.
Hi, Manikumar,
Thanks for preparing the release. Verified quickstart on scala 2.13
binary. +1 from me.
Jun
On Thu, Dec 12, 2019 at 10:30 PM Gwen Shapira <gw...@confluent.io> wrote:
> +1 (binding)
>
> Validated signatures, tests and ran some test workloads.
>
> Thank you so much for driving this. Mani.
>
> On Mon, Dec 9, 2019 at 9:32 AM Manikumar <ma...@gmail.com>
> wrote:
> >
> > Hello Kafka users, developers and client-developers,
> >
> > This is the fifth candidate for release of Apache Kafka 2.4.0.
> >
> > This release includes many new features, including:
> > - Allow consumers to fetch from closest replica
> > - Support for incremental cooperative rebalancing to the consumer
> rebalance
> > protocol
> > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter
> replication
> > engine
> > - New Java authorizer Interface
> > - Support for non-key joining in KTable
> > - Administrative API for replica reassignment
> > - Sticky partitioner
> > - Return topic metadata and configs in CreateTopics response
> > - Securing Internal connect REST endpoints
> > - API to delete consumer offsets and expose it via the AdminClient.
> >
> > Release notes for the 2.4.0 release:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Thursday, December 12, 9am PT
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
> >
> > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> > https://github.com/apache/kafka/releases/tag/2.4.0-rc4
> >
> > * Documentation:
> > https://kafka.apache.org/24/documentation.html
> >
> > * Protocol:
> > https://kafka.apache.org/24/protocol.html
> >
> > Thanks,
> > Manikumar
>
Re: [VOTE] 2.4.0 RC4
Posted by Gwen Shapira <gw...@confluent.io>.
+1 (binding)
Validated signatures, tests and ran some test workloads.
Thank you so much for driving this. Mani.
On Mon, Dec 9, 2019 at 9:32 AM Manikumar <ma...@gmail.com> wrote:
>
> Hello Kafka users, developers and client-developers,
>
> This is the fifth candidate for release of Apache Kafka 2.4.0.
>
> This release includes many new features, including:
> - Allow consumers to fetch from closest replica
> - Support for incremental cooperative rebalancing to the consumer rebalance
> protocol
> - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
> engine
> - New Java authorizer Interface
> - Support for non-key joining in KTable
> - Administrative API for replica reassignment
> - Sticky partitioner
> - Return topic metadata and configs in CreateTopics response
> - Securing Internal connect REST endpoints
> - API to delete consumer offsets and expose it via the AdminClient.
>
> Release notes for the 2.4.0 release:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
>
> *** Please download, test and vote by Thursday, December 12, 9am PT
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
>
> * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> https://github.com/apache/kafka/releases/tag/2.4.0-rc4
>
> * Documentation:
> https://kafka.apache.org/24/documentation.html
>
> * Protocol:
> https://kafka.apache.org/24/protocol.html
>
> Thanks,
> Manikumar
Re: [VOTE] 2.4.0 RC4
Posted by Manikumar <ma...@gmail.com>.
Hi all,
Successful Jenkins builds for the 2.4 branch:
Unit/integration tests:
https://builds.apache.org/blue/organizations/jenkins/kafka-2.4-jdk8/detail/kafka-2.4-jdk8/106/
System tests:
http://confluent-kafka-2-4-system-test-results.s3-us-west-2.amazonaws.com/2019-12-12--001.1576143096--confluentinc--2.4--9a7f26d/report.html
On Mon, Dec 9, 2019 at 11:02 PM Manikumar <ma...@gmail.com> wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the fifth candidate for release of Apache Kafka 2.4.0.
>
> This release includes many new features, including:
> - Allow consumers to fetch from closest replica
> - Support for incremental cooperative rebalancing to the consumer
> rebalance protocol
> - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
> engine
> - New Java authorizer Interface
> - Support for non-key joining in KTable
> - Administrative API for replica reassignment
> - Sticky partitioner
> - Return topic metadata and configs in CreateTopics response
> - Securing Internal connect REST endpoints
> - API to delete consumer offsets and expose it via the AdminClient.
>
> Release notes for the 2.4.0 release:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
>
> *** Please download, test and vote by Thursday, December 12, 9am PT
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
>
> * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> https://github.com/apache/kafka/releases/tag/2.4.0-rc4
>
> * Documentation:
> https://kafka.apache.org/24/documentation.html
>
> * Protocol:
> https://kafka.apache.org/24/protocol.html
>
> Thanks,
> Manikumar
>
Re: [VOTE] 2.4.0 RC4
Posted by Adam Bellemare <ad...@gmail.com>.
- All PGP signatures are good
- All md5, sha1sums and sha512sums pass
Initial test results:
1310 tests completed, 2 failed, 17 skipped
> Task :core:integrationTest FAILED
The failed tests:
SaslSslAdminClientIntegrationTest. testElectPreferredLeaders
SslAdminClientIntegrationTest.
testSynchronousAuthorizerAclUpdatesBlockRequestThreads
Both failed due to timeout:
java.util.concurrent.ExecutionException:
org.apache.kafka.common.errors.TimeoutException: Aborted due to
timeout.
Reran the tests and both passed.
+1 from me.
On Mon, Dec 9, 2019 at 12:32 PM Manikumar <ma...@gmail.com> wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the fifth candidate for release of Apache Kafka 2.4.0.
>
> This release includes many new features, including:
> - Allow consumers to fetch from closest replica
> - Support for incremental cooperative rebalancing to the consumer rebalance
> protocol
> - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
> engine
> - New Java authorizer Interface
> - Support for non-key joining in KTable
> - Administrative API for replica reassignment
> - Sticky partitioner
> - Return topic metadata and configs in CreateTopics response
> - Securing Internal connect REST endpoints
> - API to delete consumer offsets and expose it via the AdminClient.
>
> Release notes for the 2.4.0 release:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
>
> *** Please download, test and vote by Thursday, December 12, 9am PT
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
>
> * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> https://github.com/apache/kafka/releases/tag/2.4.0-rc4
>
> * Documentation:
> https://kafka.apache.org/24/documentation.html
>
> * Protocol:
> https://kafka.apache.org/24/protocol.html
>
> Thanks,
> Manikumar
>
Re: [VOTE] 2.4.0 RC4
Posted by Gwen Shapira <gw...@confluent.io>.
+1 (binding)
Validated signatures, tests and ran some test workloads.
Thank you so much for driving this. Mani.
On Mon, Dec 9, 2019 at 9:32 AM Manikumar <ma...@gmail.com> wrote:
>
> Hello Kafka users, developers and client-developers,
>
> This is the fifth candidate for release of Apache Kafka 2.4.0.
>
> This release includes many new features, including:
> - Allow consumers to fetch from closest replica
> - Support for incremental cooperative rebalancing to the consumer rebalance
> protocol
> - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication
> engine
> - New Java authorizer Interface
> - Support for non-key joining in KTable
> - Administrative API for replica reassignment
> - Sticky partitioner
> - Return topic metadata and configs in CreateTopics response
> - Securing Internal connect REST endpoints
> - API to delete consumer offsets and expose it via the AdminClient.
>
> Release notes for the 2.4.0 release:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html
>
> *** Please download, test and vote by Thursday, December 12, 9am PT
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/
>
> * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag:
> https://github.com/apache/kafka/releases/tag/2.4.0-rc4
>
> * Documentation:
> https://kafka.apache.org/24/documentation.html
>
> * Protocol:
> https://kafka.apache.org/24/protocol.html
>
> Thanks,
> Manikumar