You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Josep Prat <jo...@aiven.io.INVALID> on 2024/07/15 15:52:42 UTC
[VOTE] 3.8.0 RC1
Hello Kafka users, developers and client-developers,
This is the second release candidate for Apache Kafka 3.8.0.
Some of the major features included in this release are:
* KIP-1028: Docker Official Image for Apache Kafka
* KIP-974: Docker Image for GraalVM based Native Kafka Broker
* KIP-1036: Extend RecordDeserializationException exception
* KIP-1019: Expose method to determine Metric Measurability
* KIP-1004: Enforce tasks.max property in Kafka Connect
* KIP-989: Improved StateStore Iterator metrics for detecting leaks
* KIP-993: Allow restricting files accessed by File and Directory
ConfigProviders
* KIP-924: customizable task assignment for Streams
* KIP-813: Shareable State Stores
* KIP-719: Deprecate Log4J Appender
* KIP-390: Support Compression Level
* KIP-1018: Introduce max remote fetch timeout config for
DelayedRemoteFetch requests
* KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission
* KIP-1047 Introduce new org.apache.kafka.tools.api.Decoder to replace
kafka.serializer.Decoder
* KIP-899: Allow producer and consumer clients to rebootstrap
Release notes for the 3.8.0 release:
https://home.apache.org/~jlprat/kafka-3.8.0-rc1/RELEASE_NOTES.html
**** Please download, test and vote by Thursday, July 18th, 12pm PT*
Kafka's KEYS file containing PGP keys we use to sign the release:
https://kafka.apache.org/KEYS
* Release artifacts to be voted upon (source and binary):
https://home.apache.org/~jlprat/kafka-3.8.0-rc1/
* Docker release artifact to be voted upon(apache/kafka-native is supported
from 3.8+ release.):
apache/kafka:3.8.0-rc1
apache/kafka-native:3.8.0-rc1
* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/org/apache/kafka/
* Javadoc:
https://home.apache.org/~jlprat/kafka-3.8.0-rc1/javadoc/
* Tag to be voted upon (off 3.8 branch) is the 3.8.0 tag:
https://github.com/apache/kafka/releases/tag/3.8.0-rc1
Once https://github.com/apache/kafka-site/pull/608 is merged. You will be
able to find the proper documentation under kafka.apache.org.
* Documentation:
https://kafka.apache.org/38/documentation.html
* Protocol:
https://kafka.apache.org/38/protocol.html
* Successful Jenkins builds for the 3.8 branch:Unit/integration tests:
https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%252Fkafka/detail/3.8/67/
(Some known flaky tests and builds from 64 to 68 show tests passing at
least once). Additionally, this is the CI run for the changes between RC0
and RC1:
https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-16593/1/pipeline/
System tests: (Same as before)
https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-07-10--001.f1f05b43-3574-45cb-836e-8968f02d722f--1720631619--apache--3.8--4ecbb75c1f/report.html
* Successful Docker Image Github Actions Pipeline for 3.8 branch:
Docker Build Test Pipeline (JVM):
https://github.com/apache/kafka/actions/runs/9941446092
Docker Build Test Pipeline (Native):
https://github.com/apache/kafka/actions/runs/9941449561
Best,
--
[image: Aiven] <https://www.aiven.io>
*Josep Prat*
Open Source Engineering Director, *Aiven*
josep.prat@aiven.io | +491715557497
aiven.io <https://www.aiven.io> | <https://www.facebook.com/aivencloud>
<https://www.linkedin.com/company/aiven/> <https://twitter.com/aiven_io>
*Aiven Deutschland GmbH*
Alexanderufer 3-7, 10117 Berlin
Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
Amtsgericht Charlottenburg, HRB 209739 B
Re: [VOTE] 3.8.0 RC1
Posted by Josep Prat <jo...@aiven.io.INVALID>.
Hi all,
I'm cancelling this VOTE thread, and I'll generate a new RC once the fix is
merged.
Best,
On Wed, Jul 17, 2024 at 8:55 AM Josep Prat <jo...@aiven.io> wrote:
> Thanks Greg for taking a look and providing a fix!
>
> Best,
>
> ------------------
> Josep Prat
> Open Source Engineering Director, Aiven
> josep.prat@aiven.io | +491715557497 | aiven.io
> Aiven Deutschland GmbH
> Alexanderufer 3-7, 10117 Berlin
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> Amtsgericht Charlottenburg, HRB 209739 B
>
> On Wed, Jul 17, 2024, 00:40 Greg Harris <gr...@aiven.io.invalid>
> wrote:
>
>> Hi Josep,
>>
>> I found this blocker regression:
>> https://issues.apache.org/jira/browse/KAFKA-17150
>> Summary: Connector configurations that specified converters with aliases
>> (e.g. JsonConverter instead of
>> org.apache.kafka.connect.json.JsonConverter)
>> previously worked, and in this RC they throw validation exceptions and are
>> unable to start/run.
>> Severity: This would take tasks offline completely until the workers are
>> downgraded or the connectors are reconfigured with full class names
>> Impact: Aliases are commonly used in demos, and slightly less commonly
>> used
>> in production environments. It is by no means a demo-only feature, and I
>> would expect this to break at least one production workload.
>> Risk: I've opened a PR to resolve it here:
>> https://github.com/apache/kafka/pull/16608 . We've already solved this
>> bug
>> once before, so it seems low-risk to widen the scope of the original fix
>> to
>> cover this new case.
>>
>> I found this apparent bug, but as it doesn't appear to be a regression and
>> has very low severity, I don't think it's a blocker on its own:
>> https://issues.apache.org/jira/browse/KAFKA-17148
>> If we're rolling a new RC, hopefully we can include this if it's resolved
>> quickly.
>>
>> I also performed the following successful verifications:
>> 1. Verified that protected members don't appear in the generated javadocs
>> (KAFKA-14839)
>> 2. Verified that Connect Distributed can start against a Kraft cluster
>> 3. Verified that plugin scanning doesn't throw errors with jackson
>> (KAFKA-17111)
>> 4. Verified that the allowed.paths configuration works for
>> DirectoryConfigProvider (KIP-993)
>>
>> Unfortunately due to the blocker regression, I think I'll have to -1
>> (binding) this RC. Sorry!
>>
>> Thanks,
>> Greg
>>
>> On Tue, Jul 16, 2024 at 1:32 PM Jakub Scholz <ja...@scholz.cz> wrote:
>>
>> > +1 (non-binding). I used the staged Scala 2.13 binaries and the staged
>> > Maven artifacts. All seems to work fine. Thanks!
>> >
>> > Jakub
>> >
>> > On Mon, Jul 15, 2024 at 5:53 PM Josep Prat <josep.prat@aiven.io.invalid
>> >
>> > wrote:
>> >
>> > > Hello Kafka users, developers and client-developers,
>> > >
>> > > This is the second release candidate for Apache Kafka 3.8.0.
>> > >
>> > > Some of the major features included in this release are:
>> > > * KIP-1028: Docker Official Image for Apache Kafka
>> > > * KIP-974: Docker Image for GraalVM based Native Kafka Broker
>> > > * KIP-1036: Extend RecordDeserializationException exception
>> > > * KIP-1019: Expose method to determine Metric Measurability
>> > > * KIP-1004: Enforce tasks.max property in Kafka Connect
>> > > * KIP-989: Improved StateStore Iterator metrics for detecting leaks
>> > > * KIP-993: Allow restricting files accessed by File and Directory
>> > > ConfigProviders
>> > > * KIP-924: customizable task assignment for Streams
>> > > * KIP-813: Shareable State Stores
>> > > * KIP-719: Deprecate Log4J Appender
>> > > * KIP-390: Support Compression Level
>> > > * KIP-1018: Introduce max remote fetch timeout config for
>> > > DelayedRemoteFetch requests
>> > > * KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission
>> > > * KIP-1047 Introduce new org.apache.kafka.tools.api.Decoder to replace
>> > > kafka.serializer.Decoder
>> > > * KIP-899: Allow producer and consumer clients to rebootstrap
>> > >
>> > > Release notes for the 3.8.0 release:
>> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/RELEASE_NOTES.html
>> > >
>> > > **** Please download, test and vote by Thursday, July 18th, 12pm PT*
>> > >
>> > > Kafka's KEYS file containing PGP keys we use to sign the release:
>> > > https://kafka.apache.org/KEYS
>> > >
>> > > * Release artifacts to be voted upon (source and binary):
>> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/
>> > >
>> > > * Docker release artifact to be voted upon(apache/kafka-native is
>> > supported
>> > > from 3.8+ release.):
>> > > apache/kafka:3.8.0-rc1
>> > > apache/kafka-native:3.8.0-rc1
>> > >
>> > > * Maven artifacts to be voted upon:
>> > >
>> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>> > >
>> > > * Javadoc:
>> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/javadoc/
>> > >
>> > > * Tag to be voted upon (off 3.8 branch) is the 3.8.0 tag:
>> > > https://github.com/apache/kafka/releases/tag/3.8.0-rc1
>> > >
>> > > Once https://github.com/apache/kafka-site/pull/608 is merged. You
>> will
>> > be
>> > > able to find the proper documentation under kafka.apache.org.
>> > > * Documentation:
>> > > https://kafka.apache.org/38/documentation.html
>> > >
>> > > * Protocol:
>> > > https://kafka.apache.org/38/protocol.html
>> > >
>> > > * Successful Jenkins builds for the 3.8 branch:Unit/integration tests:
>> > >
>> > >
>> >
>> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%252Fkafka/detail/3.8/67/
>> > > (Some known flaky tests and builds from 64 to 68 show tests passing at
>> > > least once). Additionally, this is the CI run for the changes between
>> RC0
>> > > and RC1:
>> > >
>> > >
>> >
>> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-16593/1/pipeline/
>> > >
>> > > System tests: (Same as before)
>> > >
>> > >
>> >
>> https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-07-10--001.f1f05b43-3574-45cb-836e-8968f02d722f--1720631619--apache--3.8--4ecbb75c1f/report.html
>> > >
>> > > * Successful Docker Image Github Actions Pipeline for 3.8 branch:
>> > > Docker Build Test Pipeline (JVM):
>> > > https://github.com/apache/kafka/actions/runs/9941446092
>> > > Docker Build Test Pipeline (Native):
>> > > https://github.com/apache/kafka/actions/runs/9941449561
>> > >
>> > > Best,
>> > > --
>> > > [image: Aiven] <https://www.aiven.io>
>> > >
>> > > *Josep Prat*
>> > > Open Source Engineering Director, *Aiven*
>> > > josep.prat@aiven.io | +491715557497
>> > > aiven.io <https://www.aiven.io> | <
>> > https://www.facebook.com/aivencloud
>> > > >
>> > > <https://www.linkedin.com/company/aiven/> <
>> > > https://twitter.com/aiven_io>
>> > > *Aiven Deutschland GmbH*
>> > > Alexanderufer 3-7, 10117 Berlin
>> > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>> > > Amtsgericht Charlottenburg, HRB 209739 B
>> > >
>> >
>>
>
--
[image: Aiven] <https://www.aiven.io>
*Josep Prat*
Open Source Engineering Director, *Aiven*
josep.prat@aiven.io | +491715557497
aiven.io <https://www.aiven.io> | <https://www.facebook.com/aivencloud>
<https://www.linkedin.com/company/aiven/> <https://twitter.com/aiven_io>
*Aiven Deutschland GmbH*
Alexanderufer 3-7, 10117 Berlin
Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
Amtsgericht Charlottenburg, HRB 209739 B
Re: [VOTE] 3.8.0 RC1
Posted by Josep Prat <jo...@aiven.io.INVALID>.
Hi all,
I'm cancelling this VOTE thread, and I'll generate a new RC once the fix is
merged.
Best,
On Wed, Jul 17, 2024 at 8:55 AM Josep Prat <jo...@aiven.io> wrote:
> Thanks Greg for taking a look and providing a fix!
>
> Best,
>
> ------------------
> Josep Prat
> Open Source Engineering Director, Aiven
> josep.prat@aiven.io | +491715557497 | aiven.io
> Aiven Deutschland GmbH
> Alexanderufer 3-7, 10117 Berlin
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> Amtsgericht Charlottenburg, HRB 209739 B
>
> On Wed, Jul 17, 2024, 00:40 Greg Harris <gr...@aiven.io.invalid>
> wrote:
>
>> Hi Josep,
>>
>> I found this blocker regression:
>> https://issues.apache.org/jira/browse/KAFKA-17150
>> Summary: Connector configurations that specified converters with aliases
>> (e.g. JsonConverter instead of
>> org.apache.kafka.connect.json.JsonConverter)
>> previously worked, and in this RC they throw validation exceptions and are
>> unable to start/run.
>> Severity: This would take tasks offline completely until the workers are
>> downgraded or the connectors are reconfigured with full class names
>> Impact: Aliases are commonly used in demos, and slightly less commonly
>> used
>> in production environments. It is by no means a demo-only feature, and I
>> would expect this to break at least one production workload.
>> Risk: I've opened a PR to resolve it here:
>> https://github.com/apache/kafka/pull/16608 . We've already solved this
>> bug
>> once before, so it seems low-risk to widen the scope of the original fix
>> to
>> cover this new case.
>>
>> I found this apparent bug, but as it doesn't appear to be a regression and
>> has very low severity, I don't think it's a blocker on its own:
>> https://issues.apache.org/jira/browse/KAFKA-17148
>> If we're rolling a new RC, hopefully we can include this if it's resolved
>> quickly.
>>
>> I also performed the following successful verifications:
>> 1. Verified that protected members don't appear in the generated javadocs
>> (KAFKA-14839)
>> 2. Verified that Connect Distributed can start against a Kraft cluster
>> 3. Verified that plugin scanning doesn't throw errors with jackson
>> (KAFKA-17111)
>> 4. Verified that the allowed.paths configuration works for
>> DirectoryConfigProvider (KIP-993)
>>
>> Unfortunately due to the blocker regression, I think I'll have to -1
>> (binding) this RC. Sorry!
>>
>> Thanks,
>> Greg
>>
>> On Tue, Jul 16, 2024 at 1:32 PM Jakub Scholz <ja...@scholz.cz> wrote:
>>
>> > +1 (non-binding). I used the staged Scala 2.13 binaries and the staged
>> > Maven artifacts. All seems to work fine. Thanks!
>> >
>> > Jakub
>> >
>> > On Mon, Jul 15, 2024 at 5:53 PM Josep Prat <josep.prat@aiven.io.invalid
>> >
>> > wrote:
>> >
>> > > Hello Kafka users, developers and client-developers,
>> > >
>> > > This is the second release candidate for Apache Kafka 3.8.0.
>> > >
>> > > Some of the major features included in this release are:
>> > > * KIP-1028: Docker Official Image for Apache Kafka
>> > > * KIP-974: Docker Image for GraalVM based Native Kafka Broker
>> > > * KIP-1036: Extend RecordDeserializationException exception
>> > > * KIP-1019: Expose method to determine Metric Measurability
>> > > * KIP-1004: Enforce tasks.max property in Kafka Connect
>> > > * KIP-989: Improved StateStore Iterator metrics for detecting leaks
>> > > * KIP-993: Allow restricting files accessed by File and Directory
>> > > ConfigProviders
>> > > * KIP-924: customizable task assignment for Streams
>> > > * KIP-813: Shareable State Stores
>> > > * KIP-719: Deprecate Log4J Appender
>> > > * KIP-390: Support Compression Level
>> > > * KIP-1018: Introduce max remote fetch timeout config for
>> > > DelayedRemoteFetch requests
>> > > * KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission
>> > > * KIP-1047 Introduce new org.apache.kafka.tools.api.Decoder to replace
>> > > kafka.serializer.Decoder
>> > > * KIP-899: Allow producer and consumer clients to rebootstrap
>> > >
>> > > Release notes for the 3.8.0 release:
>> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/RELEASE_NOTES.html
>> > >
>> > > **** Please download, test and vote by Thursday, July 18th, 12pm PT*
>> > >
>> > > Kafka's KEYS file containing PGP keys we use to sign the release:
>> > > https://kafka.apache.org/KEYS
>> > >
>> > > * Release artifacts to be voted upon (source and binary):
>> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/
>> > >
>> > > * Docker release artifact to be voted upon(apache/kafka-native is
>> > supported
>> > > from 3.8+ release.):
>> > > apache/kafka:3.8.0-rc1
>> > > apache/kafka-native:3.8.0-rc1
>> > >
>> > > * Maven artifacts to be voted upon:
>> > >
>> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>> > >
>> > > * Javadoc:
>> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/javadoc/
>> > >
>> > > * Tag to be voted upon (off 3.8 branch) is the 3.8.0 tag:
>> > > https://github.com/apache/kafka/releases/tag/3.8.0-rc1
>> > >
>> > > Once https://github.com/apache/kafka-site/pull/608 is merged. You
>> will
>> > be
>> > > able to find the proper documentation under kafka.apache.org.
>> > > * Documentation:
>> > > https://kafka.apache.org/38/documentation.html
>> > >
>> > > * Protocol:
>> > > https://kafka.apache.org/38/protocol.html
>> > >
>> > > * Successful Jenkins builds for the 3.8 branch:Unit/integration tests:
>> > >
>> > >
>> >
>> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%252Fkafka/detail/3.8/67/
>> > > (Some known flaky tests and builds from 64 to 68 show tests passing at
>> > > least once). Additionally, this is the CI run for the changes between
>> RC0
>> > > and RC1:
>> > >
>> > >
>> >
>> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-16593/1/pipeline/
>> > >
>> > > System tests: (Same as before)
>> > >
>> > >
>> >
>> https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-07-10--001.f1f05b43-3574-45cb-836e-8968f02d722f--1720631619--apache--3.8--4ecbb75c1f/report.html
>> > >
>> > > * Successful Docker Image Github Actions Pipeline for 3.8 branch:
>> > > Docker Build Test Pipeline (JVM):
>> > > https://github.com/apache/kafka/actions/runs/9941446092
>> > > Docker Build Test Pipeline (Native):
>> > > https://github.com/apache/kafka/actions/runs/9941449561
>> > >
>> > > Best,
>> > > --
>> > > [image: Aiven] <https://www.aiven.io>
>> > >
>> > > *Josep Prat*
>> > > Open Source Engineering Director, *Aiven*
>> > > josep.prat@aiven.io | +491715557497
>> > > aiven.io <https://www.aiven.io> | <
>> > https://www.facebook.com/aivencloud
>> > > >
>> > > <https://www.linkedin.com/company/aiven/> <
>> > > https://twitter.com/aiven_io>
>> > > *Aiven Deutschland GmbH*
>> > > Alexanderufer 3-7, 10117 Berlin
>> > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>> > > Amtsgericht Charlottenburg, HRB 209739 B
>> > >
>> >
>>
>
--
[image: Aiven] <https://www.aiven.io>
*Josep Prat*
Open Source Engineering Director, *Aiven*
josep.prat@aiven.io | +491715557497
aiven.io <https://www.aiven.io> | <https://www.facebook.com/aivencloud>
<https://www.linkedin.com/company/aiven/> <https://twitter.com/aiven_io>
*Aiven Deutschland GmbH*
Alexanderufer 3-7, 10117 Berlin
Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
Amtsgericht Charlottenburg, HRB 209739 B
Re: [VOTE] 3.8.0 RC1
Posted by Josep Prat <jo...@aiven.io.INVALID>.
Thanks Greg for taking a look and providing a fix!
Best,
------------------
Josep Prat
Open Source Engineering Director, Aiven
josep.prat@aiven.io | +491715557497 | aiven.io
Aiven Deutschland GmbH
Alexanderufer 3-7, 10117 Berlin
Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
Amtsgericht Charlottenburg, HRB 209739 B
On Wed, Jul 17, 2024, 00:40 Greg Harris <gr...@aiven.io.invalid>
wrote:
> Hi Josep,
>
> I found this blocker regression:
> https://issues.apache.org/jira/browse/KAFKA-17150
> Summary: Connector configurations that specified converters with aliases
> (e.g. JsonConverter instead of org.apache.kafka.connect.json.JsonConverter)
> previously worked, and in this RC they throw validation exceptions and are
> unable to start/run.
> Severity: This would take tasks offline completely until the workers are
> downgraded or the connectors are reconfigured with full class names
> Impact: Aliases are commonly used in demos, and slightly less commonly used
> in production environments. It is by no means a demo-only feature, and I
> would expect this to break at least one production workload.
> Risk: I've opened a PR to resolve it here:
> https://github.com/apache/kafka/pull/16608 . We've already solved this bug
> once before, so it seems low-risk to widen the scope of the original fix to
> cover this new case.
>
> I found this apparent bug, but as it doesn't appear to be a regression and
> has very low severity, I don't think it's a blocker on its own:
> https://issues.apache.org/jira/browse/KAFKA-17148
> If we're rolling a new RC, hopefully we can include this if it's resolved
> quickly.
>
> I also performed the following successful verifications:
> 1. Verified that protected members don't appear in the generated javadocs
> (KAFKA-14839)
> 2. Verified that Connect Distributed can start against a Kraft cluster
> 3. Verified that plugin scanning doesn't throw errors with jackson
> (KAFKA-17111)
> 4. Verified that the allowed.paths configuration works for
> DirectoryConfigProvider (KIP-993)
>
> Unfortunately due to the blocker regression, I think I'll have to -1
> (binding) this RC. Sorry!
>
> Thanks,
> Greg
>
> On Tue, Jul 16, 2024 at 1:32 PM Jakub Scholz <ja...@scholz.cz> wrote:
>
> > +1 (non-binding). I used the staged Scala 2.13 binaries and the staged
> > Maven artifacts. All seems to work fine. Thanks!
> >
> > Jakub
> >
> > On Mon, Jul 15, 2024 at 5:53 PM Josep Prat <jo...@aiven.io.invalid>
> > wrote:
> >
> > > Hello Kafka users, developers and client-developers,
> > >
> > > This is the second release candidate for Apache Kafka 3.8.0.
> > >
> > > Some of the major features included in this release are:
> > > * KIP-1028: Docker Official Image for Apache Kafka
> > > * KIP-974: Docker Image for GraalVM based Native Kafka Broker
> > > * KIP-1036: Extend RecordDeserializationException exception
> > > * KIP-1019: Expose method to determine Metric Measurability
> > > * KIP-1004: Enforce tasks.max property in Kafka Connect
> > > * KIP-989: Improved StateStore Iterator metrics for detecting leaks
> > > * KIP-993: Allow restricting files accessed by File and Directory
> > > ConfigProviders
> > > * KIP-924: customizable task assignment for Streams
> > > * KIP-813: Shareable State Stores
> > > * KIP-719: Deprecate Log4J Appender
> > > * KIP-390: Support Compression Level
> > > * KIP-1018: Introduce max remote fetch timeout config for
> > > DelayedRemoteFetch requests
> > > * KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission
> > > * KIP-1047 Introduce new org.apache.kafka.tools.api.Decoder to replace
> > > kafka.serializer.Decoder
> > > * KIP-899: Allow producer and consumer clients to rebootstrap
> > >
> > > Release notes for the 3.8.0 release:
> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/RELEASE_NOTES.html
> > >
> > > **** Please download, test and vote by Thursday, July 18th, 12pm PT*
> > >
> > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > https://kafka.apache.org/KEYS
> > >
> > > * Release artifacts to be voted upon (source and binary):
> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/
> > >
> > > * Docker release artifact to be voted upon(apache/kafka-native is
> > supported
> > > from 3.8+ release.):
> > > apache/kafka:3.8.0-rc1
> > > apache/kafka-native:3.8.0-rc1
> > >
> > > * Maven artifacts to be voted upon:
> > > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> > >
> > > * Javadoc:
> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/javadoc/
> > >
> > > * Tag to be voted upon (off 3.8 branch) is the 3.8.0 tag:
> > > https://github.com/apache/kafka/releases/tag/3.8.0-rc1
> > >
> > > Once https://github.com/apache/kafka-site/pull/608 is merged. You will
> > be
> > > able to find the proper documentation under kafka.apache.org.
> > > * Documentation:
> > > https://kafka.apache.org/38/documentation.html
> > >
> > > * Protocol:
> > > https://kafka.apache.org/38/protocol.html
> > >
> > > * Successful Jenkins builds for the 3.8 branch:Unit/integration tests:
> > >
> > >
> >
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%252Fkafka/detail/3.8/67/
> > > (Some known flaky tests and builds from 64 to 68 show tests passing at
> > > least once). Additionally, this is the CI run for the changes between
> RC0
> > > and RC1:
> > >
> > >
> >
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-16593/1/pipeline/
> > >
> > > System tests: (Same as before)
> > >
> > >
> >
> https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-07-10--001.f1f05b43-3574-45cb-836e-8968f02d722f--1720631619--apache--3.8--4ecbb75c1f/report.html
> > >
> > > * Successful Docker Image Github Actions Pipeline for 3.8 branch:
> > > Docker Build Test Pipeline (JVM):
> > > https://github.com/apache/kafka/actions/runs/9941446092
> > > Docker Build Test Pipeline (Native):
> > > https://github.com/apache/kafka/actions/runs/9941449561
> > >
> > > Best,
> > > --
> > > [image: Aiven] <https://www.aiven.io>
> > >
> > > *Josep Prat*
> > > Open Source Engineering Director, *Aiven*
> > > josep.prat@aiven.io | +491715557497
> > > aiven.io <https://www.aiven.io> | <
> > https://www.facebook.com/aivencloud
> > > >
> > > <https://www.linkedin.com/company/aiven/> <
> > > https://twitter.com/aiven_io>
> > > *Aiven Deutschland GmbH*
> > > Alexanderufer 3-7, 10117 Berlin
> > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > > Amtsgericht Charlottenburg, HRB 209739 B
> > >
> >
>
Re: [VOTE] 3.8.0 RC1
Posted by Josep Prat <jo...@aiven.io.INVALID>.
Thanks Greg for taking a look and providing a fix!
Best,
------------------
Josep Prat
Open Source Engineering Director, Aiven
josep.prat@aiven.io | +491715557497 | aiven.io
Aiven Deutschland GmbH
Alexanderufer 3-7, 10117 Berlin
Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
Amtsgericht Charlottenburg, HRB 209739 B
On Wed, Jul 17, 2024, 00:40 Greg Harris <gr...@aiven.io.invalid>
wrote:
> Hi Josep,
>
> I found this blocker regression:
> https://issues.apache.org/jira/browse/KAFKA-17150
> Summary: Connector configurations that specified converters with aliases
> (e.g. JsonConverter instead of org.apache.kafka.connect.json.JsonConverter)
> previously worked, and in this RC they throw validation exceptions and are
> unable to start/run.
> Severity: This would take tasks offline completely until the workers are
> downgraded or the connectors are reconfigured with full class names
> Impact: Aliases are commonly used in demos, and slightly less commonly used
> in production environments. It is by no means a demo-only feature, and I
> would expect this to break at least one production workload.
> Risk: I've opened a PR to resolve it here:
> https://github.com/apache/kafka/pull/16608 . We've already solved this bug
> once before, so it seems low-risk to widen the scope of the original fix to
> cover this new case.
>
> I found this apparent bug, but as it doesn't appear to be a regression and
> has very low severity, I don't think it's a blocker on its own:
> https://issues.apache.org/jira/browse/KAFKA-17148
> If we're rolling a new RC, hopefully we can include this if it's resolved
> quickly.
>
> I also performed the following successful verifications:
> 1. Verified that protected members don't appear in the generated javadocs
> (KAFKA-14839)
> 2. Verified that Connect Distributed can start against a Kraft cluster
> 3. Verified that plugin scanning doesn't throw errors with jackson
> (KAFKA-17111)
> 4. Verified that the allowed.paths configuration works for
> DirectoryConfigProvider (KIP-993)
>
> Unfortunately due to the blocker regression, I think I'll have to -1
> (binding) this RC. Sorry!
>
> Thanks,
> Greg
>
> On Tue, Jul 16, 2024 at 1:32 PM Jakub Scholz <ja...@scholz.cz> wrote:
>
> > +1 (non-binding). I used the staged Scala 2.13 binaries and the staged
> > Maven artifacts. All seems to work fine. Thanks!
> >
> > Jakub
> >
> > On Mon, Jul 15, 2024 at 5:53 PM Josep Prat <jo...@aiven.io.invalid>
> > wrote:
> >
> > > Hello Kafka users, developers and client-developers,
> > >
> > > This is the second release candidate for Apache Kafka 3.8.0.
> > >
> > > Some of the major features included in this release are:
> > > * KIP-1028: Docker Official Image for Apache Kafka
> > > * KIP-974: Docker Image for GraalVM based Native Kafka Broker
> > > * KIP-1036: Extend RecordDeserializationException exception
> > > * KIP-1019: Expose method to determine Metric Measurability
> > > * KIP-1004: Enforce tasks.max property in Kafka Connect
> > > * KIP-989: Improved StateStore Iterator metrics for detecting leaks
> > > * KIP-993: Allow restricting files accessed by File and Directory
> > > ConfigProviders
> > > * KIP-924: customizable task assignment for Streams
> > > * KIP-813: Shareable State Stores
> > > * KIP-719: Deprecate Log4J Appender
> > > * KIP-390: Support Compression Level
> > > * KIP-1018: Introduce max remote fetch timeout config for
> > > DelayedRemoteFetch requests
> > > * KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission
> > > * KIP-1047 Introduce new org.apache.kafka.tools.api.Decoder to replace
> > > kafka.serializer.Decoder
> > > * KIP-899: Allow producer and consumer clients to rebootstrap
> > >
> > > Release notes for the 3.8.0 release:
> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/RELEASE_NOTES.html
> > >
> > > **** Please download, test and vote by Thursday, July 18th, 12pm PT*
> > >
> > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > https://kafka.apache.org/KEYS
> > >
> > > * Release artifacts to be voted upon (source and binary):
> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/
> > >
> > > * Docker release artifact to be voted upon(apache/kafka-native is
> > supported
> > > from 3.8+ release.):
> > > apache/kafka:3.8.0-rc1
> > > apache/kafka-native:3.8.0-rc1
> > >
> > > * Maven artifacts to be voted upon:
> > > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> > >
> > > * Javadoc:
> > > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/javadoc/
> > >
> > > * Tag to be voted upon (off 3.8 branch) is the 3.8.0 tag:
> > > https://github.com/apache/kafka/releases/tag/3.8.0-rc1
> > >
> > > Once https://github.com/apache/kafka-site/pull/608 is merged. You will
> > be
> > > able to find the proper documentation under kafka.apache.org.
> > > * Documentation:
> > > https://kafka.apache.org/38/documentation.html
> > >
> > > * Protocol:
> > > https://kafka.apache.org/38/protocol.html
> > >
> > > * Successful Jenkins builds for the 3.8 branch:Unit/integration tests:
> > >
> > >
> >
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%252Fkafka/detail/3.8/67/
> > > (Some known flaky tests and builds from 64 to 68 show tests passing at
> > > least once). Additionally, this is the CI run for the changes between
> RC0
> > > and RC1:
> > >
> > >
> >
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-16593/1/pipeline/
> > >
> > > System tests: (Same as before)
> > >
> > >
> >
> https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-07-10--001.f1f05b43-3574-45cb-836e-8968f02d722f--1720631619--apache--3.8--4ecbb75c1f/report.html
> > >
> > > * Successful Docker Image Github Actions Pipeline for 3.8 branch:
> > > Docker Build Test Pipeline (JVM):
> > > https://github.com/apache/kafka/actions/runs/9941446092
> > > Docker Build Test Pipeline (Native):
> > > https://github.com/apache/kafka/actions/runs/9941449561
> > >
> > > Best,
> > > --
> > > [image: Aiven] <https://www.aiven.io>
> > >
> > > *Josep Prat*
> > > Open Source Engineering Director, *Aiven*
> > > josep.prat@aiven.io | +491715557497
> > > aiven.io <https://www.aiven.io> | <
> > https://www.facebook.com/aivencloud
> > > >
> > > <https://www.linkedin.com/company/aiven/> <
> > > https://twitter.com/aiven_io>
> > > *Aiven Deutschland GmbH*
> > > Alexanderufer 3-7, 10117 Berlin
> > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > > Amtsgericht Charlottenburg, HRB 209739 B
> > >
> >
>
Re: [VOTE] 3.8.0 RC1
Posted by Greg Harris <gr...@aiven.io.INVALID>.
Hi Josep,
I found this blocker regression:
https://issues.apache.org/jira/browse/KAFKA-17150
Summary: Connector configurations that specified converters with aliases
(e.g. JsonConverter instead of org.apache.kafka.connect.json.JsonConverter)
previously worked, and in this RC they throw validation exceptions and are
unable to start/run.
Severity: This would take tasks offline completely until the workers are
downgraded or the connectors are reconfigured with full class names
Impact: Aliases are commonly used in demos, and slightly less commonly used
in production environments. It is by no means a demo-only feature, and I
would expect this to break at least one production workload.
Risk: I've opened a PR to resolve it here:
https://github.com/apache/kafka/pull/16608 . We've already solved this bug
once before, so it seems low-risk to widen the scope of the original fix to
cover this new case.
I found this apparent bug, but as it doesn't appear to be a regression and
has very low severity, I don't think it's a blocker on its own:
https://issues.apache.org/jira/browse/KAFKA-17148
If we're rolling a new RC, hopefully we can include this if it's resolved
quickly.
I also performed the following successful verifications:
1. Verified that protected members don't appear in the generated javadocs
(KAFKA-14839)
2. Verified that Connect Distributed can start against a Kraft cluster
3. Verified that plugin scanning doesn't throw errors with jackson
(KAFKA-17111)
4. Verified that the allowed.paths configuration works for
DirectoryConfigProvider (KIP-993)
Unfortunately due to the blocker regression, I think I'll have to -1
(binding) this RC. Sorry!
Thanks,
Greg
On Tue, Jul 16, 2024 at 1:32 PM Jakub Scholz <ja...@scholz.cz> wrote:
> +1 (non-binding). I used the staged Scala 2.13 binaries and the staged
> Maven artifacts. All seems to work fine. Thanks!
>
> Jakub
>
> On Mon, Jul 15, 2024 at 5:53 PM Josep Prat <jo...@aiven.io.invalid>
> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the second release candidate for Apache Kafka 3.8.0.
> >
> > Some of the major features included in this release are:
> > * KIP-1028: Docker Official Image for Apache Kafka
> > * KIP-974: Docker Image for GraalVM based Native Kafka Broker
> > * KIP-1036: Extend RecordDeserializationException exception
> > * KIP-1019: Expose method to determine Metric Measurability
> > * KIP-1004: Enforce tasks.max property in Kafka Connect
> > * KIP-989: Improved StateStore Iterator metrics for detecting leaks
> > * KIP-993: Allow restricting files accessed by File and Directory
> > ConfigProviders
> > * KIP-924: customizable task assignment for Streams
> > * KIP-813: Shareable State Stores
> > * KIP-719: Deprecate Log4J Appender
> > * KIP-390: Support Compression Level
> > * KIP-1018: Introduce max remote fetch timeout config for
> > DelayedRemoteFetch requests
> > * KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission
> > * KIP-1047 Introduce new org.apache.kafka.tools.api.Decoder to replace
> > kafka.serializer.Decoder
> > * KIP-899: Allow producer and consumer clients to rebootstrap
> >
> > Release notes for the 3.8.0 release:
> > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/RELEASE_NOTES.html
> >
> > **** Please download, test and vote by Thursday, July 18th, 12pm PT*
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/
> >
> > * Docker release artifact to be voted upon(apache/kafka-native is
> supported
> > from 3.8+ release.):
> > apache/kafka:3.8.0-rc1
> > apache/kafka-native:3.8.0-rc1
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/javadoc/
> >
> > * Tag to be voted upon (off 3.8 branch) is the 3.8.0 tag:
> > https://github.com/apache/kafka/releases/tag/3.8.0-rc1
> >
> > Once https://github.com/apache/kafka-site/pull/608 is merged. You will
> be
> > able to find the proper documentation under kafka.apache.org.
> > * Documentation:
> > https://kafka.apache.org/38/documentation.html
> >
> > * Protocol:
> > https://kafka.apache.org/38/protocol.html
> >
> > * Successful Jenkins builds for the 3.8 branch:Unit/integration tests:
> >
> >
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%252Fkafka/detail/3.8/67/
> > (Some known flaky tests and builds from 64 to 68 show tests passing at
> > least once). Additionally, this is the CI run for the changes between RC0
> > and RC1:
> >
> >
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-16593/1/pipeline/
> >
> > System tests: (Same as before)
> >
> >
> https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-07-10--001.f1f05b43-3574-45cb-836e-8968f02d722f--1720631619--apache--3.8--4ecbb75c1f/report.html
> >
> > * Successful Docker Image Github Actions Pipeline for 3.8 branch:
> > Docker Build Test Pipeline (JVM):
> > https://github.com/apache/kafka/actions/runs/9941446092
> > Docker Build Test Pipeline (Native):
> > https://github.com/apache/kafka/actions/runs/9941449561
> >
> > Best,
> > --
> > [image: Aiven] <https://www.aiven.io>
> >
> > *Josep Prat*
> > Open Source Engineering Director, *Aiven*
> > josep.prat@aiven.io | +491715557497
> > aiven.io <https://www.aiven.io> | <
> https://www.facebook.com/aivencloud
> > >
> > <https://www.linkedin.com/company/aiven/> <
> > https://twitter.com/aiven_io>
> > *Aiven Deutschland GmbH*
> > Alexanderufer 3-7, 10117 Berlin
> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > Amtsgericht Charlottenburg, HRB 209739 B
> >
>
Re: [VOTE] 3.8.0 RC1
Posted by Greg Harris <gr...@aiven.io.INVALID>.
Hi Josep,
I found this blocker regression:
https://issues.apache.org/jira/browse/KAFKA-17150
Summary: Connector configurations that specified converters with aliases
(e.g. JsonConverter instead of org.apache.kafka.connect.json.JsonConverter)
previously worked, and in this RC they throw validation exceptions and are
unable to start/run.
Severity: This would take tasks offline completely until the workers are
downgraded or the connectors are reconfigured with full class names
Impact: Aliases are commonly used in demos, and slightly less commonly used
in production environments. It is by no means a demo-only feature, and I
would expect this to break at least one production workload.
Risk: I've opened a PR to resolve it here:
https://github.com/apache/kafka/pull/16608 . We've already solved this bug
once before, so it seems low-risk to widen the scope of the original fix to
cover this new case.
I found this apparent bug, but as it doesn't appear to be a regression and
has very low severity, I don't think it's a blocker on its own:
https://issues.apache.org/jira/browse/KAFKA-17148
If we're rolling a new RC, hopefully we can include this if it's resolved
quickly.
I also performed the following successful verifications:
1. Verified that protected members don't appear in the generated javadocs
(KAFKA-14839)
2. Verified that Connect Distributed can start against a Kraft cluster
3. Verified that plugin scanning doesn't throw errors with jackson
(KAFKA-17111)
4. Verified that the allowed.paths configuration works for
DirectoryConfigProvider (KIP-993)
Unfortunately due to the blocker regression, I think I'll have to -1
(binding) this RC. Sorry!
Thanks,
Greg
On Tue, Jul 16, 2024 at 1:32 PM Jakub Scholz <ja...@scholz.cz> wrote:
> +1 (non-binding). I used the staged Scala 2.13 binaries and the staged
> Maven artifacts. All seems to work fine. Thanks!
>
> Jakub
>
> On Mon, Jul 15, 2024 at 5:53 PM Josep Prat <jo...@aiven.io.invalid>
> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the second release candidate for Apache Kafka 3.8.0.
> >
> > Some of the major features included in this release are:
> > * KIP-1028: Docker Official Image for Apache Kafka
> > * KIP-974: Docker Image for GraalVM based Native Kafka Broker
> > * KIP-1036: Extend RecordDeserializationException exception
> > * KIP-1019: Expose method to determine Metric Measurability
> > * KIP-1004: Enforce tasks.max property in Kafka Connect
> > * KIP-989: Improved StateStore Iterator metrics for detecting leaks
> > * KIP-993: Allow restricting files accessed by File and Directory
> > ConfigProviders
> > * KIP-924: customizable task assignment for Streams
> > * KIP-813: Shareable State Stores
> > * KIP-719: Deprecate Log4J Appender
> > * KIP-390: Support Compression Level
> > * KIP-1018: Introduce max remote fetch timeout config for
> > DelayedRemoteFetch requests
> > * KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission
> > * KIP-1047 Introduce new org.apache.kafka.tools.api.Decoder to replace
> > kafka.serializer.Decoder
> > * KIP-899: Allow producer and consumer clients to rebootstrap
> >
> > Release notes for the 3.8.0 release:
> > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/RELEASE_NOTES.html
> >
> > **** Please download, test and vote by Thursday, July 18th, 12pm PT*
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/
> >
> > * Docker release artifact to be voted upon(apache/kafka-native is
> supported
> > from 3.8+ release.):
> > apache/kafka:3.8.0-rc1
> > apache/kafka-native:3.8.0-rc1
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~jlprat/kafka-3.8.0-rc1/javadoc/
> >
> > * Tag to be voted upon (off 3.8 branch) is the 3.8.0 tag:
> > https://github.com/apache/kafka/releases/tag/3.8.0-rc1
> >
> > Once https://github.com/apache/kafka-site/pull/608 is merged. You will
> be
> > able to find the proper documentation under kafka.apache.org.
> > * Documentation:
> > https://kafka.apache.org/38/documentation.html
> >
> > * Protocol:
> > https://kafka.apache.org/38/protocol.html
> >
> > * Successful Jenkins builds for the 3.8 branch:Unit/integration tests:
> >
> >
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%252Fkafka/detail/3.8/67/
> > (Some known flaky tests and builds from 64 to 68 show tests passing at
> > least once). Additionally, this is the CI run for the changes between RC0
> > and RC1:
> >
> >
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-16593/1/pipeline/
> >
> > System tests: (Same as before)
> >
> >
> https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-07-10--001.f1f05b43-3574-45cb-836e-8968f02d722f--1720631619--apache--3.8--4ecbb75c1f/report.html
> >
> > * Successful Docker Image Github Actions Pipeline for 3.8 branch:
> > Docker Build Test Pipeline (JVM):
> > https://github.com/apache/kafka/actions/runs/9941446092
> > Docker Build Test Pipeline (Native):
> > https://github.com/apache/kafka/actions/runs/9941449561
> >
> > Best,
> > --
> > [image: Aiven] <https://www.aiven.io>
> >
> > *Josep Prat*
> > Open Source Engineering Director, *Aiven*
> > josep.prat@aiven.io | +491715557497
> > aiven.io <https://www.aiven.io> | <
> https://www.facebook.com/aivencloud
> > >
> > <https://www.linkedin.com/company/aiven/> <
> > https://twitter.com/aiven_io>
> > *Aiven Deutschland GmbH*
> > Alexanderufer 3-7, 10117 Berlin
> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > Amtsgericht Charlottenburg, HRB 209739 B
> >
>
Re: [VOTE] 3.8.0 RC1
Posted by Jakub Scholz <ja...@scholz.cz>.
+1 (non-binding). I used the staged Scala 2.13 binaries and the staged
Maven artifacts. All seems to work fine. Thanks!
Jakub
On Mon, Jul 15, 2024 at 5:53 PM Josep Prat <jo...@aiven.io.invalid>
wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the second release candidate for Apache Kafka 3.8.0.
>
> Some of the major features included in this release are:
> * KIP-1028: Docker Official Image for Apache Kafka
> * KIP-974: Docker Image for GraalVM based Native Kafka Broker
> * KIP-1036: Extend RecordDeserializationException exception
> * KIP-1019: Expose method to determine Metric Measurability
> * KIP-1004: Enforce tasks.max property in Kafka Connect
> * KIP-989: Improved StateStore Iterator metrics for detecting leaks
> * KIP-993: Allow restricting files accessed by File and Directory
> ConfigProviders
> * KIP-924: customizable task assignment for Streams
> * KIP-813: Shareable State Stores
> * KIP-719: Deprecate Log4J Appender
> * KIP-390: Support Compression Level
> * KIP-1018: Introduce max remote fetch timeout config for
> DelayedRemoteFetch requests
> * KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission
> * KIP-1047 Introduce new org.apache.kafka.tools.api.Decoder to replace
> kafka.serializer.Decoder
> * KIP-899: Allow producer and consumer clients to rebootstrap
>
> Release notes for the 3.8.0 release:
> https://home.apache.org/~jlprat/kafka-3.8.0-rc1/RELEASE_NOTES.html
>
> **** Please download, test and vote by Thursday, July 18th, 12pm PT*
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~jlprat/kafka-3.8.0-rc1/
>
> * Docker release artifact to be voted upon(apache/kafka-native is supported
> from 3.8+ release.):
> apache/kafka:3.8.0-rc1
> apache/kafka-native:3.8.0-rc1
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~jlprat/kafka-3.8.0-rc1/javadoc/
>
> * Tag to be voted upon (off 3.8 branch) is the 3.8.0 tag:
> https://github.com/apache/kafka/releases/tag/3.8.0-rc1
>
> Once https://github.com/apache/kafka-site/pull/608 is merged. You will be
> able to find the proper documentation under kafka.apache.org.
> * Documentation:
> https://kafka.apache.org/38/documentation.html
>
> * Protocol:
> https://kafka.apache.org/38/protocol.html
>
> * Successful Jenkins builds for the 3.8 branch:Unit/integration tests:
>
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%252Fkafka/detail/3.8/67/
> (Some known flaky tests and builds from 64 to 68 show tests passing at
> least once). Additionally, this is the CI run for the changes between RC0
> and RC1:
>
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-16593/1/pipeline/
>
> System tests: (Same as before)
>
> https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-07-10--001.f1f05b43-3574-45cb-836e-8968f02d722f--1720631619--apache--3.8--4ecbb75c1f/report.html
>
> * Successful Docker Image Github Actions Pipeline for 3.8 branch:
> Docker Build Test Pipeline (JVM):
> https://github.com/apache/kafka/actions/runs/9941446092
> Docker Build Test Pipeline (Native):
> https://github.com/apache/kafka/actions/runs/9941449561
>
> Best,
> --
> [image: Aiven] <https://www.aiven.io>
>
> *Josep Prat*
> Open Source Engineering Director, *Aiven*
> josep.prat@aiven.io | +491715557497
> aiven.io <https://www.aiven.io> | <https://www.facebook.com/aivencloud
> >
> <https://www.linkedin.com/company/aiven/> <
> https://twitter.com/aiven_io>
> *Aiven Deutschland GmbH*
> Alexanderufer 3-7, 10117 Berlin
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> Amtsgericht Charlottenburg, HRB 209739 B
>
Re: [VOTE] 3.8.0 RC1
Posted by Jakub Scholz <ja...@scholz.cz>.
+1 (non-binding). I used the staged Scala 2.13 binaries and the staged
Maven artifacts. All seems to work fine. Thanks!
Jakub
On Mon, Jul 15, 2024 at 5:53 PM Josep Prat <jo...@aiven.io.invalid>
wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the second release candidate for Apache Kafka 3.8.0.
>
> Some of the major features included in this release are:
> * KIP-1028: Docker Official Image for Apache Kafka
> * KIP-974: Docker Image for GraalVM based Native Kafka Broker
> * KIP-1036: Extend RecordDeserializationException exception
> * KIP-1019: Expose method to determine Metric Measurability
> * KIP-1004: Enforce tasks.max property in Kafka Connect
> * KIP-989: Improved StateStore Iterator metrics for detecting leaks
> * KIP-993: Allow restricting files accessed by File and Directory
> ConfigProviders
> * KIP-924: customizable task assignment for Streams
> * KIP-813: Shareable State Stores
> * KIP-719: Deprecate Log4J Appender
> * KIP-390: Support Compression Level
> * KIP-1018: Introduce max remote fetch timeout config for
> DelayedRemoteFetch requests
> * KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission
> * KIP-1047 Introduce new org.apache.kafka.tools.api.Decoder to replace
> kafka.serializer.Decoder
> * KIP-899: Allow producer and consumer clients to rebootstrap
>
> Release notes for the 3.8.0 release:
> https://home.apache.org/~jlprat/kafka-3.8.0-rc1/RELEASE_NOTES.html
>
> **** Please download, test and vote by Thursday, July 18th, 12pm PT*
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~jlprat/kafka-3.8.0-rc1/
>
> * Docker release artifact to be voted upon(apache/kafka-native is supported
> from 3.8+ release.):
> apache/kafka:3.8.0-rc1
> apache/kafka-native:3.8.0-rc1
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~jlprat/kafka-3.8.0-rc1/javadoc/
>
> * Tag to be voted upon (off 3.8 branch) is the 3.8.0 tag:
> https://github.com/apache/kafka/releases/tag/3.8.0-rc1
>
> Once https://github.com/apache/kafka-site/pull/608 is merged. You will be
> able to find the proper documentation under kafka.apache.org.
> * Documentation:
> https://kafka.apache.org/38/documentation.html
>
> * Protocol:
> https://kafka.apache.org/38/protocol.html
>
> * Successful Jenkins builds for the 3.8 branch:Unit/integration tests:
>
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%252Fkafka/detail/3.8/67/
> (Some known flaky tests and builds from 64 to 68 show tests passing at
> least once). Additionally, this is the CI run for the changes between RC0
> and RC1:
>
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-16593/1/pipeline/
>
> System tests: (Same as before)
>
> https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-07-10--001.f1f05b43-3574-45cb-836e-8968f02d722f--1720631619--apache--3.8--4ecbb75c1f/report.html
>
> * Successful Docker Image Github Actions Pipeline for 3.8 branch:
> Docker Build Test Pipeline (JVM):
> https://github.com/apache/kafka/actions/runs/9941446092
> Docker Build Test Pipeline (Native):
> https://github.com/apache/kafka/actions/runs/9941449561
>
> Best,
> --
> [image: Aiven] <https://www.aiven.io>
>
> *Josep Prat*
> Open Source Engineering Director, *Aiven*
> josep.prat@aiven.io | +491715557497
> aiven.io <https://www.aiven.io> | <https://www.facebook.com/aivencloud
> >
> <https://www.linkedin.com/company/aiven/> <
> https://twitter.com/aiven_io>
> *Aiven Deutschland GmbH*
> Alexanderufer 3-7, 10117 Berlin
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> Amtsgericht Charlottenburg, HRB 209739 B
>
Re: [kafka-clients] [VOTE] 3.8.0 RC1
Posted by Igor Soarez <so...@apache.org>.
Hi Josep,
Thanks for running this release.
+1 non-binding. I performed the following checks:
- Verified signatures and checksums
- Built from source
- Basic workload against a KRaft cluster using the artifacts for both Scala versions
- Browsed Javadoc
- Checked LICENSE
Best,
--
Igor