You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "satishd (via GitHub)" <gi...@apache.org> on 2023/09/19 09:55:13 UTC
[GitHub] [kafka-site] satishd opened a new pull request, #547: Added a blog entry for 3.6.0 release
satishd opened a new pull request, #547:
URL: https://github.com/apache/kafka-site/pull/547
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "mimaison (via GitHub)" <gi...@apache.org>.
mimaison commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1345510589
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
Review Comment:
```suggestion
<li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b>: <a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a> reduces CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
Review Comment:
```suggestion
<li><b>KIP-937: Improve Message Timestamp Validation</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a> improves Producer's record timestamp validation.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
Review Comment:
```suggestion
<li><b>KIP-938: Add more metrics for measuring KRaft performance</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a> adds the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
Review Comment:
```suggestion
<li><b>KIP-941: Range queries to accept null lower and upper bounds</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> updates range queries to accept lower and upper bounds as null values.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
+ <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
Review Comment:
```suggestion
<li><b>KIP-898: Modernize Connect plugin discovery</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a> updates Connect so workers discover plugin classes using ServiceLoader manifests and module info during startup.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
Review Comment:
```suggestion
<li><b>KIP-917: Additional custom metadata for remote log segment</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a> adds custom metadata support for remote log segments.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
Review Comment:
```suggestion
<li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a> adds a grace period to Stream Table join.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
Review Comment:
```suggestion
<li><b>KIP-405: Kafka Tiered Storage</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a> introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
Review Comment:
```suggestion
<li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a> upgrades the ZooKeeper client to 3.8.2 as the current ZooKeeper dependency version 3.6.3 reached the end of life.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
Review Comment:
```suggestion
<li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a> adds support for topic-mutating SMTs for async sink connectors.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
Review Comment:
```suggestion
<p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
Review Comment:
```suggestion
<li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b>: <a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a> allows brokers to be configured with listeners that have same port on different IP stack like IPv4 and IPv6.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
+ <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ </ul>
+ <h3>Summary</h3>
+ <p>This was a community effort, so thank you to everyone who contributed to this release, including all our users and our 142 contributors:
+ A. Sophie Blee-Goldman, Aaron Ai, Abhijeet Kumar, aindriu-aiven, Akhilesh Chaganti, Alexandre Dupriez, Alexandre Garnier, Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew Schofield, Andrew Grant, Aneel Kumar, Anna Sophie Blee-Goldman, Anton Agestam, Artem Livshits, atu-sharm, bachmanity1, Bill Bejeck, Bo Gao, Bruno Cadonna, Calvin Liu, Chaitanya Mukka, Chase Thomas, Cheryl Simmons, Chia-Ping Tsai, Chris Egerton, Christo Lolov, Clay Johnson, Colin P. McCabe, Colin Patrick McCabe, Colt McNealy, d00791190, Damon Xie, Danica Fine, Daniel Scanteianu, Daniel Urban, David Arthur, David Jacot, David Mao, dengziming, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, DL1231, Dániel Urbán, Erik van Oosten, ezio, Farooq Qaiser, Federico Valeri, flashmouse, Florin Akermann, Gabriel Oliveira, Gantigmaa Selenge, Gaurav Narula, GeunJae Jeon, Greg Harris, Guozhang Wang, Hailey Ni, Hao Li, Hector Geraldino, hudeqi, hzh0425, Iblis Lin, iit2009060, Ismael Juma, Ivan Yurchen
ko, James Shaw, Jason Gustafson, Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstreet, Lucas Brutschy, Lucent-Wong, Lucia Cerchie, Luke Chen, Manikumar Reddy, Manyanda Chitimbo, Maros Orsak, Matthew de Detrich, Matthias J. Sax, maulin-vasavada, Max Riedel, Mehari Beyene, Michal Cabak (@miccab), Mickael Maison, Milind Mantri, minjian.cai, mojh7, Nikolay, Okada Haruki, Omnia G H Ibrahim, Owen Leung, Philip Nee, prasanthV, Proven Provenzano, Purshotam Chauhan, Qichao Chu, Qichao Chu (@ex172000), Rajini Sivaram, Randall Hauch, Renaldo Baur Filho, Ritika Reddy, Rittika Adhikari, Rohan, Ron Dagostino, Sagar Rao, Said Boudjelda, Sambhav Jain, Satish Duggana, sciclon2, Shekhar Rajak, Sungyun Hur, Sushant Mahajan, Tanay Karmarkar, tison, Tom Bentley, vamossagar12, Victoria
Xia, Vincent Jiang, vveicc, Walker Carlson, Yash Mayya, Yi-Sheng Lien, Ziming Deng, 蓝士钦
Review Comment:
There are a few duplicates:
- `A. Sophie Blee-Goldman` and `Anna Sophie Blee-Goldman`
- `Qichao Chu` and `Qichao Chu (@ex172000)`
- `Colin P. McCabe` and `Colin Patrick McCabe`
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
Review Comment:
```suggestion
<li><b>KIP-875: First-class offsets support in Kafka Connect</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a> adds support for resetting connector offsets in Connect.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
Review Comment:
```suggestion
<li><b>KIP-868: Metadata Transactions</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a> allows the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
```
##########
blog.html:
##########
@@ -22,6 +22,54 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
+ utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
Review Comment:
```suggestion
<li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a> renames ambiguous tiered storage metrics.</li>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1351381500
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now ready for usage in production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefore clusters
+ utilizing JBOD can not be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Release Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. For more information, please see the documentation for <a href="/documentation#zk_depr">ZooKeeper Deprecation</a></i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>:
+ Kafka Tiered Storage (Early Access): </b><br>Introduces Tiered Storage to Kafka. Note that this
+ is an early access feature only advised for use in non-production environments (see the <a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">early
+ access notes</a> for more information). This feature provides a separation of computation
+ and storage in the broker for pluggable storage tiering natively in Kafka Tiered Storage brings
+ a seamless extension of storage to remote objects with minimal operational changes.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-890</a>:
+ Transactions Server Side Defense (Part 1): </b><br>Hanging transactions can negatively impact
+ your read committed consumers and prevent compacted logs from being compacted. KIP-890 helps
+ address hanging transactions by verifying partition additions. Part 2 of KIP-890 will optimize
+ verification, which currently adds an extra hop.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>:
+ Accept duplicate listener on port for IPv4/IPv6: </b><br>Until now, Kafka has not supported
+ duplicate listeners on the same port. This works when using only a single IP stack, but presents
+ an issue if you are working with both IPv4 and IPv6. With KIP-797, brokers can be configured
+ with listeners that have the same port on different IP stacks. This update does not affect
+ advertised listeners, which already have this feature.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>:
+ Reduce CompletedFetch#parseRecord() memory copy: </b><br>reduces memory allocation and improves
+ memory performance during record deserialization by using a ByteBuffer instead of byte[] for
+ deserialization, which improves efficiency. Updated public interfaces include the Deserializer
+ class, ByteBufferDeserializer class, and StringDeserializer class.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>:
+ Metadata Transactions: </b><br> improves the overall durability of the KRaft layer by adding
+ metadata transactions that consist of:
+ <ul>
+ <li>ssBeginTransaction</li>
+ <li>Number of records</li>
+ <li>EndTransaction or AbortTransaction</li>
+ </ul>
+ KRaft uses record batches as a mechanism for atomicity. Typically, there was a limit to the
+ fetch size on the Raft consensus layer, and the controller could generate a set of atomic
+ records that exceeded this limit. This update introduces marker records that allow larger sets
+ of atomic records to be sent to the Raft consensus layer in multiple batches. This bypasses the
+ fetch limit.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>:
+ Upgrade Zookeeper to 3.8.2:</b>upgrades the ZooKeeper version that is bundled with Kafka to
+ version 3.8.2. The new version includes several updates and security improvements. This is the
+ last planned update for ZooKeeper in the 3.8.x releases, as it will be removed in Apache Kafka
+ 4.0 and replaced with KRaft.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>:
+ Additional custom metadata for remote log segment:</b><br> It introduces having an optional
+ custom metadata as part of remote log segment metadata. RemoteStorageManager returns the
+ optional custom metadata when copyLogSegmentData() is invoked. It will be passed along with
+ remote log segment metadata.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>:
+ Improve Message Timestamp Validation: </b> Improves data integrity and prevents potential
+ pitfalls caused by inaccurate timestamp handling by adding more validation logic for message
+ timestamps. While past timestamps are a normal occurrence in Kafka, future timestamps might
+ represent an incorrectly formatted integer. KIP-937 rejects messages with future timestamps and
+ provides a descriptive exemption.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>:
+ Add more metrics for measuring KRaft performance: </b><br> Adds new controller, loader, and
+ snapshot emitter KRaft performance metrics.
+ </li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>: Add A Grace Period to Stream Table Join: </b>Adds a grace period to stream-table joins to improve table-side out-of-order data handling. The joined object has a new method called .withGracePeriod that will cause the table side lookup to only happen after the grace period has passed.</li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a>: Range queries to accept null lower and upper bounds: </b>Previously, RangeQuery did not support null to specify “no upper/lower bound”.
+ KIP-941 allows users to pass null into withRange(...) for lower/upper bounds to specify a full or half-open range:
+ <ul>
+ <li>`withRange(null, null)` == `withNoBounds()`</li>
+ <li>`withRange(lower, null)` == `withLowerBound(lower)`</li>
+ <li>`withRange(null, upper)` == `withUpperBound(upper)`</li>
+ </ul>
+ </li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>: Allow sink connectors to be used with topic-mutating SMTs: </b><br>Adds support for topic-mutating SMTs for async sink connectors. This is to address an incompatibility between sink connectors overriding the SinkTask::preCommit method and SMTs that mutate the topic field of a SinkRecord .</li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>: First-class offsets support in Kafka Connect: </b><br>Provides first-class admin support for offsets in Kafka Connect. KIP-875 Part 1 added endpoints to get offsets and a new STOPPED state for connectors. The alter offsets and reset offsets endpoints have now been added.
+ <table>
+ <tr>
+ <th>Action</th>
+ <th>Description</th>
+ </tr>
+ <tr>
+ <td>GET /connectors/{connector}/offsets</td>
+ <td>Retrieve the offsets for a connector; the connector must exist</td>
+ </tr>
+ <tr>
+ <td>PATCH /connectors/{connector}/offsets</td>
+ <td>Alter the offsets for a connector; the connector must exist, and must be in the STOPPED state
+ </td>
+ </tr>
+ <tr>
+ <td>DELETE /connectors/{connector}/offsets</td>
+ <td>Reset the offsets for a connector; the connector must exist, and must be in the STOPPED state
+ </td>
+ </tr>
+ <tr>
+ <td>PUT /connectors/{connector}/pause</td>
+ <td>Pause the connector; the connector must exist</td>
+ </tr>
+ </table>
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>: Modernize Connect plugin discovery: </b><br>With KIP-898, Connect workers now read from ServiceLoader manifests and module info directly during startup for more efficient plugin class discovery. Note that this update requires connector developers to add service declarations to their plugins.</li>
Review Comment:
instead of "requires", added "allows". With that, it becomes `Note that this update allows connector developers to add service declarations to their plugins.`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] satishd commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1330802348
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.1</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1">KIP-902</a>. Zookeeper client upgraded to 3.8.1 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
Review Comment:
@divijvaidya @clolov Please update the KIP and references to 3.8.1. I will update the text here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] satishd commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331713531
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
+ <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ </ul>
+ <h3>Summary</h3>
+ <p>This was a community effort, so thank you to everyone who contributed to this release, including all our users and our 144 contributors:
+ A. Sophie Blee-Goldman, Aaron Ai, Abhijeet Kumar, aindriu-aiven, Akhilesh C, Akhilesh Chaganti, Alexandre Dupriez, Alexandre Garnier, Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew Schofield, andymg3, Aneel Kumar, Anna Sophie Blee-Goldman, Anton Agestam, Artem Livshits, atu-sharm, bachmanity1, Bill Bejeck, Bo Gao, Bruno Cadonna, Calvin Liu, Chaitanya Mukka, Chase Thomas, Cheryl Simmons, Chia-Ping Tsai, Chris Egerton, Christo Lolov, Clay Johnson, Colin P. McCabe, Colin Patrick McCabe, Colt McNealy, d00791190, Damon Xie, Danica Fine, Daniel Scanteianu, Daniel Urban, David Arthur, David Jacot, David Mao, dengziming, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, DL1231, Dániel Urbán, Erik van Oosten, ezio, Farooq Qaiser, Federico Valeri, flashmouse, Florin Akermann, Gabriel Oliveira, Gantigmaa Selenge, gaurav-narula, GeunJae Jeon, Greg Harris, Guozhang Wang, Hailey Ni, Hao Li, Hector Geraldino, hudeqi, hzh0425, Iblis Lin, iit2009060, Ismael Juma, Ivan
Yurchenko, James Shaw, Jason Gustafson, Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstreet, Lucas Brutschy, Lucent-Wong, Lucia Cerchie, Luke Chen, Manikumar Reddy, Manyanda Chitimbo, Maros Orsak, Matthew de Detrich, Matthias J. Sax, maulin-vasavada, Max Riedel, Mehari Beyene, Michal Cabak (@miccab), Mickael Maison, Milind Mantri, minjian.cai, mojh7, Nikolay, Okada Haruki, Omnia G H Ibrahim, Omnia G.H Ibrahim, Owen Leung, Philip Nee, prasanthV, Proven Provenzano, Purshotam Chauhan, Qichao Chu, Qichao Chu (@ex172000), Rajini Sivaram, Randall Hauch, Renaldo Baur Filho, Ritika Reddy, Rittika Adhikari, Rohan, Ron Dagostino, Sagar Rao, Said Boudjelda, Sambhav Jain, Satish Duggana, sciclon2, Shekhar Rajak, Sungyun Hur, Sushant Mahajan, Tanay Karmarkar, tison, Tom Bentl
ey, vamossagar12, Victoria Xia, Vincent Jiang, vveicc, Walker Carlson, Yash Mayya, Yi-Sheng Lien, Ziming Deng, 蓝士钦
Review Comment:
@gaurav-narula @mumrah Updated with the duplicate removal and other name changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] satishd commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1330823812
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.1</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1">KIP-902</a>. Zookeeper client upgraded to 3.8.1 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
+ <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ </ul>
+ <h3>Summary</h3>
+ <p>This was a community effort, so thank you to everyone who contributed to this release, including all our users and our 147 authors:
+ A. Sophie Blee-Goldman, Aaron Ai, Abhijeet Kumar, aindriu-aiven, Akhilesh C, Akhilesh Chaganti, Alexandre Dupriez, Alexandre Garnier, Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew Schofield, Greg Harris, andymg3, Aneel Kumar, Anna Sophie Blee-Goldman, Anton Agestam, Artem Livshits, atu-sharm, bachmanity1, Bill Bejeck, Bo Gao, Bruno Cadonna, Calvin Liu, Chaitanya Mukka, Chase Thomas, Cheryl Simmons, Chia-Ping Tsai, Chris Egerton, Christo Lolov, Christo Lolov (@clolov), Bill Bejeck, Clay Johnson, Colin P. McCabe, Colin Patrick McCabe, Colt McNealy, d00791190, Damon Xie, Danica Fine, Daniel Scanteianu, Daniel Urban, David Arthur, David Jacot, David Mao, dengziming, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, DL1231, Dániel Urbán, Erik van Oosten, ezio, Farooq Qaiser, Federico Valeri, flashmouse, Florin Akermann, Gabriel Oliveira, Gantigmaa Selenge, gaurav-narula, GeunJae Jeon, Greg Harris, Guozhang Wang, Hailey Ni, Hao Li, Hector Geraldino, hudeqi,
hzh0425, Iblis Lin, iit2009060, Ismael Juma, Ivan Yurchenko, James Shaw, Jason Gustafson, Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstreet, Lucas Brutschy, Lucent-Wong, Lucia Cerchie, Luke Chen, Manikumar Reddy, Manyanda Chitimbo, Maros Orsak, Matthew de Detrich, Matthias J. Sax, maulin-vasavada, Max Riedel, Mehari Beyene, Michal Cabak (@miccab), John Roesler, Mickael Maison, Milind Mantri, minjian.cai, mojh7, Nikolay, Okada Haruki, Omnia G H Ibrahim, Omnia G.H Ibrahim, Owen Leung, Philip Nee, prasanthV, Proven Provenzano, Purshotam Chauhan, Qichao Chu, Qichao Chu (@ex172000), Chris Egerton, Qichao Chu (@ex172000), Mickael Maison, Rajini Sivaram, Randall Hauch, Renaldo Baur Filho, Victoria Xia, Ritika Reddy, Rittika Adhikari, Rohan, Ron Dagostino, Sagar Rao,
Said Boudjelda, Sambhav Jain, Satish Duggana, sciclon2, Shekhar Rajak, Sungyun Hur, Sushant Mahajan, Tanay Karmarkar, tison, Tom Bentley, vamossagar12, Victoria Xia, Vincent Jiang, vveicc, Walker Carlson, Yash Mayya, Yi-Sheng Lien, Ziming Deng, 蓝士钦
Review Comment:
Removed a few other duplicate names and updated it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] mumrah commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "mumrah (via GitHub)" <gi...@apache.org>.
mumrah commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331517587
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
+ <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ </ul>
+ <h3>Summary</h3>
+ <p>This was a community effort, so thank you to everyone who contributed to this release, including all our users and our 144 contributors:
+ A. Sophie Blee-Goldman, Aaron Ai, Abhijeet Kumar, aindriu-aiven, Akhilesh C, Akhilesh Chaganti, Alexandre Dupriez, Alexandre Garnier, Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew Schofield, andymg3, Aneel Kumar, Anna Sophie Blee-Goldman, Anton Agestam, Artem Livshits, atu-sharm, bachmanity1, Bill Bejeck, Bo Gao, Bruno Cadonna, Calvin Liu, Chaitanya Mukka, Chase Thomas, Cheryl Simmons, Chia-Ping Tsai, Chris Egerton, Christo Lolov, Clay Johnson, Colin P. McCabe, Colin Patrick McCabe, Colt McNealy, d00791190, Damon Xie, Danica Fine, Daniel Scanteianu, Daniel Urban, David Arthur, David Jacot, David Mao, dengziming, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, DL1231, Dániel Urbán, Erik van Oosten, ezio, Farooq Qaiser, Federico Valeri, flashmouse, Florin Akermann, Gabriel Oliveira, Gantigmaa Selenge, gaurav-narula, GeunJae Jeon, Greg Harris, Guozhang Wang, Hailey Ni, Hao Li, Hector Geraldino, hudeqi, hzh0425, Iblis Lin, iit2009060, Ismael Juma, Ivan
Yurchenko, James Shaw, Jason Gustafson, Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstreet, Lucas Brutschy, Lucent-Wong, Lucia Cerchie, Luke Chen, Manikumar Reddy, Manyanda Chitimbo, Maros Orsak, Matthew de Detrich, Matthias J. Sax, maulin-vasavada, Max Riedel, Mehari Beyene, Michal Cabak (@miccab), Mickael Maison, Milind Mantri, minjian.cai, mojh7, Nikolay, Okada Haruki, Omnia G H Ibrahim, Omnia G.H Ibrahim, Owen Leung, Philip Nee, prasanthV, Proven Provenzano, Purshotam Chauhan, Qichao Chu, Qichao Chu (@ex172000), Rajini Sivaram, Randall Hauch, Renaldo Baur Filho, Ritika Reddy, Rittika Adhikari, Rohan, Ron Dagostino, Sagar Rao, Said Boudjelda, Sambhav Jain, Satish Duggana, sciclon2, Shekhar Rajak, Sungyun Hur, Sushant Mahajan, Tanay Karmarkar, tison, Tom Bentl
ey, vamossagar12, Victoria Xia, Vincent Jiang, vveicc, Walker Carlson, Yash Mayya, Yi-Sheng Lien, Ziming Deng, 蓝士钦
Review Comment:
Here's a few more changes to this list:
* Remove "Akhilesh C" since it's a duplicate of "Akhilesh Chaganti"
* Change andymg3 to "Andrew Grant"
* Remove "Colin P. McCabe" (duplicate of "Colin Patrick McCabe")
@dengziming, do you want your name here, or is you Github username okay?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] clolov commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "clolov (via GitHub)" <gi...@apache.org>.
clolov commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331664528
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.1</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1">KIP-902</a>. Zookeeper client upgraded to 3.8.1 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
Review Comment:
Updated
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on PR #547:
URL: https://github.com/apache/kafka-site/pull/547#issuecomment-1754340983
@mimaison @gharris1727 @jolshan Addressed the review comments with the latest commit.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd merged PR #547:
URL: https://github.com/apache/kafka-site/pull/547
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1349603237
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
Review Comment:
I will update the release date with the date the release announcement is made.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] satishd commented on pull request #547: Added a blog entry for 3.6.0 release
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on PR #547:
URL: https://github.com/apache/kafka-site/pull/547#issuecomment-1727830289
@mumrah @divijvaidya Thanks for the review. Addressed the review comments with the latest commits.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on PR #547:
URL: https://github.com/apache/kafka-site/pull/547#issuecomment-1750064512
@mimaison Earlier I did not update the PR completely earlier based on the review comments as we were planning to update the KIP items section with more details as received from others' feedback. I have updated the PR with each KIP description and with minor format changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1351387052
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now ready for usage in production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefore clusters
+ utilizing JBOD can not be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Release Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. For more information, please see the documentation for <a href="/documentation#zk_depr">ZooKeeper Deprecation</a></i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>:
+ Kafka Tiered Storage (Early Access): </b><br>Introduces Tiered Storage to Kafka. Note that this
+ is an early access feature only advised for use in non-production environments (see the <a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">early
+ access notes</a> for more information). This feature provides a separation of computation
+ and storage in the broker for pluggable storage tiering natively in Kafka Tiered Storage brings
+ a seamless extension of storage to remote objects with minimal operational changes.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-890</a>:
+ Transactions Server Side Defense (Part 1): </b><br>Hanging transactions can negatively impact
+ your read committed consumers and prevent compacted logs from being compacted. KIP-890 helps
+ address hanging transactions by verifying partition additions. Part 2 of KIP-890 will optimize
+ verification, which currently adds an extra hop.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>:
+ Accept duplicate listener on port for IPv4/IPv6: </b><br>Until now, Kafka has not supported
+ duplicate listeners on the same port. This works when using only a single IP stack, but presents
+ an issue if you are working with both IPv4 and IPv6. With KIP-797, brokers can be configured
+ with listeners that have the same port on different IP stacks. This update does not affect
+ advertised listeners, which already have this feature.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>:
+ Reduce CompletedFetch#parseRecord() memory copy: </b><br>reduces memory allocation and improves
+ memory performance during record deserialization by using a ByteBuffer instead of byte[] for
+ deserialization, which improves efficiency. Updated public interfaces include the Deserializer
+ class, ByteBufferDeserializer class, and StringDeserializer class.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>:
+ Metadata Transactions: </b><br> improves the overall durability of the KRaft layer by adding
+ metadata transactions that consist of:
+ <ul>
+ <li>ssBeginTransaction</li>
+ <li>Number of records</li>
+ <li>EndTransaction or AbortTransaction</li>
+ </ul>
+ KRaft uses record batches as a mechanism for atomicity. Typically, there was a limit to the
+ fetch size on the Raft consensus layer, and the controller could generate a set of atomic
+ records that exceeded this limit. This update introduces marker records that allow larger sets
+ of atomic records to be sent to the Raft consensus layer in multiple batches. This bypasses the
+ fetch limit.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>:
+ Upgrade Zookeeper to 3.8.2:</b>upgrades the ZooKeeper version that is bundled with Kafka to
+ version 3.8.2. The new version includes several updates and security improvements. This is the
+ last planned update for ZooKeeper in the 3.8.x releases, as it will be removed in Apache Kafka
Review Comment:
It meant the last time to update but any critical fixes or CVE updates will be honoured. Removed this sentence as suggested to avoid any confusion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] jolshan commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "jolshan (via GitHub)" <gi...@apache.org>.
jolshan commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1330577105
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.1</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1">KIP-902</a>. Zookeeper client upgraded to 3.8.1 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
+ <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ </ul>
+ <h3>Summary</h3>
+ <p>This was a community effort, so thank you to everyone who contributed to this release, including all our users and our 147 authors:
+ A. Sophie Blee-Goldman, Aaron Ai, Abhijeet Kumar, aindriu-aiven, Akhilesh C, Akhilesh Chaganti, Alexandre Dupriez, Alexandre Garnier, Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew Schofield, Greg Harris, andymg3, Aneel Kumar, Anna Sophie Blee-Goldman, Anton Agestam, Artem Livshits, atu-sharm, bachmanity1, Bill Bejeck, Bo Gao, Bruno Cadonna, Calvin Liu, Chaitanya Mukka, Chase Thomas, Cheryl Simmons, Chia-Ping Tsai, Chris Egerton, Christo Lolov, Christo Lolov (@clolov), Bill Bejeck, Clay Johnson, Colin P. McCabe, Colin Patrick McCabe, Colt McNealy, d00791190, Damon Xie, Danica Fine, Daniel Scanteianu, Daniel Urban, David Arthur, David Jacot, David Mao, dengziming, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, DL1231, Dániel Urbán, Erik van Oosten, ezio, Farooq Qaiser, Federico Valeri, flashmouse, Florin Akermann, Gabriel Oliveira, Gantigmaa Selenge, gaurav-narula, GeunJae Jeon, Greg Harris, Guozhang Wang, Hailey Ni, Hao Li, Hector Geraldino, hudeqi,
hzh0425, Iblis Lin, iit2009060, Ismael Juma, Ivan Yurchenko, James Shaw, Jason Gustafson, Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstreet, Lucas Brutschy, Lucent-Wong, Lucia Cerchie, Luke Chen, Manikumar Reddy, Manyanda Chitimbo, Maros Orsak, Matthew de Detrich, Matthias J. Sax, maulin-vasavada, Max Riedel, Mehari Beyene, Michal Cabak (@miccab), John Roesler, Mickael Maison, Milind Mantri, minjian.cai, mojh7, Nikolay, Okada Haruki, Omnia G H Ibrahim, Omnia G.H Ibrahim, Owen Leung, Philip Nee, prasanthV, Proven Provenzano, Purshotam Chauhan, Qichao Chu, Qichao Chu (@ex172000), Chris Egerton, Qichao Chu (@ex172000), Mickael Maison, Rajini Sivaram, Randall Hauch, Renaldo Baur Filho, Victoria Xia, Ritika Reddy, Rittika Adhikari, Rohan, Ron Dagostino, Sagar Rao,
Said Boudjelda, Sambhav Jain, Satish Duggana, sciclon2, Shekhar Rajak, Sungyun Hur, Sushant Mahajan, Tanay Karmarkar, tison, Tom Bentley, vamossagar12, Victoria Xia, Vincent Jiang, vveicc, Walker Carlson, Yash Mayya, Yi-Sheng Lien, Ziming Deng, 蓝士钦
Review Comment:
Seems there is a section of duplicate names here:
`Chris Egerton, Qichao Chu (@ex172000), Mickael Maison,`
These names are also not in alphabetical order like the others.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] divijvaidya commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "divijvaidya (via GitHub)" <gi...@apache.org>.
divijvaidya commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1330040052
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.1</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1">KIP-902</a>. Zookeeper client upgraded to 3.8.1 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
Review Comment:
It's actually version 3.8.2. The KIP title is not updated.
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
Review Comment:
Should we add a note about support of delegation token for kraft? [1]
Suggesting this because it takes us one step closer to completing the missing features for kraft https://kafka.apache.org/documentation.html#kraft_missing
[1] https://issues.apache.org/jira/browse/KAFKA-15219
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.1</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1">KIP-902</a>. Zookeeper client upgraded to 3.8.1 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
+ <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ </ul>
+ <h3>Summary</h3>
+ <p>This was a community effort, so thank you to everyone who contributed to this release, including all our users and our 147 authors:
Review Comment:
With this release we have started adding code reviewers as well as authors in this list [1]. Perhaps we can change the word `authors` to `contributors`.
[1] https://github.com/apache/kafka/pull/14288
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] divijvaidya commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "divijvaidya (via GitHub)" <gi...@apache.org>.
divijvaidya commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331252329
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
Review Comment:
Correct me I am wrong but delegation token support is different from Zk to KRaft migration.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "mimaison (via GitHub)" <gi...@apache.org>.
mimaison commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1347093948
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
</ul>
<h3>Kafka Streams</h3>
<ul>
- <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
- <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
Review Comment:
We're missing a space (and dot) between `KIP-923` and `Added`
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
Review Comment:
What about `This allows <code>RemoteStorageManager</code> implementation to attach custom metadata to remote log segments that can be used by storage systems to adjust the way they are stored.`?
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
Review Comment:
What about: `This reduces the memory usage of consumers by avoiding making copies in Deserializers.`?
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
</ul>
<h3>Kafka Streams</h3>
<ul>
- <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
- <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
</ul>
<h3>Kafka Connect</h3>
<ul>
- <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
- <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
- <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
Review Comment:
What about: `This allows transformations that update the topic of records to be used with sink connectors that use their own mechanism to track offsets.`?
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
</ul>
<h3>Kafka Streams</h3>
<ul>
- <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
- <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
Review Comment:
What about using `This simplifies making range queries using only an upper or lower bound` for the description?
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
</ul>
<h3>Kafka Streams</h3>
<ul>
- <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
- <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
Review Comment:
Missing a dot after `KIP-941`
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
</ul>
<h3>Kafka Streams</h3>
<ul>
- <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
- <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
</ul>
<h3>Kafka Connect</h3>
<ul>
- <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
- <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
- <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
+ <li><b>KIP-898: Modernize Connect plugin discovery: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
Review Comment:
Missing a space before `The`
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
Review Comment:
What about: `This improved the naming of Tiered Storage metrics to make them more user friendly.`?
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
</ul>
<h3>Kafka Streams</h3>
<ul>
- <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
- <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
Review Comment:
What about `This adds a grace period buffer to the stream side of Stream Table joins to improve processing of out of order data`?
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
Review Comment:
What about: `This adds 2 new configurations to brokers, <code>log.message.timestamp.before.max.ms</code> and <code>log.message.timestamp.after.max.ms</code> to allow broker to validate timestamp of records and reject them if their timestamps are outside of the configured range.`?
##########
blog.html:
##########
@@ -39,35 +39,35 @@ <h2 class="bullet">
for details regarding KRaft and JBOD.
</p>
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
- <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
<p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p>
<h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
<ul>
- <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
- <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
- <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
- <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
- <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
- <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
- <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
- <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
- <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ <li><b>KIP-405: Kafka Tiered Storage: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy: </b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current Zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
</ul>
<h3>Kafka Streams</h3>
<ul>
- <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
- <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
</ul>
<h3>Kafka Connect</h3>
<ul>
- <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
- <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
- <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect: </b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
Review Comment:
What about: `This add new endpoints to the Connect REST API to retrieve and reset the offsets of connectors.`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "gharris1727 (via GitHub)" <gi...@apache.org>.
gharris1727 commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1350763659
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now ready for usage in production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefore clusters
+ utilizing JBOD can not be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Release Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. For more information, please see the documentation for <a href="/documentation#zk_depr">ZooKeeper Deprecation</a></i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>:
+ Kafka Tiered Storage (Early Access): </b><br>Introduces Tiered Storage to Kafka. Note that this
+ is an early access feature only advised for use in non-production environments (see the <a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">early
+ access notes</a> for more information). This feature provides a separation of computation
+ and storage in the broker for pluggable storage tiering natively in Kafka Tiered Storage brings
+ a seamless extension of storage to remote objects with minimal operational changes.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-890</a>:
+ Transactions Server Side Defense (Part 1): </b><br>Hanging transactions can negatively impact
+ your read committed consumers and prevent compacted logs from being compacted. KIP-890 helps
+ address hanging transactions by verifying partition additions. Part 2 of KIP-890 will optimize
+ verification, which currently adds an extra hop.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>:
+ Accept duplicate listener on port for IPv4/IPv6: </b><br>Until now, Kafka has not supported
+ duplicate listeners on the same port. This works when using only a single IP stack, but presents
+ an issue if you are working with both IPv4 and IPv6. With KIP-797, brokers can be configured
+ with listeners that have the same port on different IP stacks. This update does not affect
+ advertised listeners, which already have this feature.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>:
+ Reduce CompletedFetch#parseRecord() memory copy: </b><br>reduces memory allocation and improves
+ memory performance during record deserialization by using a ByteBuffer instead of byte[] for
+ deserialization, which improves efficiency. Updated public interfaces include the Deserializer
+ class, ByteBufferDeserializer class, and StringDeserializer class.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>:
+ Metadata Transactions: </b><br> improves the overall durability of the KRaft layer by adding
+ metadata transactions that consist of:
+ <ul>
+ <li>ssBeginTransaction</li>
+ <li>Number of records</li>
+ <li>EndTransaction or AbortTransaction</li>
+ </ul>
+ KRaft uses record batches as a mechanism for atomicity. Typically, there was a limit to the
+ fetch size on the Raft consensus layer, and the controller could generate a set of atomic
+ records that exceeded this limit. This update introduces marker records that allow larger sets
+ of atomic records to be sent to the Raft consensus layer in multiple batches. This bypasses the
+ fetch limit.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>:
+ Upgrade Zookeeper to 3.8.2:</b>upgrades the ZooKeeper version that is bundled with Kafka to
+ version 3.8.2. The new version includes several updates and security improvements. This is the
+ last planned update for ZooKeeper in the 3.8.x releases, as it will be removed in Apache Kafka
+ 4.0 and replaced with KRaft.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>:
+ Additional custom metadata for remote log segment:</b><br> It introduces having an optional
+ custom metadata as part of remote log segment metadata. RemoteStorageManager returns the
+ optional custom metadata when copyLogSegmentData() is invoked. It will be passed along with
+ remote log segment metadata.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>:
+ Improve Message Timestamp Validation: </b> Improves data integrity and prevents potential
+ pitfalls caused by inaccurate timestamp handling by adding more validation logic for message
+ timestamps. While past timestamps are a normal occurrence in Kafka, future timestamps might
+ represent an incorrectly formatted integer. KIP-937 rejects messages with future timestamps and
+ provides a descriptive exemption.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>:
+ Add more metrics for measuring KRaft performance: </b><br> Adds new controller, loader, and
+ snapshot emitter KRaft performance metrics.
+ </li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>: Add A Grace Period to Stream Table Join: </b>Adds a grace period to stream-table joins to improve table-side out-of-order data handling. The joined object has a new method called .withGracePeriod that will cause the table side lookup to only happen after the grace period has passed.</li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a>: Range queries to accept null lower and upper bounds: </b>Previously, RangeQuery did not support null to specify “no upper/lower bound”.
+ KIP-941 allows users to pass null into withRange(...) for lower/upper bounds to specify a full or half-open range:
+ <ul>
+ <li>`withRange(null, null)` == `withNoBounds()`</li>
+ <li>`withRange(lower, null)` == `withLowerBound(lower)`</li>
+ <li>`withRange(null, upper)` == `withUpperBound(upper)`</li>
+ </ul>
+ </li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>: Allow sink connectors to be used with topic-mutating SMTs: </b><br>Adds support for topic-mutating SMTs for async sink connectors. This is to address an incompatibility between sink connectors overriding the SinkTask::preCommit method and SMTs that mutate the topic field of a SinkRecord .</li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>: First-class offsets support in Kafka Connect: </b><br>Provides first-class admin support for offsets in Kafka Connect. KIP-875 Part 1 added endpoints to get offsets and a new STOPPED state for connectors. The alter offsets and reset offsets endpoints have now been added.
+ <table>
+ <tr>
+ <th>Action</th>
+ <th>Description</th>
+ </tr>
+ <tr>
+ <td>GET /connectors/{connector}/offsets</td>
+ <td>Retrieve the offsets for a connector; the connector must exist</td>
+ </tr>
+ <tr>
+ <td>PATCH /connectors/{connector}/offsets</td>
+ <td>Alter the offsets for a connector; the connector must exist, and must be in the STOPPED state
+ </td>
+ </tr>
+ <tr>
+ <td>DELETE /connectors/{connector}/offsets</td>
+ <td>Reset the offsets for a connector; the connector must exist, and must be in the STOPPED state
+ </td>
+ </tr>
+ <tr>
+ <td>PUT /connectors/{connector}/pause</td>
+ <td>Pause the connector; the connector must exist</td>
+ </tr>
+ </table>
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>: Modernize Connect plugin discovery: </b><br>With KIP-898, Connect workers now read from ServiceLoader manifests and module info directly during startup for more efficient plugin class discovery. Note that this update requires connector developers to add service declarations to their plugins.</li>
Review Comment:
Alternatively, just soften "requires" so that someone reading the release blog and not the KIP doesn't get the impression that this is a breaking change.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1353967595
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
Review Comment:
Updated the release date as October 10, 2023.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] satishd commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1330833102
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
Review Comment:
@mumrah is covering ZK to KRaft migration documentation in https://github.com/apache/kafka-site/pull/545/.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] mumrah commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "mumrah (via GitHub)" <gi...@apache.org>.
mumrah commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331519680
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
Review Comment:
nit: `<it>` tags should be `<i>`
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
Review Comment:
```suggestion
<p>
The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration
<a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters
utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
for details regarding KRaft and JBOD.
</p>
```
Here's what I had in my other PR, let's just include it in this one.
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
Review Comment:
I agree, @divijvaidya, we should call out KRaft support for delegation tokens. How about a short blurb after the ZK migration paragraph:
```
<p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
```
cc @pprovenzano
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] satishd commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331784605
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
Review Comment:
I meant delegation token support as part of KRaft related updates, including the migration. Added the blurb as suggested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka-site] gaurav-narula commented on a diff in pull request #547: Added a blog entry for 3.6.0 release
Posted by "gaurav-narula (via GitHub)" <gi...@apache.org>.
gaurav-narula commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331193907
##########
blog.html:
##########
@@ -22,6 +22,46 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>The ability to migrate Kafka clusters from ZK to KRaft mode with no downtime is still an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration">KIP-866</a> for more details.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p>
+
+ <p><it>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</it><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li>
+ <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li>
+ <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li>
+ <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li>
+ <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li>
+ <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li>
+ <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li>
+ <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li>
+ <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li>
+ <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li>
+ <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li>
+ <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li>
+ </ul>
+ <h3>Summary</h3>
+ <p>This was a community effort, so thank you to everyone who contributed to this release, including all our users and our 144 contributors:
+ A. Sophie Blee-Goldman, Aaron Ai, Abhijeet Kumar, aindriu-aiven, Akhilesh C, Akhilesh Chaganti, Alexandre Dupriez, Alexandre Garnier, Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew Schofield, andymg3, Aneel Kumar, Anna Sophie Blee-Goldman, Anton Agestam, Artem Livshits, atu-sharm, bachmanity1, Bill Bejeck, Bo Gao, Bruno Cadonna, Calvin Liu, Chaitanya Mukka, Chase Thomas, Cheryl Simmons, Chia-Ping Tsai, Chris Egerton, Christo Lolov, Clay Johnson, Colin P. McCabe, Colin Patrick McCabe, Colt McNealy, d00791190, Damon Xie, Danica Fine, Daniel Scanteianu, Daniel Urban, David Arthur, David Jacot, David Mao, dengziming, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, DL1231, Dániel Urbán, Erik van Oosten, ezio, Farooq Qaiser, Federico Valeri, flashmouse, Florin Akermann, Gabriel Oliveira, Gantigmaa Selenge, gaurav-narula, GeunJae Jeon, Greg Harris, Guozhang Wang, Hailey Ni, Hao Li, Hector Geraldino, hudeqi, hzh0425, Iblis Lin, iit2009060, Ismael Juma, Ivan
Yurchenko, James Shaw, Jason Gustafson, Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstreet, Lucas Brutschy, Lucent-Wong, Lucia Cerchie, Luke Chen, Manikumar Reddy, Manyanda Chitimbo, Maros Orsak, Matthew de Detrich, Matthias J. Sax, maulin-vasavada, Max Riedel, Mehari Beyene, Michal Cabak (@miccab), Mickael Maison, Milind Mantri, minjian.cai, mojh7, Nikolay, Okada Haruki, Omnia G H Ibrahim, Omnia G.H Ibrahim, Owen Leung, Philip Nee, prasanthV, Proven Provenzano, Purshotam Chauhan, Qichao Chu, Qichao Chu (@ex172000), Rajini Sivaram, Randall Hauch, Renaldo Baur Filho, Ritika Reddy, Rittika Adhikari, Rohan, Ron Dagostino, Sagar Rao, Said Boudjelda, Sambhav Jain, Satish Duggana, sciclon2, Shekhar Rajak, Sungyun Hur, Sushant Mahajan, Tanay Karmarkar, tison, Tom Bentl
ey, vamossagar12, Victoria Xia, Vincent Jiang, vveicc, Walker Carlson, Yash Mayya, Yi-Sheng Lien, Ziming Deng, 蓝士钦
Review Comment:
I'd prefer my name, `Gaurav Narula` to be listed instead of my Github username `gaurav-narula`.
I believe there's duplication in `Omnia G H Ibrahim` and `Omnia G.H Ibrahim`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on PR #547:
URL: https://github.com/apache/kafka-site/pull/547#issuecomment-1750070114
@mimaison I did not update the PR completely earlier based on the review comments as we were planning to update the KIP items section with more details as received from others' feedback. I have updated the PR with each KIP description and with minor format changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "jolshan (via GitHub)" <gi...@apache.org>.
jolshan commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1350841290
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now ready for usage in production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefore clusters
+ utilizing JBOD can not be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Release Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. For more information, please see the documentation for <a href="/documentation#zk_depr">ZooKeeper Deprecation</a></i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>:
+ Kafka Tiered Storage (Early Access): </b><br>Introduces Tiered Storage to Kafka. Note that this
+ is an early access feature only advised for use in non-production environments (see the <a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">early
+ access notes</a> for more information). This feature provides a separation of computation
+ and storage in the broker for pluggable storage tiering natively in Kafka Tiered Storage brings
+ a seamless extension of storage to remote objects with minimal operational changes.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-890</a>:
+ Transactions Server Side Defense (Part 1): </b><br>Hanging transactions can negatively impact
Review Comment:
We should add a note that we missed the fix for offset commits. That will be addressed in the next release.
Something like.
In 3.6.0, transaction verification will prevent hanging transactions on data partitions. In the next release, transactional offset commits will also be covered.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "mimaison (via GitHub)" <gi...@apache.org>.
mimaison commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1350023124
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now ready for usage in production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefore clusters
+ utilizing JBOD can not be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Release Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. For more information, please see the documentation for <a href="/documentation#zk_depr">ZooKeeper Deprecation</a></i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>:
+ Kafka Tiered Storage (Early Access): </b><br>Introduces Tiered Storage to Kafka. Note that this
+ is an early access feature only advised for use in non-production environments (see the <a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">early
+ access notes</a> for more information). This feature provides a separation of computation
+ and storage in the broker for pluggable storage tiering natively in Kafka Tiered Storage brings
+ a seamless extension of storage to remote objects with minimal operational changes.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-890</a>:
+ Transactions Server Side Defense (Part 1): </b><br>Hanging transactions can negatively impact
+ your read committed consumers and prevent compacted logs from being compacted. KIP-890 helps
+ address hanging transactions by verifying partition additions. Part 2 of KIP-890 will optimize
+ verification, which currently adds an extra hop.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>:
+ Accept duplicate listener on port for IPv4/IPv6: </b><br>Until now, Kafka has not supported
+ duplicate listeners on the same port. This works when using only a single IP stack, but presents
+ an issue if you are working with both IPv4 and IPv6. With KIP-797, brokers can be configured
+ with listeners that have the same port on different IP stacks. This update does not affect
+ advertised listeners, which already have this feature.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>:
+ Reduce CompletedFetch#parseRecord() memory copy: </b><br>reduces memory allocation and improves
+ memory performance during record deserialization by using a ByteBuffer instead of byte[] for
+ deserialization, which improves efficiency. Updated public interfaces include the Deserializer
+ class, ByteBufferDeserializer class, and StringDeserializer class.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>:
+ Metadata Transactions: </b><br> improves the overall durability of the KRaft layer by adding
+ metadata transactions that consist of:
+ <ul>
+ <li>ssBeginTransaction</li>
+ <li>Number of records</li>
+ <li>EndTransaction or AbortTransaction</li>
+ </ul>
+ KRaft uses record batches as a mechanism for atomicity. Typically, there was a limit to the
+ fetch size on the Raft consensus layer, and the controller could generate a set of atomic
+ records that exceeded this limit. This update introduces marker records that allow larger sets
+ of atomic records to be sent to the Raft consensus layer in multiple batches. This bypasses the
+ fetch limit.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>:
+ Upgrade Zookeeper to 3.8.2:</b>upgrades the ZooKeeper version that is bundled with Kafka to
+ version 3.8.2. The new version includes several updates and security improvements. This is the
+ last planned update for ZooKeeper in the 3.8.x releases, as it will be removed in Apache Kafka
Review Comment:
Should `3.8.x releases` be `3.6.x releases`? As I think you mean it's the last time Kafka updates the ZooKeeper dependency. I'm actually not sure we want to say that. For example we may need to bump ZooKeeper's version if a CVE is found.
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now ready for usage in production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefore clusters
+ utilizing JBOD can not be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Release Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. For more information, please see the documentation for <a href="/documentation#zk_depr">ZooKeeper Deprecation</a></i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>:
+ Kafka Tiered Storage (Early Access): </b><br>Introduces Tiered Storage to Kafka. Note that this
+ is an early access feature only advised for use in non-production environments (see the <a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">early
+ access notes</a> for more information). This feature provides a separation of computation
+ and storage in the broker for pluggable storage tiering natively in Kafka Tiered Storage brings
+ a seamless extension of storage to remote objects with minimal operational changes.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-890</a>:
+ Transactions Server Side Defense (Part 1): </b><br>Hanging transactions can negatively impact
+ your read committed consumers and prevent compacted logs from being compacted. KIP-890 helps
+ address hanging transactions by verifying partition additions. Part 2 of KIP-890 will optimize
+ verification, which currently adds an extra hop.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>:
+ Accept duplicate listener on port for IPv4/IPv6: </b><br>Until now, Kafka has not supported
+ duplicate listeners on the same port. This works when using only a single IP stack, but presents
+ an issue if you are working with both IPv4 and IPv6. With KIP-797, brokers can be configured
+ with listeners that have the same port on different IP stacks. This update does not affect
+ advertised listeners, which already have this feature.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>:
+ Reduce CompletedFetch#parseRecord() memory copy: </b><br>reduces memory allocation and improves
+ memory performance during record deserialization by using a ByteBuffer instead of byte[] for
+ deserialization, which improves efficiency. Updated public interfaces include the Deserializer
+ class, ByteBufferDeserializer class, and StringDeserializer class.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>:
+ Metadata Transactions: </b><br> improves the overall durability of the KRaft layer by adding
+ metadata transactions that consist of:
+ <ul>
+ <li>ssBeginTransaction</li>
+ <li>Number of records</li>
+ <li>EndTransaction or AbortTransaction</li>
+ </ul>
+ KRaft uses record batches as a mechanism for atomicity. Typically, there was a limit to the
+ fetch size on the Raft consensus layer, and the controller could generate a set of atomic
+ records that exceeded this limit. This update introduces marker records that allow larger sets
+ of atomic records to be sent to the Raft consensus layer in multiple batches. This bypasses the
+ fetch limit.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>:
+ Upgrade Zookeeper to 3.8.2:</b>upgrades the ZooKeeper version that is bundled with Kafka to
Review Comment:
`upgrades` -> `This` upgrades`
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now ready for usage in production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefore clusters
+ utilizing JBOD can not be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Release Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. For more information, please see the documentation for <a href="/documentation#zk_depr">ZooKeeper Deprecation</a></i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>:
+ Kafka Tiered Storage (Early Access): </b><br>Introduces Tiered Storage to Kafka. Note that this
+ is an early access feature only advised for use in non-production environments (see the <a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">early
+ access notes</a> for more information). This feature provides a separation of computation
+ and storage in the broker for pluggable storage tiering natively in Kafka Tiered Storage brings
+ a seamless extension of storage to remote objects with minimal operational changes.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-890</a>:
+ Transactions Server Side Defense (Part 1): </b><br>Hanging transactions can negatively impact
+ your read committed consumers and prevent compacted logs from being compacted. KIP-890 helps
+ address hanging transactions by verifying partition additions. Part 2 of KIP-890 will optimize
+ verification, which currently adds an extra hop.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>:
+ Accept duplicate listener on port for IPv4/IPv6: </b><br>Until now, Kafka has not supported
+ duplicate listeners on the same port. This works when using only a single IP stack, but presents
+ an issue if you are working with both IPv4 and IPv6. With KIP-797, brokers can be configured
+ with listeners that have the same port on different IP stacks. This update does not affect
+ advertised listeners, which already have this feature.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>:
+ Reduce CompletedFetch#parseRecord() memory copy: </b><br>reduces memory allocation and improves
+ memory performance during record deserialization by using a ByteBuffer instead of byte[] for
+ deserialization, which improves efficiency. Updated public interfaces include the Deserializer
+ class, ByteBufferDeserializer class, and StringDeserializer class.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>:
+ Metadata Transactions: </b><br> improves the overall durability of the KRaft layer by adding
+ metadata transactions that consist of:
+ <ul>
+ <li>ssBeginTransaction</li>
Review Comment:
Should this be `BeginTransaction`?
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now ready for usage in production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefore clusters
+ utilizing JBOD can not be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Release Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. For more information, please see the documentation for <a href="/documentation#zk_depr">ZooKeeper Deprecation</a></i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>:
+ Kafka Tiered Storage (Early Access): </b><br>Introduces Tiered Storage to Kafka. Note that this
+ is an early access feature only advised for use in non-production environments (see the <a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">early
+ access notes</a> for more information). This feature provides a separation of computation
+ and storage in the broker for pluggable storage tiering natively in Kafka Tiered Storage brings
+ a seamless extension of storage to remote objects with minimal operational changes.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-890</a>:
+ Transactions Server Side Defense (Part 1): </b><br>Hanging transactions can negatively impact
+ your read committed consumers and prevent compacted logs from being compacted. KIP-890 helps
+ address hanging transactions by verifying partition additions. Part 2 of KIP-890 will optimize
+ verification, which currently adds an extra hop.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>:
+ Accept duplicate listener on port for IPv4/IPv6: </b><br>Until now, Kafka has not supported
+ duplicate listeners on the same port. This works when using only a single IP stack, but presents
+ an issue if you are working with both IPv4 and IPv6. With KIP-797, brokers can be configured
+ with listeners that have the same port on different IP stacks. This update does not affect
+ advertised listeners, which already have this feature.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>:
+ Reduce CompletedFetch#parseRecord() memory copy: </b><br>reduces memory allocation and improves
+ memory performance during record deserialization by using a ByteBuffer instead of byte[] for
+ deserialization, which improves efficiency. Updated public interfaces include the Deserializer
+ class, ByteBufferDeserializer class, and StringDeserializer class.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>:
+ Metadata Transactions: </b><br> improves the overall durability of the KRaft layer by adding
+ metadata transactions that consist of:
+ <ul>
+ <li>ssBeginTransaction</li>
+ <li>Number of records</li>
+ <li>EndTransaction or AbortTransaction</li>
+ </ul>
+ KRaft uses record batches as a mechanism for atomicity. Typically, there was a limit to the
+ fetch size on the Raft consensus layer, and the controller could generate a set of atomic
+ records that exceeded this limit. This update introduces marker records that allow larger sets
+ of atomic records to be sent to the Raft consensus layer in multiple batches. This bypasses the
+ fetch limit.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>:
+ Upgrade Zookeeper to 3.8.2:</b>upgrades the ZooKeeper version that is bundled with Kafka to
+ version 3.8.2. The new version includes several updates and security improvements. This is the
+ last planned update for ZooKeeper in the 3.8.x releases, as it will be removed in Apache Kafka
+ 4.0 and replaced with KRaft.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>:
+ Additional custom metadata for remote log segment:</b><br> It introduces having an optional
+ custom metadata as part of remote log segment metadata. RemoteStorageManager returns the
+ optional custom metadata when copyLogSegmentData() is invoked. It will be passed along with
+ remote log segment metadata.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>:
+ Improve Message Timestamp Validation: </b> Improves data integrity and prevents potential
+ pitfalls caused by inaccurate timestamp handling by adding more validation logic for message
+ timestamps. While past timestamps are a normal occurrence in Kafka, future timestamps might
+ represent an incorrectly formatted integer. KIP-937 rejects messages with future timestamps and
+ provides a descriptive exemption.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>:
+ Add more metrics for measuring KRaft performance: </b><br> Adds new controller, loader, and
+ snapshot emitter KRaft performance metrics.
+ </li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>: Add A Grace Period to Stream Table Join: </b>Adds a grace period to stream-table joins to improve table-side out-of-order data handling. The joined object has a new method called .withGracePeriod that will cause the table side lookup to only happen after the grace period has passed.</li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a>: Range queries to accept null lower and upper bounds: </b>Previously, RangeQuery did not support null to specify “no upper/lower bound”.
+ KIP-941 allows users to pass null into withRange(...) for lower/upper bounds to specify a full or half-open range:
+ <ul>
+ <li>`withRange(null, null)` == `withNoBounds()`</li>
+ <li>`withRange(lower, null)` == `withLowerBound(lower)`</li>
+ <li>`withRange(null, upper)` == `withUpperBound(upper)`</li>
+ </ul>
+ </li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>: Allow sink connectors to be used with topic-mutating SMTs: </b><br>Adds support for topic-mutating SMTs for async sink connectors. This is to address an incompatibility between sink connectors overriding the SinkTask::preCommit method and SMTs that mutate the topic field of a SinkRecord .</li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>: First-class offsets support in Kafka Connect: </b><br>Provides first-class admin support for offsets in Kafka Connect. KIP-875 Part 1 added endpoints to get offsets and a new STOPPED state for connectors. The alter offsets and reset offsets endpoints have now been added.
+ <table>
+ <tr>
+ <th>Action</th>
+ <th>Description</th>
+ </tr>
+ <tr>
+ <td>GET /connectors/{connector}/offsets</td>
+ <td>Retrieve the offsets for a connector; the connector must exist</td>
+ </tr>
+ <tr>
+ <td>PATCH /connectors/{connector}/offsets</td>
+ <td>Alter the offsets for a connector; the connector must exist, and must be in the STOPPED state
+ </td>
+ </tr>
+ <tr>
+ <td>DELETE /connectors/{connector}/offsets</td>
+ <td>Reset the offsets for a connector; the connector must exist, and must be in the STOPPED state
+ </td>
+ </tr>
+ <tr>
+ <td>PUT /connectors/{connector}/pause</td>
+ <td>Pause the connector; the connector must exist</td>
+ </tr>
+ </table>
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>: Modernize Connect plugin discovery: </b><br>With KIP-898, Connect workers now read from ServiceLoader manifests and module info directly during startup for more efficient plugin class discovery. Note that this update requires connector developers to add service declarations to their plugins.</li>
+ </ul>
+ <h3>Summary</h3>
+ <p>Ready to get started with Apache Kafka 3.6.0? Check out all of the details in the release notes and download Apache Kafka 3.6.0.</p>
Review Comment:
Should `release notes` and `download Apache Kafka 3.6.0` be links?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]
Posted by "gharris1727 (via GitHub)" <gi...@apache.org>.
gharris1727 commented on code in PR #547:
URL: https://github.com/apache/kafka-site/pull/547#discussion_r1350759025
##########
blog.html:
##########
@@ -22,6 +22,146 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_360_release_announcement"></a>
+ <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a>
+ </h2>
+ 08 Oct 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>)
+ <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p>
+ <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p>
+ <p>
+ The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is
+ now ready for usage in production environments. See the ZooKeeper to KRaft migration
+ <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for
+ details. Note that support for JBOD is still not available for KRaft clusters, therefore clusters
+ utilizing JBOD can not be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a>
+ for details regarding KRaft and JBOD.
+ </p>
+ <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p>
+ <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Release Notes</a> for more details.</p>
+
+ <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. For more information, please see the documentation for <a href="/documentation#zk_depr">ZooKeeper Deprecation</a></i><p>
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>:
+ Kafka Tiered Storage (Early Access): </b><br>Introduces Tiered Storage to Kafka. Note that this
+ is an early access feature only advised for use in non-production environments (see the <a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">early
+ access notes</a> for more information). This feature provides a separation of computation
+ and storage in the broker for pluggable storage tiering natively in Kafka Tiered Storage brings
+ a seamless extension of storage to remote objects with minimal operational changes.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-890</a>:
+ Transactions Server Side Defense (Part 1): </b><br>Hanging transactions can negatively impact
+ your read committed consumers and prevent compacted logs from being compacted. KIP-890 helps
+ address hanging transactions by verifying partition additions. Part 2 of KIP-890 will optimize
+ verification, which currently adds an extra hop.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>:
+ Accept duplicate listener on port for IPv4/IPv6: </b><br>Until now, Kafka has not supported
+ duplicate listeners on the same port. This works when using only a single IP stack, but presents
+ an issue if you are working with both IPv4 and IPv6. With KIP-797, brokers can be configured
+ with listeners that have the same port on different IP stacks. This update does not affect
+ advertised listeners, which already have this feature.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>:
+ Reduce CompletedFetch#parseRecord() memory copy: </b><br>reduces memory allocation and improves
+ memory performance during record deserialization by using a ByteBuffer instead of byte[] for
+ deserialization, which improves efficiency. Updated public interfaces include the Deserializer
+ class, ByteBufferDeserializer class, and StringDeserializer class.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>:
+ Metadata Transactions: </b><br> improves the overall durability of the KRaft layer by adding
+ metadata transactions that consist of:
+ <ul>
+ <li>ssBeginTransaction</li>
+ <li>Number of records</li>
+ <li>EndTransaction or AbortTransaction</li>
+ </ul>
+ KRaft uses record batches as a mechanism for atomicity. Typically, there was a limit to the
+ fetch size on the Raft consensus layer, and the controller could generate a set of atomic
+ records that exceeded this limit. This update introduces marker records that allow larger sets
+ of atomic records to be sent to the Raft consensus layer in multiple batches. This bypasses the
+ fetch limit.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>:
+ Upgrade Zookeeper to 3.8.2:</b>upgrades the ZooKeeper version that is bundled with Kafka to
+ version 3.8.2. The new version includes several updates and security improvements. This is the
+ last planned update for ZooKeeper in the 3.8.x releases, as it will be removed in Apache Kafka
+ 4.0 and replaced with KRaft.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>:
+ Additional custom metadata for remote log segment:</b><br> It introduces having an optional
+ custom metadata as part of remote log segment metadata. RemoteStorageManager returns the
+ optional custom metadata when copyLogSegmentData() is invoked. It will be passed along with
+ remote log segment metadata.
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>:
+ Improve Message Timestamp Validation: </b> Improves data integrity and prevents potential
+ pitfalls caused by inaccurate timestamp handling by adding more validation logic for message
+ timestamps. While past timestamps are a normal occurrence in Kafka, future timestamps might
+ represent an incorrectly formatted integer. KIP-937 rejects messages with future timestamps and
+ provides a descriptive exemption.
+ </li>
+ <li><b><a
+ href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>:
+ Add more metrics for measuring KRaft performance: </b><br> Adds new controller, loader, and
+ snapshot emitter KRaft performance metrics.
+ </li>
+ </ul>
+ <h3>Kafka Streams</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>: Add A Grace Period to Stream Table Join: </b>Adds a grace period to stream-table joins to improve table-side out-of-order data handling. The joined object has a new method called .withGracePeriod that will cause the table side lookup to only happen after the grace period has passed.</li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a>: Range queries to accept null lower and upper bounds: </b>Previously, RangeQuery did not support null to specify “no upper/lower bound”.
+ KIP-941 allows users to pass null into withRange(...) for lower/upper bounds to specify a full or half-open range:
+ <ul>
+ <li>`withRange(null, null)` == `withNoBounds()`</li>
+ <li>`withRange(lower, null)` == `withLowerBound(lower)`</li>
+ <li>`withRange(null, upper)` == `withUpperBound(upper)`</li>
+ </ul>
+ </li>
+ </ul>
+ <h3>Kafka Connect</h3>
+ <ul>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>: Allow sink connectors to be used with topic-mutating SMTs: </b><br>Adds support for topic-mutating SMTs for async sink connectors. This is to address an incompatibility between sink connectors overriding the SinkTask::preCommit method and SMTs that mutate the topic field of a SinkRecord .</li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>: First-class offsets support in Kafka Connect: </b><br>Provides first-class admin support for offsets in Kafka Connect. KIP-875 Part 1 added endpoints to get offsets and a new STOPPED state for connectors. The alter offsets and reset offsets endpoints have now been added.
+ <table>
+ <tr>
+ <th>Action</th>
+ <th>Description</th>
+ </tr>
+ <tr>
+ <td>GET /connectors/{connector}/offsets</td>
+ <td>Retrieve the offsets for a connector; the connector must exist</td>
+ </tr>
+ <tr>
+ <td>PATCH /connectors/{connector}/offsets</td>
+ <td>Alter the offsets for a connector; the connector must exist, and must be in the STOPPED state
+ </td>
+ </tr>
+ <tr>
+ <td>DELETE /connectors/{connector}/offsets</td>
+ <td>Reset the offsets for a connector; the connector must exist, and must be in the STOPPED state
+ </td>
+ </tr>
+ <tr>
+ <td>PUT /connectors/{connector}/pause</td>
+ <td>Pause the connector; the connector must exist</td>
+ </tr>
+ </table>
+ </li>
+ <li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>: Modernize Connect plugin discovery: </b><br>With KIP-898, Connect workers now read from ServiceLoader manifests and module info directly during startup for more efficient plugin class discovery. Note that this update requires connector developers to add service declarations to their plugins.</li>
Review Comment:
```suggestion
<li><b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>: Modernize Connect plugin discovery: </b><br>With KIP-898, Connect workers can now read from ServiceLoader manifests and module info directly during startup for more efficient plugin class discovery. See the <a href="https://kafka.apache.org/36/documentation.html#connect_plugindiscovery">migration documentation</a> for how to add service declarations to plugins to opt-in to these optimizations.</li>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org