You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/12/03 03:51:03 UTC
[GitHub] [pulsar] BewareMyPower commented on a change in pull request #12425: Apache Pulsar 2.9.0 release notes
BewareMyPower commented on a change in pull request #12425:
URL: https://github.com/apache/pulsar/pull/12425#discussion_r761629339
##########
File path: site2/website/release-notes.md
##########
@@ -1,6 +1,440 @@
## Apache Pulsar Release Notes
+### 2.9.0 — 2021-11-25 <a id=“2.9.0”></a>
+
+### News and noteworthy
+- PIP-45 Pluggable metadata interface introduced many changes about ZooKeeper metadata management: consistency, resilience, stability, tech debt reduction (less code duplication)
+- Pulsar IO: Oracle Debezium connector, new Schema aware Elasticsearch sink connector
+- Many improvements to the Pulsar clients, with PIP-83, PIP-91, PIP-96 (see below)
+- Geo-replication improvements: PIP-88 replicate schemas across clusters
+- Apache Kafka connect sinks can be run as Pulsar sinks [#9927](https://github.com/apache/pulsar/pull/9927)
+
+### Breaking changes
+- Now Pulsar requires ZooKeeper 3.6.x because it leverages the Persistent Recursive Watches feature (see PIP-45)
+- The discovery service has been removed. [12119](https://github.com/apache/pulsar/pull/12119)
+- The Pulsar standalone docker image has been removed. [11657](https://github.com/apache/pulsar/pull/11657)
+
+### PIPs
+- [PIP 96] Add message payload processor for Pulsar client [#12088](https://github.com/apache/pulsar/pull/12088)
+- [PIP 99] Pulsar Proxy Extensions [#11838](https://github.com/apache/pulsar/pull/11838)
+- [PIP 89] Timed log events [#11944](https://github.com/apache/pulsar/pull/11944)
+- [PIP 82] Tenant and namespace level rate limiting [#11918](https://github.com/apache/pulsar/pull/11918)
+- [PIP 91] Separate lookup timeout from operation timeout [#11627](https://github.com/apache/pulsar/pull/11627)
+- [PIP 88] Replicate schemas across clusters [#11441](https://github.com/apache/pulsar/pull/11441)
+- [PIP 83] Pulsar Reader: Message consumption with pooled buffer [#11725](https://github.com/apache/pulsar/pull/11725)
+- [PIP 64] Rest API Produce message [PIP 64](https://github.com/apache/pulsar/pull/8125)
+- [PIP 45] Pluggable metadata interface [PIP 45](https://github.com/apache/pulsar/wiki/PIP-45%3A-Pluggable-metadata-interface)
+
+### Pulsar IO and Pulsar Functions
+
+- Added Debezium source for Microsoft SQL Server. [12256](https://github.com/apache/pulsar/pull/12256)
+- Upgrading Debezium to 1.7. [12295](https://github.com/apache/pulsar/pull/12295)
+- Allow Pulsar Functions localrun to exit on error. [12278](https://github.com/apache/pulsar/pull/12278)
+- [pulsar-io-kinesis] add missing dependency. [12246](https://github.com/apache/pulsar/pull/12246)
+- Support for draining workers. [12178](https://github.com/apache/pulsar/pull/12178)
+- [pulsar-functions-go] support set subscription position. [11990](https://github.com/apache/pulsar/pull/11990)
+- [function] enable protobuf-native schema support for function. [11868](https://github.com/apache/pulsar/pull/11868)
+- [pulsar-functions-go] sync to the latest function proto. [11853](https://github.com/apache/pulsar/pull/11853)
+- [Functions]Support protobuf schema for pulsar function. [11709](https://github.com/apache/pulsar/pull/11709)
+- [Functions] Remove unused class which didn't get reverted. [11707](https://github.com/apache/pulsar/pull/11707)
+- [Functions] Support KEY_BASED batch builder for Java based functions and sources. [11706](https://github.com/apache/pulsar/pull/11706)
+- PIP-85: [pulsar-io] pass pulsar client via context to connector. [11056](https://github.com/apache/pulsar/pull/11056)
+
+### Java Client
+- Use failPendingMessages to ensure proper cleanup. [12259](https://github.com/apache/pulsar/pull/12259)
+- Remove unnecessary stats incremement. [12229](https://github.com/apache/pulsar/pull/12229)
+- Remove unnecessary synchronization and simplify initialization. [12228](https://github.com/apache/pulsar/pull/12228)
+- Add partition-change API for producer or consumer interceptors. [12287](https://github.com/apache/pulsar/pull/12287)
+- Fix deadLetterPolicy is not working with key shared subscription under partitioned topic. [12148](https://github.com/apache/pulsar/pull/12148)
+- Fix endless receiveAsync loop in MultiTopicsConsumer. [12044](https://github.com/apache/pulsar/pull/12044)
+- Reduce redundant FLOW requests for non-durable multi-topics consumer. [11802](https://github.com/apache/pulsar/pull/11802)
+- Set and return topic names on message API. [11743](https://github.com/apache/pulsar/pull/11743)
+- PIP-91: Separate lookup timeout from operation timeout. [11627](https://github.com/apache/pulsar/pull/11627)
+- Switch from pretty print to compact print for configs. [11609](https://github.com/apache/pulsar/pull/11609)
+- Java Client: remove usage of reflection while using Pulsar Implementation classes. [11636](https://github.com/apache/pulsar/pull/11636)
+- Add a optional params scope for pulsar oauth2 client. [11931](https://github.com/apache/pulsar/pull/11931)
+
+### C++ Client
+- Support configuring optional scope field for OAuth2 authentication. [12305](https://github.com/apache/pulsar/pull/12305)
+- Support setting priority for the consumer. [12076](https://github.com/apache/pulsar/pull/12076)
+- Fixed attempting to connect to multiple IP addresses. [11958](https://github.com/apache/pulsar/pull/11958)
+- Handle error when shutting down client after forks. [11954](https://github.com/apache/pulsar/pull/11954)
+- Move all C symbols into C++ pulsar namespace. [11919](https://github.com/apache/pulsar/pull/11919)
+- Expose getLastMessageId in the Reader API. [11723](https://github.com/apache/pulsar/pull/11723)
+- Add padding characters to base64 encoded protobuf native schema. [11492](https://github.com/apache/pulsar/pull/11492)
+
+### Python Client
+- Do not sort schema fields by default. [12232](https://github.com/apache/pulsar/pull/12232)
+- Support setting namespace for python schema. [12175](https://github.com/apache/pulsar/pull/12175)
+- Expose Client.shutdown() method. [11955](https://github.com/apache/pulsar/pull/11955)
+
+### Proxy
+- set default httpProxyTimeout to 5 minutes. [12299](https://github.com/apache/pulsar/pull/12299)
+- Fixed NPE in ProxyConnection with no auth data. [12111](https://github.com/apache/pulsar/pull/12111)
+- [Issue-11966] set default http proxy request timeout. [11971](https://github.com/apache/pulsar/pull/11971)
+- Fixed Proxy leaking oubound connections. [11848](https://github.com/apache/pulsar/pull/11848)
+
+### Metrics
+- Add support for splitting topic and partition label in Prometheus. [12225](https://github.com/apache/pulsar/pull/12225)
+
+### Library updates
+- [security] Upgrade netty to 4.1.68.Final. [12218](https://github.com/apache/pulsar/pull/12218)
+- Added JLine 2.x for ZK CLI tool. [12102](https://github.com/apache/pulsar/pull/12102)
+- upgrade aircompressor to 0.20. [11790](https://github.com/apache/pulsar/pull/11790)
+- [Security] Upgrade Jetty to 9.4.43.v20210629. [11660](https://github.com/apache/pulsar/pull/11660)
+- [Security] Upgrade commons-compress to 1.21. [11345](https://github.com/apache/pulsar/pull/11345)
+- [Security] Bump Netty version to 4.1.66.Final. [11344](https://github.com/apache/pulsar/pull/11344)
+
+### Tiered Storage
+- Fix the potential race condition in the BlobStore readhandler. [12123](https://github.com/apache/pulsar/pull/12123)
+
+### Misc
Review comment:
I agree that `Misc` part is useless for users and we should remove it. See https://pulsar.apache.org/en/release-notes/#apache-pulsar-release-notes for example, the release notes of 2.8.1 and 2.8.0 don't contain this part.
But I also found many PRs in this part should be noted in other parts. For example,
```
- fix publish_time not set error when broker entry metadata enable without AppendBrokerTimestampMetadataInterceptor. [11014](https://github.com/apache/pulsar/pull/11014)
```
fixes a very common issue of Pulsar 2.8.0 when enabling KoP.
> I am sorry but I don't want to spend hours in classifying 2-3 hundreds of PRs
It might took some time but I think it's necessary. From my perspective, the release notes of this PR looks very terrible, especially compared with the existing release notes for 2.8.0 and 2.8.1.
Some semantics errors or inconsistency are acceptable. Take release notes of 2.8.1 as example,
```
Add metrics for writing or reading size of cursor #11500
Added missing configuration entries #11095
```
It's totally acceptable IMO.
But I think the PR description (in this PR) like
```
- fix lost message issues 12221. [12223](https://github.com/apache/pulsar/pull/12223)
```
should be fixed. No one knows what's the issue of 12221 only from the website.
The readers of release notes are usually those who want to check if this release has fixed some specific bugs or supported some features. The classification is very important though it could take much time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org