You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pulsar.apache.org by Huanli Meng <hu...@streamnative.io> on 2020/11/03 16:01:00 UTC

Pulsar Community Weekly Update] 2020-10-24 ~ 2020-10-30

Dear Pulsar enthusiast,

This is the Pulsar community weekly update for 2020-10-24 ~ 2020-10-30,
with updates on Pulsar client, broker, transaction, and so on.

This Pulsar community weekly update is also available at
https://streamnative.io/weekly/2020/2020-10/2020-10-30-pulsar-weekly.

*All Pulsar community weekly updates are available at
**https://streamnative.io/weekly/
<https://streamnative.io/weekly/>.*

===============
Pulsar Highlight
================
The Pulsar Java client supports both `AvroBased` and `UnAvroBased` schemas.
For details, see [PR-8246](https://github.com/apache/pulsar/pull/8246).

Before this PR is merged, the Pulsar Java client only supports the
`AvroBased` schema.
===============



















































































































*Notable Feature================- [Websocket] Update produce request and
acknowledgement for WebSocket.
https://github.com/apache/pulsar/pull/8401
<https://github.com/apache/pulsar/pull/8401>
([@MarvinCai](https://github.com/MarvinCai
<https://github.com/MarvinCai>))- [Broker] Add the `nettyMaxFrameSizeBytes`
setting to the `standalone.conf` file.
https://github.com/apache/pulsar/pull/8385
<https://github.com/apache/pulsar/pull/8385>
([@massakam](https://github.com/massakam <https://github.com/massakam>))
- [Java Client] Disable the batch receiving timer for Readers.
https://github.com/apache/pulsar/pull/8381
<https://github.com/apache/pulsar/pull/8381>
([@lhotari](https://github.com/lhotari <https://github.com/lhotari>))-
[Broker] Allow the tenant Admin to look up for topics.
https://github.com/apache/pulsar/pull/8353
<https://github.com/apache/pulsar/pull/8353>
([@rdhabalia]https://github.com/rdhabalia <https://github.com/rdhabalia>)
  - [Broker] Implement the `TransactionBuffer` Refactor.
https://github.com/apache/pulsar/pull/8347
<https://github.com/apache/pulsar/pull/8347>
([@gaoran10]https://github.com/gaoran10 <https://github.com/gaoran10>)- [Go
Functions] Add the `newOuputMessage` interface for Go Function.
https://github.com/apache/pulsar/pull/8327
<https://github.com/apache/pulsar/pull/8327>
([@wolfstudy](https://github.com/wolfstudy
<https://github.com/wolfstudy>))- [Java client] Support cancelling message
and batch futures returned from the reader and consumer.
https://github.com/apache/pulsar/pull/8326
<https://github.com/apache/pulsar/pull/8326>
([@lhotari](https://github.com/lhotari <https://github.com/lhotari>))    -
[Broker] Delete the transaction marker for topics.
https://github.com/apache/pulsar/pull/8318
<https://github.com/apache/pulsar/pull/8318>
([@congbobo184](https://github.com/congbobo184
<https://github.com/congbobo184>))    - [Java client] Support the
`UnAvroBased` Schema.    https://github.com/apache/pulsar/pull/8246
<https://github.com/apache/pulsar/pull/8246>
([@hnail](https://github.com/hnail <https://github.com/hnail>))    -
[Broker] Supporting deleting associated ledgers before deleting cluster
metadata.    https://github.com/apache/pulsar/pull/8244
<https://github.com/apache/pulsar/pull/8244>
([@BewareMyPower]https://github.com/BewareMyPower
<https://github.com/BewareMyPower>)    - [Broker] Add broker configurations
to enforce producer to publish encrypted messages.
https://github.com/apache/pulsar/pull/8055
<https://github.com/apache/pulsar/pull/8055>
([@rdhabalia](https://github.com/rdhabalia
<https://github.com/rdhabalia>))    - [Admin API] Support looking up for
partitioned topics.    https://github.com/apache/pulsar/pull/7605
<https://github.com/apache/pulsar/pull/7605>
([@aloyszhang](https://github.com/aloyszhang
<https://github.com/aloyszhang>))    - [Broker] Support configuring the
maximum concurrent HTTP Web requests.
https://github.com/apache/pulsar/pull/7250
<https://github.com/apache/pulsar/pull/7250>
([@rdhabalia](https://github.com/rdhabalia
<https://github.com/rdhabalia>))===============Notable Bug
Fix================- [Broker] Fix the deadlock that occurred during topic
ownership check.    https://github.com/apache/pulsar/pull/8406
<https://github.com/apache/pulsar/pull/8406>
([@massakam](https://github.com/massakam <https://github.com/massakam>))-
[Java client] Fix the issue that consumer pause does not work properly in
case of consuming multiple topics.
https://github.com/apache/pulsar/pull/8387
<https://github.com/apache/pulsar/pull/8387>
([@aloyszhang](https://github.com/aloyszhang
<https://github.com/aloyszhang>))- [Admin API] Validate the retention
policy.    https://github.com/apache/pulsar/pull/8358
<https://github.com/apache/pulsar/pull/8358>
([@lhotari](https://github.com/lhotari <https://github.com/lhotari>))- [Go
client] Fix the memory leak issue for the Golang client.
https://github.com/apache/pulsar/pull/8325
<https://github.com/apache/pulsar/pull/8325>
([@bschofield](https://github.com/bschofield
<https://github.com/bschofield>))- [Broker] Make the field names in
`OffloadPolicies` match with those in config file.
https://github.com/apache/pulsar/pull/8310
<https://github.com/apache/pulsar/pull/8310>
([@gaoran10]https://github.com/gaoran10 <https://github.com/gaoran10>)-
[Broker] Refresh ZooKeeper-data cache in background to avoid deadlock and
blocking IO on ZK thread.    https://github.com/apache/pulsar/pull/8304
<https://github.com/apache/pulsar/pull/8304>
([@rdhabalia](https://github.com/rdhabalia
<https://github.com/rdhabalia>))- [Python client] Expose schema version (of
writerSchema) in messages.    https://github.com/apache/pulsar/pull/8173
<https://github.com/apache/pulsar/pull/8173>
([@shiv4289](https://github.com/shiv4289 <https://github.com/shiv4289>))-
[Proxy] Fix the memory leak issue caused by the the debug log level.
https://github.com/apache/pulsar/pull/7963
<https://github.com/apache/pulsar/pull/7963>
([@rdhabalia](https://github.com/rdhabalia
<https://github.com/rdhabalia>))- [Broker] Support using the Kubernetes
runtime to customize the class path of the function instance.
https://github.com/apache/pulsar/pull/7844
<https://github.com/apache/pulsar/pull/7844>
([@nlu90](https://github.com/nlu90
<https://github.com/nlu90>))================Event / News================-
[TGIP] Weekly live stream about Pulsar and its ecosystem.  - All video
recordings are available at [here](https://streamnative.io/resource#tgip
<https://streamnative.io/resource#tgip>).- [Training]  - Low-Latency Stream
Processing with Jet    Slides:
https://www.slideshare.net/streamnative/low-latency-stream-processing-with-jet
<https://www.slideshare.net/streamnative/low-latency-stream-processing-with-jet>
  Video: https://www.youtube.com/watch?v=wIJGusBxB70
<https://www.youtube.com/watch?v=wIJGusBxB70>  - Flink + Pulsar: The Path
To Unified Batch and Streaming - Addison Higham    Video:
https://www.youtube.com/watch?v=4OHUTJDlnag
<https://www.youtube.com/watch?v=4OHUTJDlnag>- [Upcoming Event]  -  Pulsar
Summit Asia 2020     https://pulsar-summit.org/en/event/asia-2020
<https://pulsar-summit.org/en/event/asia-2020>================Blog /
Article================- StreamNative Announces Free Cloud Offering  -
https://streamnative.io/blog/release/2020-10-28-streamnative-free-cloud
<https://streamnative.io/blog/release/2020-10-28-streamnative-free-cloud>If
we miss anything, welcome to reply to this thread, thank you.Cheers,Ran
Gao, Huanli Meng*