You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hudi.apache.org by leesf <le...@gmail.com> on 2022/08/28 15:18:00 UTC

[ANNOUNCE] Hudi Community Update(2022-08-15 ~ 2022-08-28)

Dear community,

Nice to share Hudi community bi-weekly updates for 2022-08-15 ~ 2022-08-28
with updates on bug fixes.


=======================================
Features


[DeltaStreamer] Adding PulsarSource to DeltaStreamer to support ingesting
from Apache Pulsar [1]
[CLI] Add timeline commands in hudi-cli [2]



[1] https://issues.apache.org/jira/browse/HUDI-4616
[2] https://issues.apache.org/jira/browse/HUDI-3579


=======================================
Bugs

[Core] Fallback to full table scan with incremental query when files are
cleaned up or achived for MOR table [1]
[Core] Fixed timeline based marker thread safety issue [2]
[Core] Read error from MOR table after compaction with timestamp
partitioning [3]
[Spark] MergeInto syntax WHEN MATCHED is optional but must be set [4]
[Core] infer cleaner policy when write concurrency mode is OCC [5]
[Core] Fix savepoints will be cleaned in keeping latest versions policy [6]
[Core] Fixing DebeziumSource to properly commit offsets [7]


[1] https://issues.apache.org/jira/browse/HUDI-3189
[2] https://issues.apache.org/jira/browse/HUDI-4574
[3] https://issues.apache.org/jira/browse/HUDI-4601
[3] https://issues.apache.org/jira/browse/HUDI-4477
[4] https://issues.apache.org/jira/browse/HUDI-4643
[5] https://issues.apache.org/jira/browse/HUDI-4676
[6] https://issues.apache.org/jira/browse/HUDI-4515
[6] https://issues.apache.org/jira/browse/HUDI-4616


Best,
Leesf