You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hudi.apache.org by leesf <le...@gmail.com> on 2022/11/06 15:38:00 UTC

[ANNOUNCE] Hudi Community Update(2022-10-24 ~ 2022-11-06)

Dear community,

Nice to share Hudi community bi-weekly updates for 2022-10-24 ~ 2022-11-06
with updates on bug fixes.


=======================================
Features


[Flink] Supports dropPartition for Flink catalog [1]
[Core] glue support drop partitions [2]
[Core] Support schema evolution for Hive/presto [3]
[Flink] source operator(monitor and reader) support user uid [4]
[Flink] Add Call show_commit_extra_metadata for spark sql [5]
[Core] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing
Efficiency [6]



[1] https://issues.apache.org/jira/browse/HUDI-5049
[2] https://issues.apache.org/jira/browse/HUDI-4809
[3] https://issues.apache.org/jira/browse/HUDI-5000
[4] https://issues.apache.org/jira/browse/HUDI-5102
[5] https://issues.apache.org/jira/browse/HUDI-5105
[6] https://issues.apache.org/jira/browse/HUDI-3963


=======================================
Bugs

[Core] Using hudi to build a large number of tables in spark on hive causes
OOM [1]
[Core] Fix clustering schedule problem in flink when enable schedule
clustering and disable async clustering [2]
[Flink] Fix flink catalog read spark table error : primary key col can not
be nullable[3]
[Core] fix merge into with no preCombineField having dup row by only insert
 [4]
[Core] Fix msck repair external hudi table [5]
[Core] presto/hive respect payload during merge parquet file and logfile
when reading mor table [6]



[1] https://issues.apache.org/jira/browse/HUDI-4281
[2] https://issues.apache.org/jira/browse/HUDI-5042
[3] https://issues.apache.org/jira/browse/HUDI-5058
[4] https://issues.apache.org/jira/browse/HUDI-4946
[5] https://issues.apache.org/jira/browse/HUDI-5057
[6] https://issues.apache.org/jira/browse/HUDI-4898


Best,
Leesf