You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hudi.apache.org by leesf <le...@gmail.com> on 2021/04/11 15:28:00 UTC

[ANNOUNCE] Hudi Community Update(2021-03-28 ~ 2021-04-11)

Dear community,

Nice to share Hudi community bi-weekly updates for 2021-03-28 ~ 2021-04-11
with updates on features, bug fixes and tests.

=======================================
Community

[Release] Apache Hudi 0.8.0 version has released, you would try it out and
checkout the release notes here [1]

[1] http://hudi.apache.org/releases.html#release-080-docs


=======================================
Features

[Flink Integration] Asynchronous Hive sync and commits cleaning for Flink
writer  [1]
[Flink Integration] Emit deletes for flink MOR table streaming read  [2]
[Spark Integration] Implement Spark's FileIndex for Hudi to support queries
via Hudi DataSource using non-globbed table path and partition pruning [3]
[Flink Integration] Code Cleanup: Extract common method in
HoodieCreateHandle & FlinkCreateHandle [4]
[Flink Integration] add apache commons-codec dependency to flink-bundle
explicitly  [5]
[Core] Clean/Compaction/Rollback command maybe never exit when operation
fail [6]
[Flink Integration] Assigns the buckets by record key for Flink writer [7]
[Core] Fail to load user's class if user move hudi-spark-bundle.jar into
spark classpath [8]
[Flink Integration] Add setter to CompactionPlanEvent and
CompactionCommitEvent to have better SE/DE performance for Flink [9]
[Core] HoodieFileGroup code optimize [10]
[Hive Integration] Added HiveStylePartitionExtractor to support Hive style
partitions [11]
[Flink Integration] Add option for compaction parallelism [12]
[Core] Support Huawei Cloud Object Storage [13]


[1] https://issues.apache.org/jira/browse/HUDI-1729
[2] https://issues.apache.org/jira/browse/HUDI-1738
[3] https://issues.apache.org/jira/browse/HUDI-1591
[4] https://issues.apache.org/jira/browse/HUDI-1737
[5] https://issues.apache.org/jira/browse/HUDI-1696
[6] https://issues.apache.org/jira/browse/HUDI-1749
[7] https://issues.apache.org/jira/browse/HUDI-1757
[8] https://issues.apache.org/jira/browse/HUDI-1750
[9] https://issues.apache.org/jira/browse/HUDI-1778
[10] https://issues.apache.org/jira/browse/HUDI-1773
[11] https://issues.apache.org/jira/browse/HUDI-1762
[12] https://issues.apache.org/jira/browse/HUDI-1775
[13] https://issues.apache.org/jira/browse/HUDI-1783


=======================================
Bugs

[Examples] Add hive-exec dependency for hudi-examples [1]
[Java Client] Rename UpsertPartitioner in hudi-java-client [2]
[Deltastreamer] DeltaStreamer print many unnecessary warn log [3]
[Core] HoodieFileGroupId compareTo logical error(fileId self compare) [4]
[Cli] Fix CompactionCommand and add unit test for CompactionCommand [5]


[1] https://issues.apache.org/jira/browse/HUDI-1735
[2] https://issues.apache.org/jira/browse/HUDI-1713
[3] https://issues.apache.org/jira/browse/HUDI-1751
[4] https://issues.apache.org/jira/browse/HUDI-1772
[5] https://issues.apache.org/jira/browse/HUDI-699



Best,
Leesf