You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hudi.apache.org by leesf <le...@gmail.com> on 2020/03/09 01:04:12 UTC

[ANNOUNCE] Hudi Weekly Community Update(2020-03-03~20200308)

Dear community,

Nice to share Hudi community weekly update for 2020-03-01 ~ 2020-03-08 with
updates on development, features, bug fix and tests.

Development

[Restructure] A discussion to restructure hudi-utilities module is ongoing,
it aims to create a new module and move some classes from the utilities to
new module. [1]

[1]
https://lists.apache.org/thread.html/r22382dbe8207e7752b6bfd78c5815e2403c2df59fb6cc4a76fc45095%40%3Cdev.hudi.apache.org%3E


Features

[Writer Core] Add operation type (insert/upsert/bulkinsert/delete) to
HoodieCommitMetadata [2]
[Common Core] Match header and footer block length to improve corrupted
block detection [3]
[Spark Integration] Relocate spark-avro dependency by maven-shade-plugin [4]
[CLI] Add exportToTable option to CLI [5]
[Multi Engine] Decouple HoodieReadClient and AbstractHoodieClient to break
the inheritance chain [6]
[Usability] Building/Running Hudi on higher java versions [7]

[2] https://issues.apache.org/jira/browse/HUDI-332
[3] https://issues.apache.org/jira/browse/HUDI-409
[4] https://issues.apache.org/jira/browse/HUDI-584
[5] https://issues.apache.org/jira/browse/HUDI-626
[6] https://issues.apache.org/jira/browse/HUDI-652
[7] https://issues.apache.org/jira/browse/HUDI-553


Bugs

[Hive Integration] Fix to allow creation/syncing of Hive tables partitioned
by Date type columns [8]

[8] https://issues.apache.org/jira/browse/HUDI-607


Tests

[Tests] Added unit-test for HBaseIndex

[9] https://issues.apache.org/jira/browse/HUDI-671

Best,
Leesf