You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hudi.apache.org by leesf <le...@gmail.com> on 2020/03/29 12:33:59 UTC

[ANNOUNCE] Hudi Weekly Community Update(2020-03-22 ~ 2020-03-29)

Dear community,

Happy to share Hudi community weekly update for 2020-03-22 ~ 2020-03-29
with updates on release, questions, features, bug fix and tests.
====================================
Development

[Release] Apache Hudi (incubating) 0.5.2 released. This release solved all
apache compliance. [1]
[Transformers] Sequence of Transformers, now we could only pass just one
transformer via DeltaStreamer, it aims to pass multi transformers via
DeltaStreamer. [2]
[Docs] Now asf-site could be auto generated with PRs, any feedback is
welcome. [3]
[Tests] A discussion about upgrading unit test with Junit 5 & AssertJ [4]

====================================
Questions

[Deltastreamer & DMS] DMS - org.apache.hudi.exception.HoodieException:
Please provide a valid schema provider class [5]
[Query] Get all deletes after a specific commit time [6]

=====================================
Features

[Code Cleanup] CommitTime rename to instantTime [7]
[Utilities] Refactor exporter main logic [8]
[Multi engine] Make config package spark free [9]
[Utilities] Eliminate or Minimize use of Guava if possible [10]
[Storage Management] Adding InlineFileSystem to support embedding any file
format as an InlineFile [11]
[Multi engine] Make io package spark free [8]

=====================================
Bugs

[Tests] Fixed parquet files getting created on local FS [13]
[Common Core] Fix HoodieDeltaStreamer offset not handled correctly [14]

=====================================
Tests

[Tests] Add unit test for ArchivedCommitsCommand [15]


[1]
https://lists.apache.org/thread.html/r2fffd09407ec538bb4952a20b2e30629e00a86350f6ab903b1d392d8%40%3Cdev.hudi.apache.org%3E
[2]
https://lists.apache.org/thread.html/r70689713813b0288a9d147c53950337e7999ae27b2752262834d7976%40%3Cdev.hudi.apache.org%3E
[3]
https://lists.apache.org/thread.html/rf68db7449abc55481dd10052c898f42b5fd2de618867a1239c987fbb%40%3Cdev.hudi.apache.org%3E
[4]
https://lists.apache.org/thread.html/recd284114d9bfe5f82cdd6a5a3ead1c5e1545cf0f44c74a6bb4c813b%40%3Cdev.hudi.apache.org%3E
[5]
https://lists.apache.org/thread.html/rfcf63a32172ba2690ee400f04efb1ae6fc7ee866a4f7e5ca8247c1b4%40%3Cdev.hudi.apache.org%3E
[6]
https://lists.apache.org/thread.html/r6c4b1fa1c2e4d6fd4575b6f83ceb689d3f7ce5c340b4755f497b2b32%40%3Cdev.hudi.apache.org%3E
[7] https://jira.apache.org/jira/browse/HUDI-65
[8] https://jira.apache.org/jira/browse/HUDI-711
[9] https://jira.apache.org/jira/browse/HUDI-678
[10] https://jira.apache.org/jira/browse/HUDI-479
[11] https://jira.apache.org/jira/browse/HUDI-430
[12] https://jira.apache.org/jira/browse/HUDI-679
[13] https://jira.apache.org/jira/browse/HUDI-616
[14] https://jira.apache.org/jira/browse/HUDI-663
[15] https://jira.apache.org/jira/browse/HUDI-697


Best,
Leesf