You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@hudi.apache.org by leesf <le...@gmail.com> on 2020/09/06 15:23:00 UTC

[ANNOUNCE] Hudi Community Weekly Update(2020-08-30 ~ 2020-09-06)

Dear community,

Nice to share Hudi community weekly update for 2020-08-30 ~ 2020-09-06 with
updates on discussion, features, bugfixs.

=======================================
Discussion

[Community] A discussion about DevX, Test infra Rgdn with the community, as
the community become larger, we need more clear roles to extend the
community [1]
[Writer Core] A discussion to introduce incremental processing API in Hudi
to make incremental processing with other systems more easily [2]
[Core] A discussion to enable cross AZ consistency and quality checks of
hudi datasets [3]
[Release] A discussion about formalizing the release process, that would
make community release new version in a more standard way [4]
[Community] There are new four committers to the community [5]

=======================================
Features

[Writer Core] Implementation of the HFile base and log file format [6]
[Writer Core] Let delete API use "hoodie.delete.shuffle.parallelism". [7]


=======================================
Bugs

[Writer Core] Spark DataSource and Streaming Write must fail when operation
type is misconfigured [8]



[1]
https://lists.apache.org/thread.html/rfd0d7793e9def7485718d0228e24330dcf7a9dd02ccfbd27554bb9f4%40%3Cdev.hudi.apache.org%3E
[2]
https://lists.apache.org/thread.html/r7d3006dc5e6db85fbdc6ef714bf4eb1c99534aa52be0ba365a29c772%40%3Cdev.hudi.apache.org%3E
[3]
https://lists.apache.org/thread.html/r295aa716aac1bdc58a49ede7b50220b29d595531aad9058d7ee33da6%40%3Cdev.hudi.apache.org%3E
[4]
https://lists.apache.org/thread.html/r3ac49b5ae17734120f13b4403e7c4fc548ba4c772825d3a5c67e09eb%40%3Cdev.hudi.apache.org%3E
[5]
https://lists.apache.org/thread.html/r53a38909bec9905df096694a75de522fe7bf37d59cc4ce0500300938%40%3Cdev.hudi.apache.org%3E
[6] https://issues.apache.org/jira/browse/HUDI-960
[7] https://issues.apache.org/jira/browse/HUDI-993
[8] https://issues.apache.org/jira/browse/HUDI-1153


Best,
Leesf