[ANNOUNCE] Hudi Weekly Community Update (2020-01-12 ~ 2020-01-19)

[leesf <le...@gmail.com>]

Dear community,

Nice to share Hudi community weekly update for 2020-01-12 ~ 2020-01-19 with
updates on development, features, bug fixes.


Development

[Release] A discussion about delaying code freeze date for next release
until Jan 19 to get blockers on land, most blockers are resolved and
hopefully a new release candidate will be cut soon.[1]
[Module Reanme] A disscussion about renaming hudi-hadoop-mr module to
hudi-query-common to make the module more user-friendly, it is still under
discussion and welcome to participate in.[2]

[1]
https://lists.apache.org/thread.html/rab51d3158eb41659c3ce6e12dd46a8bd56d475d40fc7de356575c518%40%3Cdev.hudi.apache.org%3E
[2]
https://lists.apache.org/thread.html/ra659be560374a9c2f39007e719bac11a8422e31f42769a49a757ea25%40%3Cdev.hudi.apache.org%3E


Features

[Common Core] Improvements to DiskBasedMap used by ExternalSpillableMap for
write and random/sequential read paths, by introducing
bufferedRandmomAccessFile.[3]
[Writer Core] Adds new GlobalDeleteKeyGenerator for record_key deletes with
global indices.[4]
[Code Cleanup] Renaming code in sync with cWiki restructuring.[5]
[CLI] Introduce `repair overwrite-hoodie-props` CLI command.[6]
[Code Cleanup] This fixes compile warnings as well as unnecessary plugin
invocation for most of the modules which do not have scala code[7]
[Usability] Make Hudi support Scala 2.12[8]

[3] https://issues.apache.org/jira/browse/HUDI-377
[4] https://issues.apache.org/jira/browse/HUDI-326
[5] https://issues.apache.org/jira/browse/HUDI-509
[6] https://issues.apache.org/jira/browse/HUDI-537
[7] https://issues.apache.org/jira/browse/HUDI-527
[8] https://issues.apache.org/jira/browse/HUDI-238


Bugs

[Compaction] Inline compact not work[9]
[Spark Integration] Datasource Writer throws error on resolving struct
fields[10]
[Common Core] Ensure Compaction Plan is always written in .aux folder to
avoid 0.5.0/0.5.1 reader-writer compatibility issues[11]
[Spark Integration] Fix the schema mismatch in Row-to-Avro conversion[12]

[9] https://issues.apache.org/jira/browse/HUDI-526
[10] https://issues.apache.org/jira/browse/HUDI-530
[11] https://issues.apache.org/jira/browse/HUDI-535
[12] https://issues.apache.org/jira/browse/HUDI-552

Best,
Leesf