You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2023/02/17 23:29:00 UTC
[jira] [Closed] (HUDI-3304) Support partial update payload
[ https://issues.apache.org/jira/browse/HUDI-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ethan Guo closed HUDI-3304.
---------------------------
Resolution: Fixed
> Support partial update payload
> ------------------------------
>
> Key: HUDI-3304
> URL: https://issues.apache.org/jira/browse/HUDI-3304
> Project: Apache Hudi
> Issue Type: New Feature
> Components: writer-core
> Reporter: Jian Feng
> Assignee: Jian Feng
> Priority: Critical
> Labels: pull-request-available
> Fix For: 0.13.0
>
> Attachments: image2022-1-13_0-33-5.png
>
>
> h2. current status
> * OverwriteNonDefaultsWithLatestAvroPayload implement partial update behavior in combineAndGetUpdateValue method
> * Spark sql also have a 'Merge into' syntax support partial update by ExpressionPayload,
> * both OverwriteNonDefaultsWithLatestAvroPayload and ExpressionPayload can not handle partial update in preCombine method, so they can only support partial update with COW table
> h2. solution
> make preCombine function also support partial update(need pass schema as parameter)
> !image2022-1-13_0-33-5.png|width=832,height=516!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)