You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Danny Chen (Jira)" <ji...@apache.org> on 2022/09/19 01:45:00 UTC

[jira] [Commented] (HUDI-3304) support partial update on mor table

    [ https://issues.apache.org/jira/browse/HUDI-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17606386#comment-17606386 ] 

Danny Chen commented on HUDI-3304:
----------------------------------

Fixed via master branch: 3160c89d6d13b6cd2774c7cf4303455b3b944d9f

> support partial update on mor table 
> ------------------------------------
>
>                 Key: HUDI-3304
>                 URL: https://issues.apache.org/jira/browse/HUDI-3304
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: writer-core
>            Reporter: Jian Feng
>            Assignee: Jian Feng
>            Priority: Critical
>              Labels: pull-request-available
>             Fix For: 0.13.0
>
>         Attachments: image2022-1-13_0-33-5.png
>
>
> h2. current status
>  * OverwriteNonDefaultsWithLatestAvroPayload implement partial update behavior in combineAndGetUpdateValue method
>  * Spark sql also have a 'Merge into' syntax support partial update by ExpressionPayload,
>  * both OverwriteNonDefaultsWithLatestAvroPayload and ExpressionPayload can not handle partial update in preCombine method, so they can only support partial update with COW table
> h2. solution
> make preCombine function also support partial update(need pass schema as parameter)
> !image2022-1-13_0-33-5.png|width=832,height=516!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)