You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Udit Mehrotra (Jira)" <ji...@apache.org> on 2021/07/31 01:50:00 UTC

[jira] [Resolved] (HUDI-2139) MergeInto MOR Table May Result InCorrect Result

     [ https://issues.apache.org/jira/browse/HUDI-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Udit Mehrotra resolved HUDI-2139.
---------------------------------
    Resolution: Fixed

> MergeInto MOR Table May Result InCorrect Result
> -----------------------------------------------
>
>                 Key: HUDI-2139
>                 URL: https://issues.apache.org/jira/browse/HUDI-2139
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: Spark Integration
>            Reporter: pengzhiwei
>            Assignee: pengzhiwei
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.9.0
>
>
> Currently we process all the update-action and inert-action in the ExpressionPayload#
> getInsertValue without know whether the record is matched or not matched for MOR table. This may result in incorrect merge result. e.g.
> {code:java}
> Merge into h0
> using (select 2 as id, 'a1' as name, 10 as price from s) s0
> on h0.id = s0.id
> when matched then s0.id = 1 the update set id = s0.id, name = s0.name, price = 10
> when not matched then s0.id = 2 the insert (id,name,price) values(id,name, 20){code}
> If the id = 2 can matched the target table h0,  but it cannot match the udpate-condition ( s0.id = 1),  It should not update the table. However, currently we cannot know the matched state of the input record, it will goes to the not-matched actions and update the price to 20 finally. This is incorrect.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)