[jira] [Created] (HUDI-5875) Fix index look/matching records for MERGE INTO with MOR table

["sivabalan narayanan (Jira)" <ji...@apache.org>]

sivabalan narayanan created HUDI-5875:
-----------------------------------------

             Summary: Fix index look/matching records for MERGE INTO with MOR table
                 Key: HUDI-5875
                 URL: https://issues.apache.org/jira/browse/HUDI-5875
             Project: Apache Hudi
          Issue Type: Improvement
          Components: writer-core
            Reporter: sivabalan narayanan


MERGE INTO statement w/ MOR table might result go wrong in some corner case. 

 

where a record is valid as per base file, but has gotten a delete in log files, 

following this, if a user executes below MERGE_INTO statement 
{code:java}
merge into hudi_table2 using (select * from source) as b on (hudi_table2.id = b.id and hudi_table2.name=b.name) when not matched then insert *; {code}
In this case, a record that was deleted in log file, might appear as though its valid record w/ our index look up. 

 

This will not be an issue w/ COW table or after compaction kicks in. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)