[I] To support partial update function which can move and update the data from the old partition to the new partition , when the data with same key change it's partition [hudi]

["hudi-bot (via GitHub)" <gi...@apache.org>]

hudi-bot opened a new issue, #14862:
URL: https://github.com/apache/hudi/issues/14862

   to considerate such a scene, there 2 reocod *in different batch*  as follow 
   ||post_id ||position||weight||ts||day ||
   | 1|shengzhen|3KG|1630480027|{color:#ff0000}20210901{color}|
   | 1|beijing|3KG|1630652828|{color:#ff0000}20210903{color}|
   
    
   
   when using the {color:#ff0000}*Global Index*{color} with such sql
   
    
   {code:java}
   merge into target_hudi_table  t
      using (
           select post_id, position, ts , day from source_table
      ) as s
   on t.id = s.id
   when natched then update set  t.position = s.position, t.ts=s.ts, t.day = s.day
   when not matched then insert *
   {code}
    
   
   Beacuse now the hudi engine haven't support *cross partitions partial merge into,* the result in the target table is  
   
    
   ||post_id  (as primiary key)||position||weight||ts||day||
   | 1|beijing| |1630652828|*{color:#ff0000}20210903{color}*|
   
   the record still in  the old parition. 
   
    
   
   but the *expected* result is 
   ||post_id  (as primiary key)||position||weight||ts||day||
   | 1|beijing|*{color:#ff0000}3KG{color}*|1630652828|{color:#ff0000}*20210903*{color}|
   
    
   
    
   
    
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-2441
   - Type: Improvement
   
   
   ---
   
   
   ## Comments
   
   21/Sep/21 12:05;David_Liang;we have do some job for this issue, The main development have finished,  It's testing now;;;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org