You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/10/25 03:52:47 UTC

[GitHub] [hudi] nsivabalan commented on issue #5180: [SUPPORT] Which hudi deltastreamer configuration to use with JSONKafkaSource when target schema is fixed and source contains sparse events

nsivabalan commented on issue #5180:
URL: https://github.com/apache/hudi/issues/5180#issuecomment-1289940890

   yes, its a known limitation as of now, that if there are multiple versions of the same record in same batch, we leverage preCombine api and entire record will be chosen based on precombine value. 
   
   But we recently added support for partial update record. 
   https://github.com/apache/hudi/blob/master/hudi-common/src/main/java/org/apache/hudi/common/model/PartialUpdateAvroPayload.java
   
   this should assist in your case. 
   Also, we have RFC-46 where we are introducing new merge API through which we are unifying preCombine method and combineAndGetUpdate method. 
   
   Let us know if you are looking for any more assistance. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org