You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/10/01 11:31:08 UTC

[GitHub] [hudi] bvaradar commented on issue #2131: [SUPPORT] HUDI with Mongo Oplogs (Debezium)

bvaradar commented on issue #2131:
URL: https://github.com/apache/hudi/issues/2131#issuecomment-702072024


   @tandonraghavs : For compaction, the payload class defined in hoodie.properties is used for pre-combining. Can you check what is the payload class configured in hoodie.properties ?
   
   As you would have noticed, compaction would first pre-combines all delta records first before merging using combineAndGetUpdateValue. So, you would need to implement custom merging in preCombine method in your payload class. 
   
   IIUC, Oplogs are partial row image(updates). Wouldn't it be possible to employ the same merging logic that you were doing as part of combineAndGetUpdateValue ?
   
   Also, which version of Hudi are you using ? 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org