You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/10/29 21:34:15 UTC

[GitHub] [hudi] bvaradar commented on issue #2214: [SUPPORT] Hudi Upsert but with duplicates record for same key

bvaradar commented on issue #2214:
URL: https://github.com/apache/hudi/issues/2214#issuecomment-719037420


   @RajasekarSribalan : Do you have hoodie.combine.before.upsert set to true ? By default, this is true, so unless you have set to false, this should not be a problem ? You can also check if the duplicates have the same `_hoodie_commit_time` value to see if this is the pattern ?
   
    Another question, when you say duplicate record - Do they have same `_hoodie_record_key` value ?
   
   It is also possible that you have more than one writer ingesting data to the same dataset concurrently. This will not work as expected.
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org