You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/02/03 17:08:22 UTC

[GitHub] [hudi] sleapfish edited a comment on issue #2522: [SUPPORT] Avoid UPSERT unchanged records from source

sleapfish edited a comment on issue #2522:
URL: https://github.com/apache/hudi/issues/2522#issuecomment-772668176


   @nsivabalan That is correct! But maybe if you have control over source but let's say that you do something like extracting data from it with a rolling window of -3 days. And there is a case where some of the records from -3 days could change, but most of the records wouldn't. I want to commit only changed/new records to target Hudi table.
   
   When I do incremental query I don't want all 3 days worth of data in it, even tho only small portion of it actually changed


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org