You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/11/06 14:34:04 UTC

[GitHub] [hudi] sbernauer commented on issue #2224: Incremental query on COW table is missing data

sbernauer commented on issue #2224:
URL: https://github.com/apache/hudi/issues/2224#issuecomment-723112137


   Hi @satishkotha thanks for your response!
   We had `hoodie.cleaner.commits.retained=24` and a batch every 2 minutes. We want to be able to query backwards up to 2h and set the following settings, which work fine. Thanks a lot!
   ```
   hoodie.cleaner.policy=KEEP_LATEST_COMMITS
   # [2h] * [60 s/min] / [2 min for every commit] ==>> Incremental queries up to 2h in the past
   hoodie.cleaner.commits.retained=60
   hoodie.keep.min.commits=65
   hoodie.keep.max.commits=100
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org