You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/04/26 22:51:28 UTC

[GitHub] [hudi] yihua commented on issue #5400: [SUPPORT] fail on data loss semantics for Deltastreamer Kafka sources

yihua commented on issue #5400:
URL: https://github.com/apache/hudi/issues/5400#issuecomment-1110323390

   @qjqqyy Thanks for the Inquiry.  I'd like to understand your use case first.  By providing `a checkpoint that is out-of-bounds in Kafka`, do you mean using `--checkpoint` option to provide the Kafka offset to the Hudi Deltastreamer?  Usually, the checkpointing is maintained by Deltastreamer so it is not required, and only for the first run, the checkpoint may be provided.  In the later case, the user needs to make sure the checkpoint is valid according to the source.
   
   However, I see that this can be a usability improvement.  If you have time, I encourage you to file a Jira ticket, detail the solution, and contribute this improvement to the community by putting up a PR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org