[GitHub] [incubator-hudi] pushpavanthar commented on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

[GitBox <gi...@apache.org>]

pushpavanthar commented on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer
URL: https://github.com/apache/incubator-hudi/pull/969#issuecomment-561331620
 
 
   @vinothchandar Thanks. 
   It would be great if we document this in design doc and proceed from there. I've been using JDBC incremental puller approach as one of the sources to Apache HUDI at work. I'm very excited about this feature. 
   In my opinion, user shouldn't be aware of query unless it is of special case (very rare). All incremental pulling of data follow same query template to which check-pointed values are substituted. 
   However, I would like to understand where this processor of HUDI maintains checkpointing/state data. If it is filesystem, are we going to provide this filesystem path as config? Or is It external state store?
   If you can redirect me to the doc to this feature, I would like to add my thoughts to it.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services