You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Purushotham Pushpavanthar (Jira)" <ji...@apache.org> on 2019/12/11 17:45:00 UTC
[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with
DeltaStreamer
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993751#comment-16993751 ]
Purushotham Pushpavanthar commented on HUDI-251:
------------------------------------------------
Hi [~taherk77], are you still working on this?
If not I would like to work on this. Bringing JDBC incremental pull into HUDI in a scalable way helps a lot.
> JDBC incremental load to HUDI with DeltaStreamer
> ------------------------------------------------
>
> Key: HUDI-251
> URL: https://issues.apache.org/jira/browse/HUDI-251
> Project: Apache Hudi (incubating)
> Issue Type: New Feature
> Components: deltastreamer
> Reporter: Taher Koitawala
> Priority: Trivial
> Labels: pull-request-available
> Fix For: 0.5.1
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Mirroring RDBMS to HUDI is one of the most basic use cases of HUDI. Hence, for such use cases, DeltaStreamer should provide inbuilt support.
> DeltaSteamer should accept something like jdbc-source.properties where users can define the RDBMS connection properties along with a timestamp column and an interval which allows users to express how frequently HUDI should check with RDBMS data source for new inserts or updates.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)