You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flume.apache.org by "Ferenc Szabo (JIRA)" <ji...@apache.org> on 2017/09/12 13:36:06 UTC

[jira] [Updated] (FLUME-2938) JDBC Source

     [ https://issues.apache.org/jira/browse/FLUME-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ferenc Szabo updated FLUME-2938:
--------------------------------
    Fix Version/s:     (was: 1.8.0)
                   1.9.0

> JDBC Source
> -----------
>
>                 Key: FLUME-2938
>                 URL: https://issues.apache.org/jira/browse/FLUME-2938
>             Project: Flume
>          Issue Type: New Feature
>          Components: Sinks+Sources
>    Affects Versions: 1.8.0
>            Reporter: Lior Zeno
>             Fix For: 1.9.0
>
>
> The idea is to allow migrating data from SQL stores to NoSQL stores or HDFS for archiving purposes.
> This source will get a statement to execute and a scheduling policy. It will be able to fetch timestamped data by performing range queries on a configurable field (this can fetch data with incremental id as well). For fault-tolerance, the last fetched value can be checkpointed to a file.
> Dealing with large datasets can be done via the fetch_size parameter. (Ref: https://docs.oracle.com/cd/A87860_01/doc/java.817/a83724/resltse5.htm)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)