Feature request - DDL to schema conversion

[Ashwin Chandra Putta <as...@gmail.com>]

Hi All,

We have seen multiple use cases where users want to get data from
relational databases and ingest it downstream. Typical use cases fall into
the following categories:

1. Use CDC systems to write to messaging queue and DT apps read from the
message queue.
2. JDBC polling.

Typically these use cases have multiple tables with multiple columns.
Creating schemas for each of these tables to be usable by operators is a
manual process today which can get pretty time consuming and error prone as
the number of columns increases.

To solve it, we can create a feature to convert DDL to schema as DDL is
easily accessible from databases. The DDL can be made available by two ways.
1. Query for DDL from the database itself if accessible.
2. DDL can be configured on the application.

What do you guys think?

-- 

Regards,
Ashwin.