[GitHub] [incubator-seatunnel] xbkaishui edited a comment on issue #720: [Roadmap][Volunteer-Wanted] SeaTunnel 2.0 Roadmap Task

[GitBox <gi...@apache.org>]

xbkaishui edited a comment on issue #720:
URL: https://github.com/apache/incubator-seatunnel/issues/720#issuecomment-1003360659


   > The roadmap 2.0 is excellent 👍.
   > 
   > I want to add a new feature to roadmap, it is very important for data integration. We use flume long long ago, but it's not friendly for us to write the agent file. Then we use flinksql replace the flume, it have provided great convenience to insert、etl data, etc.
   > 
   > project	weakness
   > flume	1) need to learn how to write agent file 2) can not work with resource manager like yarn, k8s
   > sqoop	1) don't have rich connectors 2) based on mapreduce
   > ### flinksql
   > * has rich connectors, cdc
   > * friendly for us, we can use sql grammar easily, like `+`, `-`, etc
   > * easy to work with resource manager, yarn, k8s
   > 
   > This point of this feature is introduce a new workflow template, show you the workflow demo.
   > 
   > **The origin workflow**
   > 
   > ```
   > env {
   >   execution.parallelism = 1
   > }
   > 
   > source {
   >     FakeSourceStream {
   >       result_table_name = "fake"
   >       field_name = "name,age"
   >     }
   > }
   > 
   > transform {
   >     sql {
   >       sql = "select name,age from fake"
   >     }
   > }
   > 
   > sink {
   >   ConsoleSink {}
   > }
   > ```
   > 
   > **The feature workflow**
   > 
   > ```
   > CREATE TABLE fake_source (
   >   name string,
   >   age int
   > ) with (
   >   'connector.type' = 'fakestream',
   >   'format.type' = 'json'
   > );
   > 
   > CREATE TABLE print_sink (
   >   name string,
   >   age int
   > ) with (
   >   'connector.type' = 'print',
   > );
   > 
   > INSERT INTO print_sink
   > SELECT * FROM fake_source;
   > ```
   
   that's awesome, sql is common language for use. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org