You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Nishant Gupta <ni...@gmail.com> on 2019/09/26 09:35:56 UTC

CSV Table source as data-stream in environment file

Hi Team,

How do we define csv table source as a data-stream instead of data-set in
environment file.?

Whether or not i mention  update-mode: append  or not... I takes only csv
file as data-set.
Is there any detailed reference to environment file configuration where
sinks and sources are defined.

 - name: badips
    type: source-table
    update-mode: append
    connector:
      type: filesystem
      path: "/home/user/file.csv"
    format:
      type: csv
      fields:
        - name: col1
          type: VARCHAR
      comment-prefix: "#"
    schema:
      - name: col1
        type: VARCHAR

Re: CSV Table source as data-stream in environment file

Posted by Dian Fu <di...@gmail.com>.

You need to add the following configuration to configure it run in streaming mode[1].

execution:
  type: streaming

Regards,
Dian

[1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/sqlClient.html#environment-files <https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/sqlClient.html#environment-files>
> 在 2019年9月26日，下午5:35，Nishant Gupta <ni...@gmail.com> 写道：
> 
> Hi Team,
> 
> How do we define csv table source as a data-stream instead of data-set in environment file.?
> 
> Whether or not i mention  update-mode: append  or not... I takes only csv file as data-set.
> Is there any detailed reference to environment file configuration where sinks and sources are defined.
> 
>  - name: badips
>     type: source-table
>     update-mode: append
>     connector:
>       type: filesystem
>       path: "/home/user/file.csv"
>     format:
>       type: csv
>       fields:
>         - name: col1
>           type: VARCHAR
>       comment-prefix: "#"
>     schema:
>       - name: col1
>         type: VARCHAR