[jira] [Commented] (FLINK-20286) Support streaming source for filesystem SQL connector

["Francesco Guardiani (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-20286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17429977#comment-17429977 ] 

Francesco Guardiani commented on FLINK-20286:
---------------------------------------------

{{FileSource}} now provides a directory watching feature. In order to enable this, the {{FileSystemTableSource}} should configure the {{FileSourceBuilder}} to monitor the directory with {{FileSourceBuilder#monitorContinuously(Duration)}}, only when the table environment is configured in streaming mode. We should also expose as a connector configuration entry to define the duration of the continuous monitor.  

> Support streaming source for filesystem SQL connector
> -----------------------------------------------------
>
>                 Key: FLINK-20286
>                 URL: https://issues.apache.org/jira/browse/FLINK-20286
>             Project: Flink
>          Issue Type: New Feature
>          Components: Connectors / FileSystem, Table SQL / Ecosystem
>            Reporter: Jark Wu
>            Priority: Minor
>              Labels: auto-deprioritized-major
>
> Currenlty, the filesystem SQL connector only supports bounded source. It would be great to support streaming read just like Hive connector. It should monitor the new added files and read the content of new files. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)