[jira] [Commented] (FLINK-24641) Flink SQL FileSystem read hdfs Path, when Path's file name change, the sql will not find the file.

["Martijn Visser (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434328#comment-17434328 ] 

Martijn Visser commented on FLINK-24641:
----------------------------------------

I believe this is caused because the filesystem SQL connector currently only supports bounded source, so if a file name is changed, it will throw an error. It feels like this ticket would be a duplicate of https://issues.apache.org/jira/browse/FLINK-20286, do you agree [~Hadiiiiiiiii] ?

> Flink SQL FileSystem read hdfs Path, when Path's file name change, the sql will not find the file.
> --------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-24641
>                 URL: https://issues.apache.org/jira/browse/FLINK-24641
>             Project: Flink
>          Issue Type: Bug
>          Components: Table SQL / Client
>    Affects Versions: 1.13.2
>            Reporter: Hadiiiiiiiii
>            Priority: Minor
>         Attachments: screenshot-1.png
>
>
> Hello, big bro.
> when I use the Flink SQL to read HDFS Files like this:
> {code:java}
> CREATE TABLE `cfg_city`(
>     `provincecode` int, `city_id` int, `city_name` string)
> WITH (
>     'connector'='filesystem',
>     'path'='viewfs://path1/path2/path3/cfg_city',
>     'format' = 'csv',
>     'csv.field-delimiter' = ',',
>     'csv.ignore-parse-errors' = 'true'
> )
> ;
> {code}
> if the task failed and retry, this will throw a exception:
>  !screenshot-1.png! 
> I found , because the path 'viewfs://path1/path2/path3/cfg_city' file name changed. but it not get new FileList.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)