You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2022/04/21 09:01:00 UTC

[jira] [Closed] (FLINK-27330) Why Read File Stream Function Deprecated?

     [ https://issues.apache.org/jira/browse/FLINK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chesnay Schepler closed FLINK-27330.
------------------------------------
    Resolution: Information Provided

Because the underlying source implementation (FileMonitoringFunction/FileReadFunction) has several flaws, one of which is no support for checkpointing / exactly-once processing (e.g., it doesn't remember whether it has already processed a given file when the job has restarted).

> Why Read File Stream Function Deprecated?
> -----------------------------------------
>
>                 Key: FLINK-27330
>                 URL: https://issues.apache.org/jira/browse/FLINK-27330
>             Project: Flink
>          Issue Type: Technical Debt
>          Components: API / DataStream
>    Affects Versions: 1.11.6
>            Reporter: Karthik
>            Priority: Major
>
>  env.readFileStream() is used in previous version of flink.
> But I think after 1.11.6 it is deprecated. may I know why?



--
This message was sent by Atlassian Jira
(v8.20.7#820007)