You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "luoyuxia (Jira)" <ji...@apache.org> on 2022/11/01 02:40:00 UTC

[jira] [Commented] (FLINK-29800) Continuous failover will leak the inprogress output file

    [ https://issues.apache.org/jira/browse/FLINK-29800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626923#comment-17626923 ] 

luoyuxia commented on FLINK-29800:
----------------------------------

Just one quick question, how do you know it's failover in the close method?

IIUC, there's no way to know whether it's closed  by a failure or canceling?

When it's for canceling, we can't delete the file.

> Continuous failover will leak the inprogress output file
> --------------------------------------------------------
>
>                 Key: FLINK-29800
>                 URL: https://issues.apache.org/jira/browse/FLINK-29800
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / FileSystem
>            Reporter: Aitozi
>            Priority: Major
>
> When running job which sink to the file system, the inprogress files will keep growing when job keeps failover, it will do harm to the filesystem. I think the clean up to the file which is currently written to should be performed when job failing



--
This message was sent by Atlassian Jira
(v8.20.10#820010)