You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "luoyuxia (Jira)" <ji...@apache.org> on 2022/11/01 02:48:00 UTC

[jira] (FLINK-29800) Continuous failover will leak the inprogress output file

    [ https://issues.apache.org/jira/browse/FLINK-29800 ]


    luoyuxia deleted comment on FLINK-29800:
    ----------------------------------

was (Author: luoyuxia):
Just one quick question, how do you know it's failover in the close method?

IIUC, there's no way to know whether it's closed  by a failure or canceling.

When it's for canceling, I don't think we can delete the file.

> Continuous failover will leak the inprogress output file
> --------------------------------------------------------
>
>                 Key: FLINK-29800
>                 URL: https://issues.apache.org/jira/browse/FLINK-29800
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / FileSystem
>            Reporter: Aitozi
>            Priority: Major
>
> When running job which sink to the file system, the inprogress files will keep growing when job keeps failover, it will do harm to the filesystem. I think the clean up to the file which is currently written to should be performed when job failing



--
This message was sent by Atlassian Jira
(v8.20.10#820010)