You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "luoyuxia (Jira)" <ji...@apache.org> on 2022/10/31 06:13:00 UTC
[jira] [Comment Edited] (FLINK-29800) Continuous failover will leak the inprogress output file
[ https://issues.apache.org/jira/browse/FLINK-29800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626415#comment-17626415 ]
luoyuxia edited comment on FLINK-29800 at 10/31/22 6:12 AM:
------------------------------------------------------------
What's you idea for cleaning up these files? From my sides, it may be not a trivial work.
was (Author: luoyuxia):
What's you idea for cleaning up these files?
> Continuous failover will leak the inprogress output file
> --------------------------------------------------------
>
> Key: FLINK-29800
> URL: https://issues.apache.org/jira/browse/FLINK-29800
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem
> Reporter: Aitozi
> Priority: Major
>
> When running job which sink to the file system, the inprogress files will keep growing when job keeps failover, it will do harm to the filesystem. I think the clean up to the file which is currently written to should be performed when job failing
--
This message was sent by Atlassian Jira
(v8.20.10#820010)