You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Till Rohrmann (JIRA)" <ji...@apache.org> on 2019/02/28 15:04:00 UTC
[jira] [Commented] (FLINK-9647) Files uploaded to blobservice
during job submission aren't removed on failure
[ https://issues.apache.org/jira/browse/FLINK-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780607#comment-16780607 ]
Till Rohrmann commented on FLINK-9647:
--------------------------------------
The clean up of job data in case that the job submission fails given that the submission reaches the {{Dispatcher}} has been solved with FLINK-11383. What's now remaining to solve is if blobs have been uploaded to the {{BlobServer}} but the job submission never reaches the {{Dispatcher}}.
> Files uploaded to blobservice during job submission aren't removed on failure
> -----------------------------------------------------------------------------
>
> Key: FLINK-9647
> URL: https://issues.apache.org/jira/browse/FLINK-9647
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Coordination
> Affects Versions: 1.4.0, 1.5.0, 1.6.0
> Reporter: Chesnay Schepler
> Priority: Major
>
> During the job-submission clients upload jars, and in 1.6+ also distributed cache artifacts, to the blob service.
> If the job-submission is successful the cluster ensures that the files are cleaned up when the job submitted job terminates.
> However, if the job-submission fails these files linger around, as the cluster isn't aware of the files and no cleanup is performed by the clients.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)