You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Stephan Ewen (JIRA)" <ji...@apache.org> on 2017/07/25 15:33:00 UTC

[jira] [Created] (FLINK-7266) Don't attempt to delete parent directory on S3

Stephan Ewen created FLINK-7266:
-----------------------------------

             Summary: Don't attempt to delete parent directory on S3
                 Key: FLINK-7266
                 URL: https://issues.apache.org/jira/browse/FLINK-7266
             Project: Flink
          Issue Type: Bug
          Components: Core
    Affects Versions: 1.3.1
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.4.0, 1.3.2


Currently, every attempted release of an S3 state object also checks if the "parent directory" is empty and then tries to delete it.

Not only is that unnecessary on S3, but it is prohibitively expensive and for example causes S3 to throttle calls by the JobManager on checkpoint cleanup.

The {{FileState}} must only attempt parent directory cleanup when operating against real file systems, not when operating against object stores.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)