You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2019/02/14 21:51:00 UTC

[jira] [Created] (HADOOP-16111) FileSystem.closeAllForUGI closes() filesystem in Sync block

Steve Loughran created HADOOP-16111:
---------------------------------------

             Summary: FileSystem.closeAllForUGI closes() filesystem in Sync block
                 Key: HADOOP-16111
                 URL: https://issues.apache.org/jira/browse/HADOOP-16111
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 3.2.0
            Reporter: Steve Loughran


FileSystem.closeAllForUGI() builds the target list and then 

if an FS has many (slow) pending deletes then they all take place in the sync block, which can block other threads. And as the delete calls are serialized, potentially really slow.

Really we should do more for that delete-on-exit process. IF anyone uses it to any extent, they'll be in trouble.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org