You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2019/02/14 21:51:00 UTC
[jira] [Created] (HADOOP-16111) FileSystem.closeAllForUGI closes()
filesystem in Sync block
Steve Loughran created HADOOP-16111:
---------------------------------------
Summary: FileSystem.closeAllForUGI closes() filesystem in Sync block
Key: HADOOP-16111
URL: https://issues.apache.org/jira/browse/HADOOP-16111
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 3.2.0
Reporter: Steve Loughran
FileSystem.closeAllForUGI() builds the target list and then
if an FS has many (slow) pending deletes then they all take place in the sync block, which can block other threads. And as the delete calls are serialized, potentially really slow.
Really we should do more for that delete-on-exit process. IF anyone uses it to any extent, they'll be in trouble.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org