You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Jonathan Eagles (JIRA)" <ji...@apache.org> on 2018/03/22 23:21:00 UTC
[jira] [Commented] (HADOOP-15337) RawLocalFileSystem file status
permissions can avoid shelling out in some cases
[ https://issues.apache.org/jira/browse/HADOOP-15337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410553#comment-16410553 ]
Jonathan Eagles commented on HADOOP-15337:
------------------------------------------
It tested the nio implementation and found that in addition to not shelling out, it also was 5 times faster to get file permissions on linux.
> RawLocalFileSystem file status permissions can avoid shelling out in some cases
> -------------------------------------------------------------------------------
>
> Key: HADOOP-15337
> URL: https://issues.apache.org/jira/browse/HADOOP-15337
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Jonathan Eagles
> Assignee: Jonathan Eagles
> Priority: Major
>
> While investigating YARN-8054, it was noticed that getting file permissions for RawLocalFileSystem can fail by having too many files open. Upon inspection this happens when getting permissions by launching a shell program (ls -ld on linux) and parsing the results. With the introduction of java 7 posix file systems can accurately get file permissions without launching a shell program.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org