You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2021/08/06 11:12:00 UTC

[jira] [Created] (HADOOP-17839) LocalFS to support ability to disable permission get/set; remove need for winutils

Steve Loughran created HADOOP-17839:
---------------------------------------

             Summary: LocalFS to support ability to disable permission get/set; remove need for winutils
                 Key: HADOOP-17839
                 URL: https://issues.apache.org/jira/browse/HADOOP-17839
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs
    Affects Versions: 3.3.1
            Reporter: Steve Loughran



Setting FS permissions on windows has always been a paint point for people running spark standalone, creating files through localFS required WINUTILS.EX To do this

I'm seeing some other demand for disabling setting permissions, primarily because if you mount storage (including azure storage) to a VM, you cant call setPermissions; things fail. 

Proposed: 
1. we add an option to disable permission setting
2. we add a path capability, which for hdfs, abfs is always true (not sure about wasb as it varies on file vs dir)
3. we add the option to turn off permission get/set for RawLocalFileSystem and downgrade to a no-op on write, ug+rw on read (or even make configurable?)

(Distcp should maybe probe the path and downgrade -p options if the dest store doesn't do perms properly, which argues for wasb to return true, so file perms are set)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org