You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Zamil Majdy (Jira)" <ji...@apache.org> on 2021/11/04 16:46:00 UTC

[jira] [Created] (HADOOP-17990) Failing concurrent FS.initialize commands when fs.azure.createRemoteFileSystemDuringInitialization is enabled on hadoop-azure ABFS

Zamil Majdy created HADOOP-17990:
------------------------------------

             Summary: Failing concurrent FS.initialize commands when fs.azure.createRemoteFileSystemDuringInitialization is enabled on hadoop-azure ABFS
                 Key: HADOOP-17990
                 URL: https://issues.apache.org/jira/browse/HADOOP-17990
             Project: Hadoop Common
          Issue Type: Bug
          Components: common, fs
    Affects Versions: 3.3.1
            Reporter: Zamil Majdy


*Bug description:*

`fs.mkdirs` command for `RawLocalFileSystem` doesn't work in Hadoop 3 with NativeIO enabled.

The failure was happening when doing the native `chmod` command to the file (the `mkdir` command itself is working).

Stacktrace:

{{ENOENT: No such file or directory  ENOENT: No such file or directory at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmodImpl(Native Method) at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmod(NativeIO.java:382) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:974) at org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:660) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:700) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:672)}}

 

*To reproduce:*
 * Add `fs.mkdirs` in RawLocalFileSystem with NativeIO enabled.
 * Sample: [https://github.com/apache/hadoop/pull/3391]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org