You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Jay Vyas <ja...@gmail.com> on 2013/07/12 00:41:51 UTC
Staging directory ENOTDIR error.
Hi , I'm getting an ungoogleable exception, never seen this before.
This is on a hadoop 1.1. cluster... It appears that its permissions
related...
Any thoughts as to how this could crop up?
I assume its a bug in my filesystem, but not sure.
13/07/11 18:39:43 ERROR security.UserGroupInformation:
PriviledgedActionException as:root cause:ENOTDIR: Not a directory
ENOTDIR: Not a directory
at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Staging directory ENOTDIR error.
Posted by Jay Vyas <ja...@gmail.com>.
This was a very odd error - it turns out that i had created a file, called
"tmp" in my fs root directory, which meant that
when the jobs were trying to write to the tmp directory, they ran into the
not-a-dir exception.
In any case, I think the error reporting in NativeIO class should be
revised.
On Thu, Jul 11, 2013 at 10:24 PM, Devaraj k <de...@huawei.com> wrote:
> Hi Jay,****
>
> ** **
>
> Here client is trying to create a staging directory in local file
> system, which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
> ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:jayunit100@gmail.com]
> *Sent:* 12 July 2013 04:12
> *To:* common-user@hadoop.apache.org
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
> at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
> at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Staging directory ENOTDIR error.
Posted by Ram <pr...@gmail.com>.
Hi jay,
what hadoop command you are given.
Hi,
From,
Ramesh.
On Fri, Jul 12, 2013 at 7:54 AM, Devaraj k <de...@huawei.com> wrote:
> Hi Jay,****
>
> ** **
>
> Here client is trying to create a staging directory in local file
> system, which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
> ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:jayunit100@gmail.com]
> *Sent:* 12 July 2013 04:12
> *To:* common-user@hadoop.apache.org
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
> at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
> at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>
Re: Staging directory ENOTDIR error.
Posted by Ram <pr...@gmail.com>.
Hi jay,
what hadoop command you are given.
Hi,
From,
Ramesh.
On Fri, Jul 12, 2013 at 7:54 AM, Devaraj k <de...@huawei.com> wrote:
> Hi Jay,****
>
> ** **
>
> Here client is trying to create a staging directory in local file
> system, which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
> ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:jayunit100@gmail.com]
> *Sent:* 12 July 2013 04:12
> *To:* common-user@hadoop.apache.org
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
> at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
> at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>
Re: Staging directory ENOTDIR error.
Posted by Jay Vyas <ja...@gmail.com>.
This was a very odd error - it turns out that i had created a file, called
"tmp" in my fs root directory, which meant that
when the jobs were trying to write to the tmp directory, they ran into the
not-a-dir exception.
In any case, I think the error reporting in NativeIO class should be
revised.
On Thu, Jul 11, 2013 at 10:24 PM, Devaraj k <de...@huawei.com> wrote:
> Hi Jay,****
>
> ** **
>
> Here client is trying to create a staging directory in local file
> system, which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
> ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:jayunit100@gmail.com]
> *Sent:* 12 July 2013 04:12
> *To:* common-user@hadoop.apache.org
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
> at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
> at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Staging directory ENOTDIR error.
Posted by Ram <pr...@gmail.com>.
Hi jay,
what hadoop command you are given.
Hi,
From,
Ramesh.
On Fri, Jul 12, 2013 at 7:54 AM, Devaraj k <de...@huawei.com> wrote:
> Hi Jay,****
>
> ** **
>
> Here client is trying to create a staging directory in local file
> system, which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
> ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:jayunit100@gmail.com]
> *Sent:* 12 July 2013 04:12
> *To:* common-user@hadoop.apache.org
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
> at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
> at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>
Re: Staging directory ENOTDIR error.
Posted by Jay Vyas <ja...@gmail.com>.
This was a very odd error - it turns out that i had created a file, called
"tmp" in my fs root directory, which meant that
when the jobs were trying to write to the tmp directory, they ran into the
not-a-dir exception.
In any case, I think the error reporting in NativeIO class should be
revised.
On Thu, Jul 11, 2013 at 10:24 PM, Devaraj k <de...@huawei.com> wrote:
> Hi Jay,****
>
> ** **
>
> Here client is trying to create a staging directory in local file
> system, which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
> ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:jayunit100@gmail.com]
> *Sent:* 12 July 2013 04:12
> *To:* common-user@hadoop.apache.org
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
> at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
> at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Staging directory ENOTDIR error.
Posted by Jay Vyas <ja...@gmail.com>.
This was a very odd error - it turns out that i had created a file, called
"tmp" in my fs root directory, which meant that
when the jobs were trying to write to the tmp directory, they ran into the
not-a-dir exception.
In any case, I think the error reporting in NativeIO class should be
revised.
On Thu, Jul 11, 2013 at 10:24 PM, Devaraj k <de...@huawei.com> wrote:
> Hi Jay,****
>
> ** **
>
> Here client is trying to create a staging directory in local file
> system, which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
> ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:jayunit100@gmail.com]
> *Sent:* 12 July 2013 04:12
> *To:* common-user@hadoop.apache.org
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
> at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
> at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Staging directory ENOTDIR error.
Posted by Ram <pr...@gmail.com>.
Hi jay,
what hadoop command you are given.
Hi,
From,
Ramesh.
On Fri, Jul 12, 2013 at 7:54 AM, Devaraj k <de...@huawei.com> wrote:
> Hi Jay,****
>
> ** **
>
> Here client is trying to create a staging directory in local file
> system, which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
> ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:jayunit100@gmail.com]
> *Sent:* 12 July 2013 04:12
> *To:* common-user@hadoop.apache.org
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
> at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
> at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>
RE: Staging directory ENOTDIR error.
Posted by Devaraj k <de...@huawei.com>.
Hi Jay,
Here client is trying to create a staging directory in local file system, which actually should create in HDFS.
Could you check whether do you have configured "fs.defaultFS" configuration in client with the HDFS.
Thanks
Devaraj k
From: Jay Vyas [mailto:jayunit100@gmail.com]
Sent: 12 July 2013 04:12
To: common-user@hadoop.apache.org
Subject: Staging directory ENOTDIR error.
Hi , I'm getting an ungoogleable exception, never seen this before.
This is on a hadoop 1.1. cluster... It appears that its permissions related...
Any thoughts as to how this could crop up?
I assume its a bug in my filesystem, but not sure.
13/07/11 18:39:43 ERROR security.UserGroupInformation: PriviledgedActionException as:root cause:ENOTDIR: Not a directory
ENOTDIR: Not a directory
at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
--
Jay Vyas
http://jayunit100.blogspot.com
RE: Staging directory ENOTDIR error.
Posted by Devaraj k <de...@huawei.com>.
Hi Jay,
Here client is trying to create a staging directory in local file system, which actually should create in HDFS.
Could you check whether do you have configured "fs.defaultFS" configuration in client with the HDFS.
Thanks
Devaraj k
From: Jay Vyas [mailto:jayunit100@gmail.com]
Sent: 12 July 2013 04:12
To: common-user@hadoop.apache.org
Subject: Staging directory ENOTDIR error.
Hi , I'm getting an ungoogleable exception, never seen this before.
This is on a hadoop 1.1. cluster... It appears that its permissions related...
Any thoughts as to how this could crop up?
I assume its a bug in my filesystem, but not sure.
13/07/11 18:39:43 ERROR security.UserGroupInformation: PriviledgedActionException as:root cause:ENOTDIR: Not a directory
ENOTDIR: Not a directory
at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
--
Jay Vyas
http://jayunit100.blogspot.com
RE: Staging directory ENOTDIR error.
Posted by Devaraj k <de...@huawei.com>.
Hi Jay,
Here client is trying to create a staging directory in local file system, which actually should create in HDFS.
Could you check whether do you have configured "fs.defaultFS" configuration in client with the HDFS.
Thanks
Devaraj k
From: Jay Vyas [mailto:jayunit100@gmail.com]
Sent: 12 July 2013 04:12
To: common-user@hadoop.apache.org
Subject: Staging directory ENOTDIR error.
Hi , I'm getting an ungoogleable exception, never seen this before.
This is on a hadoop 1.1. cluster... It appears that its permissions related...
Any thoughts as to how this could crop up?
I assume its a bug in my filesystem, but not sure.
13/07/11 18:39:43 ERROR security.UserGroupInformation: PriviledgedActionException as:root cause:ENOTDIR: Not a directory
ENOTDIR: Not a directory
at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
--
Jay Vyas
http://jayunit100.blogspot.com
RE: Staging directory ENOTDIR error.
Posted by Devaraj k <de...@huawei.com>.
Hi Jay,
Here client is trying to create a staging directory in local file system, which actually should create in HDFS.
Could you check whether do you have configured "fs.defaultFS" configuration in client with the HDFS.
Thanks
Devaraj k
From: Jay Vyas [mailto:jayunit100@gmail.com]
Sent: 12 July 2013 04:12
To: common-user@hadoop.apache.org
Subject: Staging directory ENOTDIR error.
Hi , I'm getting an ungoogleable exception, never seen this before.
This is on a hadoop 1.1. cluster... It appears that its permissions related...
Any thoughts as to how this could crop up?
I assume its a bug in my filesystem, but not sure.
13/07/11 18:39:43 ERROR security.UserGroupInformation: PriviledgedActionException as:root cause:ENOTDIR: Not a directory
ENOTDIR: Not a directory
at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
--
Jay Vyas
http://jayunit100.blogspot.com