You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Kumar Jayapal <kj...@gmail.com> on 2015/06/09 20:41:55 UTC
dir permission show ??????
Hi All,
Why is my directory permission show like this
ls -ltr /mtn
d????????? ? ? ? ? ? drive15-sdq
and datanode is showing error...
I am unable to see device /dev/dsq1
how can I resolve this issue. Please help....
8:47:57.529 PMWARNorg.apache.hadoop.hdfs.server.datanode.DataNode
Slow BlockReceiver write packet to mirror took 447ms (threshold=300ms)
4:58:26.554 AMWARNorg.apache.hadoop.hdfs.server.datanode.DataNode
Failed to report bad block
BP-1644003335-172.23.110.219-1406204414108:blk_1082443176_8740206 to
namenode : Exception
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException):
Operation category WRITE is not supported in state standby
at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:87)
at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1713)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1322)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.reportBadBlocks(FSNamesystem.java:6718)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.reportBadBlocks(NameNodeRpcServer.java:685)
at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.reportBadBlocks(DatanodeProtocolServerSideTranslatorPB.java:251)
at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:26392)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:587)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1026)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
at org.apache.hadoop.ipc.Client.call(Client.java:1411)
at org.apache.hadoop.ipc.Client.call(Client.java:1364)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
at com.sun.proxy.$Proxy18.reportBadBlocks(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolClientSideTranslatorPB.reportBadBlocks(DatanodeProtocolClientSideTranslatorPB.java:262)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.reportBadBlocks(BPServiceActor.java:264)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.reportBadBlocks(BPOfferService.java:221)
at org.apache.hadoop.hdfs.server.datanode.DataNode.reportBadBlock(DataNode.java:1785)
at org.apache.hadoop.hdfs.server.datanode.DataNode.transferBlock(DataNode.java:1832)
at org.apache.hadoop.hdfs.server.datanode.DataNode.transferBlocks(DataNode.java:1857)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.processCommandFromActive(BPOfferService.java:655)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.processCommandFromActor(BPOfferService.java:613)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.processCommand(BPServiceActor.java:885)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.offerService(BPServiceActor.java:700)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:851)
at java.lang.Thread.run(Thread.java:745)
4:58:26.556 AMWARNorg.apache.hadoop.hdfs.server.datanode.DataNode
Can't replicate block
BP-1644003335-172.23.110.219-1406204414108:blk_1082443176_8740206
because on-disk length 902327 is shorter than NameNode recorded length
9223372036854775807
Thanks
Jay
Re: dir permission show ??????
Posted by Hadoop User <kj...@gmail.com>.
I am a root user and I do have permission on /mnt
Thanks
Jay
Sent from my iPhone
> On Jun 9, 2015, at 1:50 PM, Chris Nauroth <cn...@hortonworks.com> wrote:
>
> Hi Kumar,
>
> You can get question marks like this in the ls output if you can get the child directory entries within a directory, but then you can't run stat to get metadata about each of those files and directories. This might indicate that you have read permission, but not execute permission, on the /mtn directory. I recommend checking that directory to make sure you have both read and execute permissions.
>
> --Chris Nauroth
>
> From: Ilker Ozkaymak <io...@gmail.com>
> Reply-To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Tuesday, June 9, 2015 at 12:25 PM
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Cc: "cdh-user@cloudera.org" <cd...@cloudera.org>
> Subject: Re: dir permission show ??????
>
> As you mentioned something is wrong with your /dev/dsq1
> Since the physical drive is not there, but filesystem inode table is there, you are seeing those ?
>
>
>> On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com> wrote:
>> /dev/dsq1
>
>
Re: dir permission show ??????
Posted by Hadoop User <kj...@gmail.com>.
I am a root user and I do have permission on /mnt
Thanks
Jay
Sent from my iPhone
> On Jun 9, 2015, at 1:50 PM, Chris Nauroth <cn...@hortonworks.com> wrote:
>
> Hi Kumar,
>
> You can get question marks like this in the ls output if you can get the child directory entries within a directory, but then you can't run stat to get metadata about each of those files and directories. This might indicate that you have read permission, but not execute permission, on the /mtn directory. I recommend checking that directory to make sure you have both read and execute permissions.
>
> --Chris Nauroth
>
> From: Ilker Ozkaymak <io...@gmail.com>
> Reply-To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Tuesday, June 9, 2015 at 12:25 PM
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Cc: "cdh-user@cloudera.org" <cd...@cloudera.org>
> Subject: Re: dir permission show ??????
>
> As you mentioned something is wrong with your /dev/dsq1
> Since the physical drive is not there, but filesystem inode table is there, you are seeing those ?
>
>
>> On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com> wrote:
>> /dev/dsq1
>
>
Re: dir permission show ??????
Posted by Hadoop User <kj...@gmail.com>.
I am a root user and I do have permission on /mnt
Thanks
Jay
Sent from my iPhone
> On Jun 9, 2015, at 1:50 PM, Chris Nauroth <cn...@hortonworks.com> wrote:
>
> Hi Kumar,
>
> You can get question marks like this in the ls output if you can get the child directory entries within a directory, but then you can't run stat to get metadata about each of those files and directories. This might indicate that you have read permission, but not execute permission, on the /mtn directory. I recommend checking that directory to make sure you have both read and execute permissions.
>
> --Chris Nauroth
>
> From: Ilker Ozkaymak <io...@gmail.com>
> Reply-To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Tuesday, June 9, 2015 at 12:25 PM
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Cc: "cdh-user@cloudera.org" <cd...@cloudera.org>
> Subject: Re: dir permission show ??????
>
> As you mentioned something is wrong with your /dev/dsq1
> Since the physical drive is not there, but filesystem inode table is there, you are seeing those ?
>
>
>> On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com> wrote:
>> /dev/dsq1
>
>
Re: dir permission show ??????
Posted by Hadoop User <kj...@gmail.com>.
I am a root user and I do have permission on /mnt
Thanks
Jay
Sent from my iPhone
> On Jun 9, 2015, at 1:50 PM, Chris Nauroth <cn...@hortonworks.com> wrote:
>
> Hi Kumar,
>
> You can get question marks like this in the ls output if you can get the child directory entries within a directory, but then you can't run stat to get metadata about each of those files and directories. This might indicate that you have read permission, but not execute permission, on the /mtn directory. I recommend checking that directory to make sure you have both read and execute permissions.
>
> --Chris Nauroth
>
> From: Ilker Ozkaymak <io...@gmail.com>
> Reply-To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Date: Tuesday, June 9, 2015 at 12:25 PM
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> Cc: "cdh-user@cloudera.org" <cd...@cloudera.org>
> Subject: Re: dir permission show ??????
>
> As you mentioned something is wrong with your /dev/dsq1
> Since the physical drive is not there, but filesystem inode table is there, you are seeing those ?
>
>
>> On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com> wrote:
>> /dev/dsq1
>
>
Re: dir permission show ??????
Posted by Chris Nauroth <cn...@hortonworks.com>.
Hi Kumar,
You can get question marks like this in the ls output if you can get the child directory entries within a directory, but then you can't run stat to get metadata about each of those files and directories. This might indicate that you have read permission, but not execute permission, on the /mtn directory. I recommend checking that directory to make sure you have both read and execute permissions.
--Chris Nauroth
From: Ilker Ozkaymak <io...@gmail.com>>
Reply-To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Tuesday, June 9, 2015 at 12:25 PM
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Cc: "cdh-user@cloudera.org<ma...@cloudera.org>" <cd...@cloudera.org>>
Subject: Re: dir permission show ??????
As you mentioned something is wrong with your /dev/dsq1
Since the physical drive is not there, but filesystem inode table is there, you are seeing those ?
On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com>> wrote:
/dev/dsq1
Re: dir permission show ??????
Posted by Chris Nauroth <cn...@hortonworks.com>.
Hi Kumar,
You can get question marks like this in the ls output if you can get the child directory entries within a directory, but then you can't run stat to get metadata about each of those files and directories. This might indicate that you have read permission, but not execute permission, on the /mtn directory. I recommend checking that directory to make sure you have both read and execute permissions.
--Chris Nauroth
From: Ilker Ozkaymak <io...@gmail.com>>
Reply-To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Tuesday, June 9, 2015 at 12:25 PM
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Cc: "cdh-user@cloudera.org<ma...@cloudera.org>" <cd...@cloudera.org>>
Subject: Re: dir permission show ??????
As you mentioned something is wrong with your /dev/dsq1
Since the physical drive is not there, but filesystem inode table is there, you are seeing those ?
On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com>> wrote:
/dev/dsq1
Re: dir permission show ??????
Posted by Chris Nauroth <cn...@hortonworks.com>.
Hi Kumar,
You can get question marks like this in the ls output if you can get the child directory entries within a directory, but then you can't run stat to get metadata about each of those files and directories. This might indicate that you have read permission, but not execute permission, on the /mtn directory. I recommend checking that directory to make sure you have both read and execute permissions.
--Chris Nauroth
From: Ilker Ozkaymak <io...@gmail.com>>
Reply-To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Tuesday, June 9, 2015 at 12:25 PM
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Cc: "cdh-user@cloudera.org<ma...@cloudera.org>" <cd...@cloudera.org>>
Subject: Re: dir permission show ??????
As you mentioned something is wrong with your /dev/dsq1
Since the physical drive is not there, but filesystem inode table is there, you are seeing those ?
On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com>> wrote:
/dev/dsq1
Re: dir permission show ??????
Posted by Chris Nauroth <cn...@hortonworks.com>.
Hi Kumar,
You can get question marks like this in the ls output if you can get the child directory entries within a directory, but then you can't run stat to get metadata about each of those files and directories. This might indicate that you have read permission, but not execute permission, on the /mtn directory. I recommend checking that directory to make sure you have both read and execute permissions.
--Chris Nauroth
From: Ilker Ozkaymak <io...@gmail.com>>
Reply-To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Tuesday, June 9, 2015 at 12:25 PM
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Cc: "cdh-user@cloudera.org<ma...@cloudera.org>" <cd...@cloudera.org>>
Subject: Re: dir permission show ??????
As you mentioned something is wrong with your /dev/dsq1
Since the physical drive is not there, but filesystem inode table is there, you are seeing those ?
On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com>> wrote:
/dev/dsq1
Re: dir permission show ??????
Posted by Ilker Ozkaymak <io...@gmail.com>.
As you mentioned something is wrong with your /dev/dsq1
Since the physical drive is not there, but filesystem inode table is there,
you are seeing those ?
On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com> wrote:
> /dev/dsq1
Re: dir permission show ??????
Posted by Ilker Ozkaymak <io...@gmail.com>.
As you mentioned something is wrong with your /dev/dsq1
Since the physical drive is not there, but filesystem inode table is there,
you are seeing those ?
On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com> wrote:
> /dev/dsq1
Re: dir permission show ??????
Posted by Ilker Ozkaymak <io...@gmail.com>.
As you mentioned something is wrong with your /dev/dsq1
Since the physical drive is not there, but filesystem inode table is there,
you are seeing those ?
On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com> wrote:
> /dev/dsq1
Re: dir permission show ??????
Posted by Ilker Ozkaymak <io...@gmail.com>.
As you mentioned something is wrong with your /dev/dsq1
Since the physical drive is not there, but filesystem inode table is there,
you are seeing those ?
On Tue, Jun 9, 2015 at 1:41 PM, Kumar Jayapal <kj...@gmail.com> wrote:
> /dev/dsq1