You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Norbert hu <no...@gmail.com> on 2017/07/17 12:35:49 UTC
Fwd: Failed in building kylin 2.0 demo cube at step 3.
*enviroment:* CDH 5.9, apache-kylin-2.0.0-bin-cdh57.tar.gz , run
bin/kylin.sh start as hdfs user.
*error:*
Caused by: org.apache.hadoop.security.AccessControlException: Permission
denied: user=mapred, access=READ, inode="/user/history/done_
intermediate/hdfs/job_1496716928803_0013-1500286115191-hdfs-Kylin_Fact_
Distinct_Columns_kylin_sales_cube_Step-1500286137251-0-0-
FAILED-root.users.hdfs-1500286120268.jhist":hdfs:supergroup:-rwxrwx---
at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.
checkFsPermission(DefaultAuthorizationProvider.java:281)
at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.
check(DefaultAuthorizationProvider.java:262)
at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.
checkPermission(DefaultAuthorizationProvider.java:175)cd
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.
checkPermission(FSPermissionChecker.java:152)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.
checkPermission(FSDirectory.java:3560)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.
checkPermission(FSDirectory.java:3543)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.
checkPathAccess(FSDirectory.java:3514)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.
checkPathAccess(FSNamesystem.java:6566)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(
FSNamesystem.java:2009)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(
FSNamesystem.java:1977)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(
FSNamesystem.java:1890)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.
getBlockLocations(NameNodeRpcServer.java:572)
at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClie
ntProtocol.getBlockLocations(AuthorizationProviderProxyClie
ntProtocol.java:89)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSi
deTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSi
deTranslatorPB.java:365)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$
ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.
java)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(
ProtobufRpcEngine.java:617)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2141)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2137)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(
UserGroupInformation.java:1912)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2135)
*[hdfs@cloudera-3 bin]$ *hdfs dfs -ls /user/history/done_
intermediate/hdfs/job_1496716928803_0013-1500286115191-hdfs-Kylin_Fact_
Distinct_Columns_kylin_sales_cube_Step-1500286137251-0-0-
FAILED-root.users.hdfs-1500286120268.jhist
-rwxrwx--- 2 hdfs supergroup 21673 2017-07-17 18:08
/user/history/done_intermediate/hdfs/job_1496716928803_0013-
1500286115191-hdfs-Kylin_Fact_Distinct_Columns_kylin_sales_
cube_Step-1500286137251-0-0-FAILED-root.users.hdfs-1500286120268.jhist
my question is : why runs as mapred user ? I cannot find the config in
kylin , hadoop,yarn.
Thanks in advane.
Norbert
Re: Failed in building kylin 2.0 demo cube at step 3.
Posted by Li Yang <li...@apache.org>.
By default, the user who runs Kylin process is also the user who submits MR
job. Unless you have other specific setting in Hadoop & MapReduce..
On Mon, Jul 17, 2017 at 8:35 PM, Norbert hu <no...@gmail.com> wrote:
> *enviroment:* CDH 5.9, apache-kylin-2.0.0-bin-cdh57.tar.gz , run
> bin/kylin.sh start as hdfs user.
>
>
> *error:*
> Caused by: org.apache.hadoop.security.AccessControlException: Permission
> denied: user=mapred, access=READ, inode="/user/history/done_inte
> rmediate/hdfs/job_1496716928803_0013-1500286115191-hdfs-
> Kylin_Fact_Distinct_Columns_kylin_sales_cube_Step-
> 1500286137251-0-0-FAILED-root.users.hdfs-1500286120268.
> jhist":hdfs:supergroup:-rwxrwx---
> at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationP
> rovider.checkFsPermission(DefaultAuthorizationProvider.java:281)
> at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationP
> rovider.check(DefaultAuthorizationProvider.java:262)
> at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationP
> rovider.checkPermission(DefaultAuthorizationProvider.java:175)cd
> at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.c
> heckPermission(FSPermissionChecker.java:152)
> at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPerm
> ission(FSDirectory.java:3560)
> at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPerm
> ission(FSDirectory.java:3543)
> at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPath
> Access(FSDirectory.java:3514)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPat
> hAccess(FSNamesystem.java:6566)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlock
> LocationsInt(FSNamesystem.java:2009)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlock
> Locations(FSNamesystem.java:1977)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlock
> Locations(FSNamesystem.java:1890)
> at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.get
> BlockLocations(NameNodeRpcServer.java:572)
> at org.apache.hadoop.hdfs.server.namenode.AuthorizationProvider
> ProxyClientProtocol.getBlockLocations(Authorizatio
> nProviderProxyClientProtocol.java:89)
> at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServ
> erSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolS
> erverSideTranslatorPB.java:365)
> at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocol
> Protos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNam
> enodeProtocolProtos.java)
> at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcIn
> voker.call(ProtobufRpcEngine.java:617)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2141)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2137)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGro
> upInformation.java:1912)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2135)
>
>
> *[hdfs@cloudera-3 bin]$ *hdfs dfs -ls /user/history/done_intermedia
> te/hdfs/job_1496716928803_0013-1500286115191-hdfs-Kylin_
> Fact_Distinct_Columns_kylin_sales_cube_Step-1500286137251-
> 0-0-FAILED-root.users.hdfs-1500286120268.jhist
> -rwxrwx--- 2 hdfs supergroup 21673 2017-07-17 18:08
> /user/history/done_intermediate/hdfs/job_1496716928803_0013-
> 1500286115191-hdfs-Kylin_Fact_Distinct_Columns_kylin_sales_c
> ube_Step-1500286137251-0-0-FAILED-root.users.hdfs-1500286120268.jhist
>
>
> my question is : why runs as mapred user ? I cannot find the config in
> kylin , hadoop,yarn.
>
> Thanks in advane.
>
> Norbert
>
>