You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2017/08/19 09:53:01 UTC
[jira] [Commented] (KYLIN-1784) When Kylin Load HFile to HBase
Table,the Hfiles have incorrect permission
[ https://issues.apache.org/jira/browse/KYLIN-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16134045#comment-16134045 ]
Shaofeng SHI commented on KYLIN-1784:
-------------------------------------
Hi dcswinner, this is expected. What's your suggestion?
> When Kylin Load HFile to HBase Table,the Hfiles have incorrect permission
> --------------------------------------------------------------------------
>
> Key: KYLIN-1784
> URL: https://issues.apache.org/jira/browse/KYLIN-1784
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Affects Versions: v1.5.2
> Environment: hadoop: 2.4.0.5
> hive:0.13.0.5
> hbase:0.98.8
> jdk:1.7.0_60-ea
> Reporter: dcswinner
> Assignee: Dong Li
> Labels: easyfix, newbie
> Fix For: Future
>
>
> when build a cube,the job running to Load HFile to HBase Table'step,I found that all of these hfiles's owner were belong to user:kylin and group:kylin on hdfs.
> eg:
> [bigdata@kylin02-pre ~]$ hadoop fs -ls /hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1
> Found 2 items
> -rwxrwxrwx 2 kylin kylin 6965632 2016-06-12 11:06 /hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1/13f7a13f6f754f2f8a15e0efe60dac1d_SeqId_2_
> -rwxrwxrwx 2 kylin kylin 7544515 2016-06-12 11:06 /hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1/dcf03d3be6ae4dd4a93b7a05cdf00382_SeqId_2_
> the owner were belong to user:kylin and group:kylin like above.
> then,when HBase run archive chore in backgroud,will throw an error:
> Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=hbase, access=WRITE, inode="/hbase/.tmp/data/default/KYLIN_9RJA24O
> ZEM/4f54f38dc4b96a04a82bdb780fef77c4/F2/3b9adb66f50e42918a9b6c4f67cb0261_SeqId_2_":kylin:kylin:-rw-r--r--
> I have a solution is change these hfiles's permission 777 before bulkload hfile to hbase:
> hadoop fs -chmod 777 /hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1/dcf03d3be6ae4dd4a93b7a05cdf00382_SeqId_2_
> or change these hfiles's owner and group:
> hadoop fs -chown hbase:hbase /hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1/dcf03d3be6ae4dd4a93b7a05cdf00382_SeqId_2_
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)