You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 小宇（王宇） <10...@qq.com> on 2018/09/18 03:53:16 UTC
回复： kylin kerberos problem
hi ShaoFengerror msg belong of kerberos,when kylin try connect main hadoop cluster(need kerberos),and when kylin try connect hbase(no need kerberos),But in my env setting is global,see my hadoop conf,core-site.xml
<property>
<name>hadoop.security.authentication</name>
<value>kerberos</value>
</property>
<property>
<name>hadoop.security.authorization</name>
<value>true</value>
</property>
so :
kylin encounter problem
hbaseconnection: hadoop.security.authentication should be simple,and hadoop.security.authorization should be false
main HDFS:hadoop.security.authentication should be kerberos,and hadoop.security.authorization should be true
I edit source code,see
in single thread ,it's ok.But in concurrent env,It's bad.
good luck!
------------------ 原始邮件 ------------------
发件人: "ShaoFeng Shi"<sh...@apache.org>;
发送时间: 2018年9月16日(星期天) 晚上10:26
收件人: "kylin用户邮件组"<us...@kylin.apache.org>;
主题: Re: kylin kerberos problem
Hi Yu,
Please describe your problem with clear information and a concrete error message if you have. A "doesn't work" has no value. I have no idea from it ...
yu.wang <10...@qq.com> 于2018年9月13日周四 下午4:30写道：
hello everyone!
my company prepare to use kylin for our olap platform.But in the process of build kylin,we found a kerberos problem
My env:
kylin data source:main hadoop cluster(build for cloudera manager,kerberos is enable)
hbase on hdfs:another cluster(build for ambari,no kerberos)
kylin client:kylin2.3.1
our idea :
use the main hadoop cluster for hive datasource and cube compute,at last the cube to hfile insert into standlone hbase cluster
But we encounter probleam in kylin
1,kylin on start init hbase connection（no need kerberos）
2,kylin load hive table,connect hive metastore(need kerberos)
3,kylin create hdfs client to get hive flat table size(need kerberos)
I check the kylin source code(2.3.1),edit the code to switch enable or disable kerberos,But in concurrent env,it doesn't work
yu.wang
best wishes~~
--
Best regards,
Shaofeng Shi 史少锋
Re: kylin kerberos problem
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Yu, could you please provide a patch for your change? We welcome
contributions! Thank you.
小宇（王宇） <10...@qq.com> 于2018年9月18日周二 上午11:53写道：
> hi ShaoFeng
> error msg belong of kerberos,when kylin try connect main hadoop
> cluster(need kerberos),and when kylin try connect hbase(no need
> kerberos),But in my env setting is global,see my hadoop conf,core-site.xml
>
> <property>
> <name>hadoop.security.authentication</name>
> <value>kerberos</value>
> </property>
>
> <property>
> <name>hadoop.security.authorization</name>
> <value>true</value>
> </property>
>
>
> so :
> *kylin *encounter problem
> *hbaseconnection: **hadoop.security.authentication* should be *simple*,and
> *hadoop.security.authorization* should be *false*
> *main HDFS*:*hadoop.security.authentication* should be *kerberos*,and
> *hadoop.security.authorization* should be *true*
>
> *I edit source code,see*
>
>
> in single thread ,it's ok.But in concurrent env,It's bad.
>
>
>
>
> good luck!
>
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "ShaoFeng Shi"<sh...@apache.org>;
> *发送时间:* 2018年9月16日(星期天) 晚上10:26
> *收件人:* "kylin用户邮件组"<us...@kylin.apache.org>;
> *主题:* Re: kylin kerberos problem
>
> Hi Yu,
>
> Please describe your problem with clear information and a concrete error
> message if you have. A "doesn't work" has no value. I have no idea from it
> ...
>
>
>
> yu.wang <10...@qq.com> 于2018年9月13日周四 下午4:30写道：
>
>> hello everyone!
>>
>> my company prepare to use kylin for our olap platform.But in the process
>> of build kylin,we found a kerberos problem
>> My env:
>> *kylin data source*:main hadoop cluster(build for cloudera manager,*kerberos
>> is enable*)
>> *hbase on hdfs*:another cluster(build for ambari,*no kerberos*)
>> *kylin client:kylin2.3.1*
>>
>> our idea :
>> use the main hadoop cluster for hive datasource and cube compute,at last
>> the cube to hfile insert into standlone hbase cluster
>>
>> But we encounter probleam in kylin
>> 1,kylin on start init hbase connection（no need kerberos）
>> 2,kylin load hive table,connect hive metastore(need kerberos)
>> 3,kylin create hdfs client to get hive flat table size(need kerberos)
>>
>> I check the kylin source code(2.3.1),edit the code to switch enable or
>> disable kerberos,But in concurrent env,it doesn't work
>>
>> yu.wang
>> best wishes~~
>>
>>
>>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
--
Best regards,
Shaofeng Shi 史少锋