You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by bubugao0809 <bu...@163.com> on 2017/12/18 03:38:01 UTC
How to config kylin to use kerberized hadoop cluster
Our hadoop cluster has been kerberized, including hdfs , yarn , hbase , hive
I don't know how to config kylin to integrate with current cluster, cause it always fail in step Build N-Dimension Cuboid with :
Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.
Re: Re: How to config kylin to use kerberized hadoop cluster
Posted by ShaoFeng Shi <sh...@apache.org>.
Good to know the problem is resolved.
2017-12-19 9:29 GMT+08:00 bubugao0809 <bu...@163.com>:
> @all
> I have figured out that it was the problem with MR2 server that has been
> kerberized yet, so after I kerberize MR2, everything works fine.
>
>
>
>
>
> At 2017-12-18 20:30:23, "ShaoFeng Shi" <sh...@apache.org> wrote:
>
> You might mess up the configuration, please search "java.io.IOException:
> Server asks us to fall back to SIMPLE auth, but this client is configured
> to only allow secure connections"
>
> 2017-12-18 19:44 GMT+08:00 alexinx <al...@163.com>:
>
>> I use two cluster. One is hbase cluster which not use kerberos, the other
>> is hive cluster which use kerberos.
>> In kylin, hbase configuration built on the basis of hive, so I encounter
>> this problem.
>>
>> On 12/18/2017 14:14，bubugao0809<bu...@163.com>
>> <bu...@163.com> wrote：
>>
>>
>>
>> hbase has been successfully kerberized, because otherwise hbase can not
>> be started, since mine can work properly.
>> Can you tell me what is the setting that leads to the error ?
>> @{alexinx@163.com}
>>
>>
>>
>> At 2017-12-18 12:47:49, "alexinx" <al...@163.com> wrote:
>>
>> I have encountered a similar problem.
>> Just check your hbase's configuration, it might do not use kerberos.
>>
>>
>> On 12/18/2017 11:38，bubugao0809<bu...@163.com>
>> <bu...@163.com> wrote：
>>
>> Our hadoop cluster has been kerberized, including hdfs , yarn , hbase ,
>> hive
>> I don't know how to config kylin to integrate with current cluster, cause
>> it always fail in step Build N-Dimension Cuboid with :
>>
>> Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
>> java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
>>
>> FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.
>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
--
Best regards,
Shaofeng Shi 史少锋
Re:Re: How to config kylin to use kerberized hadoop cluster
Posted by bubugao0809 <bu...@163.com>.
@all
I have figured out that it was the problem with MR2 server that has been kerberized yet, so after I kerberize MR2, everything works fine.
At 2017-12-18 20:30:23, "ShaoFeng Shi" <sh...@apache.org> wrote:
You might mess up the configuration, please search "java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections"
2017-12-18 19:44 GMT+08:00 alexinx <al...@163.com>:
I use two cluster. One is hbase cluster which not use kerberos, the other is hive cluster which use kerberos.
In kylin, hbase configuration built on the basis of hive, so I encounter this problem.
On 12/18/2017 14:14，bubugao0809<bu...@163.com> wrote：
hbase has been successfully kerberized, because otherwise hbase can not be started, since mine can work properly.
Can you tell me what is the setting that leads to the error ?
@{alexinx@163.com}
At 2017-12-18 12:47:49, "alexinx" <al...@163.com> wrote:
I have encountered a similar problem.
Just check your hbase's configuration, it might do not use kerberos.
On 12/18/2017 11:38，bubugao0809<bu...@163.com> wrote：
Our hadoop cluster has been kerberized, including hdfs , yarn , hbase , hive
I don't know how to config kylin to integrate with current cluster, cause it always fail in step Build N-Dimension Cuboid with :
Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.
--
Best regards,
Shaofeng Shi 史少锋
Re: How to config kylin to use kerberized hadoop cluster
Posted by ShaoFeng Shi <sh...@apache.org>.
You might mess up the configuration, please search "java.io.IOException:
Server asks us to fall back to SIMPLE auth, but this client is configured
to only allow secure connections"
2017-12-18 19:44 GMT+08:00 alexinx <al...@163.com>:
> I use two cluster. One is hbase cluster which not use kerberos, the other
> is hive cluster which use kerberos.
> In kylin, hbase configuration built on the basis of hive, so I encounter
> this problem.
>
> On 12/18/2017 14:14，bubugao0809<bu...@163.com> <bu...@163.com>
> wrote：
>
>
>
> hbase has been successfully kerberized, because otherwise hbase can not be
> started, since mine can work properly.
> Can you tell me what is the setting that leads to the error ?
> @{alexinx@163.com}
>
>
>
> At 2017-12-18 12:47:49, "alexinx" <al...@163.com> wrote:
>
> I have encountered a similar problem.
> Just check your hbase's configuration, it might do not use kerberos.
>
>
> On 12/18/2017 11:38，bubugao0809<bu...@163.com> <bu...@163.com>
> wrote：
>
> Our hadoop cluster has been kerberized, including hdfs , yarn , hbase ,
> hive
> I don't know how to config kylin to integrate with current cluster, cause
> it always fail in step Build N-Dimension Cuboid with :
>
> Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
> java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
>
> FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.
>
>
--
Best regards,
Shaofeng Shi 史少锋
Re: How to config kylin to use kerberized hadoop cluster
Posted by alexinx <al...@163.com>.
I use two cluster. One is hbase cluster which not use kerberos, the other is hive cluster which use kerberos.
In kylin, hbase configuration built on the basis of hive, so I encounter this problem.
On 12/18/2017 14:14，bubugao0809<bu...@163.com> wrote：
hbase has been successfully kerberized, because otherwise hbase can not be started, since mine can work properly.
Can you tell me what is the setting that leads to the error ?
@{alexinx@163.com}
At 2017-12-18 12:47:49, "alexinx" <al...@163.com> wrote:
I have encountered a similar problem.
Just check your hbase's configuration, it might do not use kerberos.
On 12/18/2017 11:38，bubugao0809<bu...@163.com> wrote：
Our hadoop cluster has been kerberized, including hdfs , yarn , hbase , hive
I don't know how to config kylin to integrate with current cluster, cause it always fail in step Build N-Dimension Cuboid with :
Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.
Re: Re: Re: How to config kylin to use kerberized hadoop cluster
Posted by Billy Liu <bi...@apache.org>.
There is no kerberized version Kylin since no additional setting required
from kylin.
2017-12-18 14:29 GMT+08:00 bubugao0809 <bu...@163.com>:
>
> So, it means kylin does not need additional setting to use on a kerberized
> hadoop cluster?
> What's more, does kylin has kerberized version of its own?
>
>
>
>
> At 2017-12-18 14:23:29, "Billy Liu" <bi...@apache.org> wrote:
>
> kylin.job.status.with.kerberos=true has been deprecated since https://issues.apache.org/jira/browse/KYLIN-1319, and code removed recently.
>
> please check your YARN configuration file. For reference: http://pivotalhd-210.docs.pivotal.io/doc/2100/webhelp/topics/ConfiguringKerberosforHDFSandYARNMapReduce.html
>
>
> 2017-12-18 14:14 GMT+08:00 bubugao0809 <bu...@163.com>:
>
>>
>>
>> hbase has been successfully kerberized, because otherwise hbase can not
>> be started, since mine can work properly.
>> Can you tell me what is the setting that leads to the error ?
>> @{alexinx@163.com}
>>
>>
>>
>> At 2017-12-18 12:47:49, "alexinx" <al...@163.com> wrote:
>>
>> I have encountered a similar problem.
>> Just check your hbase's configuration, it might do not use kerberos.
>>
>>
>> On 12/18/2017 11:38，bubugao0809<bu...@163.com>
>> <bu...@163.com> wrote：
>>
>> Our hadoop cluster has been kerberized, including hdfs , yarn , hbase ,
>> hive
>> I don't know how to config kylin to integrate with current cluster, cause
>> it always fail in step Build N-Dimension Cuboid with :
>>
>> Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
>> java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
>>
>> FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.
>>
>>
>
Re:Re: Re: How to config kylin to use kerberized hadoop cluster
Posted by bubugao0809 <bu...@163.com>.
So, it means kylin does not need additional setting to use on a kerberized hadoop cluster?
What's more, does kylin has kerberized version of its own?
At 2017-12-18 14:23:29, "Billy Liu" <bi...@apache.org> wrote:
kylin.job.status.with.kerberos=true has been deprecated since https://issues.apache.org/jira/browse/KYLIN-1319, and code removed recently.
please check your YARN configuration file. For reference: http://pivotalhd-210.docs.pivotal.io/doc/2100/webhelp/topics/ConfiguringKerberosforHDFSandYARNMapReduce.html
2017-12-18 14:14 GMT+08:00 bubugao0809 <bu...@163.com>:
hbase has been successfully kerberized, because otherwise hbase can not be started, since mine can work properly.
Can you tell me what is the setting that leads to the error ?
@{alexinx@163.com}
At 2017-12-18 12:47:49, "alexinx" <al...@163.com> wrote:
I have encountered a similar problem.
Just check your hbase's configuration, it might do not use kerberos.
On 12/18/2017 11:38，bubugao0809<bu...@163.com> wrote：
Our hadoop cluster has been kerberized, including hdfs , yarn , hbase , hive
I don't know how to config kylin to integrate with current cluster, cause it always fail in step Build N-Dimension Cuboid with :
Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.
Re: Re: How to config kylin to use kerberized hadoop cluster
Posted by Billy Liu <bi...@apache.org>.
kylin.job.status.with.kerberos=true has been deprecated since
https://issues.apache.org/jira/browse/KYLIN-1319, and code removed
recently.
please check your YARN configuration file. For reference:
http://pivotalhd-210.docs.pivotal.io/doc/2100/webhelp/topics/ConfiguringKerberosforHDFSandYARNMapReduce.html
2017-12-18 14:14 GMT+08:00 bubugao0809 <bu...@163.com>:
>
>
> hbase has been successfully kerberized, because otherwise hbase can not be
> started, since mine can work properly.
> Can you tell me what is the setting that leads to the error ?
> @{alexinx@163.com}
>
>
>
> At 2017-12-18 12:47:49, "alexinx" <al...@163.com> wrote:
>
> I have encountered a similar problem.
> Just check your hbase's configuration, it might do not use kerberos.
>
>
> On 12/18/2017 11:38，bubugao0809<bu...@163.com> <bu...@163.com>
> wrote：
>
> Our hadoop cluster has been kerberized, including hdfs , yarn , hbase ,
> hive
> I don't know how to config kylin to integrate with current cluster, cause
> it always fail in step Build N-Dimension Cuboid with :
>
> Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
> java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
>
> FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.
>
>
Re:Re: How to config kylin to use kerberized hadoop cluster
Posted by bubugao0809 <bu...@163.com>.
hbase has been successfully kerberized, because otherwise hbase can not be started, since mine can work properly.
Can you tell me what is the setting that leads to the error ?
@{alexinx@163.com}
At 2017-12-18 12:47:49, "alexinx" <al...@163.com> wrote:
I have encountered a similar problem.
Just check your hbase's configuration, it might do not use kerberos.
On 12/18/2017 11:38，bubugao0809<bu...@163.com> wrote：
Our hadoop cluster has been kerberized, including hdfs , yarn , hbase , hive
I don't know how to config kylin to integrate with current cluster, cause it always fail in step Build N-Dimension Cuboid with :
Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.
Re: How to config kylin to use kerberized hadoop cluster
Posted by alexinx <al...@163.com>.
I have encountered a similar problem.
Just check your hbase's configuration, it might do not use kerberos.
On 12/18/2017 11:38，bubugao0809<bu...@163.com> wrote：
Our hadoop cluster has been kerberized, including hdfs , yarn , hbase , hive
I don't know how to config kylin to integrate with current cluster, cause it always fail in step Build N-Dimension Cuboid with :
Exception: java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
java.io.IOException: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "dp-test-04.aispeech.com/172.16.20.159"; destination host is: "dp-test-01.aispeech.com":10020;
FYI, I tried 'kylin.job.status.with.kerberos=true', but kylin reported the same error as above.