You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by "泳..." <ch...@foxmail.com> on 2020/11/09 03:28:18 UTC

Oozie(5.2.0)get jhs delegation token occured exception in updateCredentials

hi:


When I use Oozie(5.2.0) Encountered the follow problem.
please give me some advice,Thanks!



Operation Environment:
Apache Oozie 5.2.0 
Apache Hadoop 3.1.1 with Kerberos authentication 

Runing Map-reduce exmaple Action:GET JHS_DELEGATION_TOKEN FAIL
2020-11-09 10:24:27,193 DEBUG JHSCredentials:526 - SERVER[hadoop301] USER[hadoop] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000000-201109102404406-oozie-hado-W] ACTION[0000000-201109102404406-oozie-hado-W@shell-node] exception in updateCredentials
java.io.IOException: DestHost:destPort hadoop301:10020 , LocalHost:localPort hadoop301.bonc.com/172.16.13.11:0. Failed on local exception: java.io.IOException: org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS] 




If modify this part of the code,just shell action will normal running,Map-reduce action Still failed.
&nbsp;&nbsp;&nbsp; org.apache.oozie.action.hadoop.JavaActionExecutor
...
&nbsp;&nbsp;&nbsp; private void addHadoopCredentialPropertiesToActionConf(Map<String, CredentialsProperties&gt; credentialsProperties) {
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LOG.info("Adding default credentials for action: hdfs, yarn and jhs");
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; addHadoopCredentialProperties(credentialsProperties, CredentialsProviderFactory.HDFS);
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; addHadoopCredentialProperties(credentialsProperties, CredentialsProviderFactory.YARN);
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //addHadoopCredentialProperties(credentialsProperties, CredentialsProviderFactory.JHS);
&nbsp;&nbsp;&nbsp; }
...

Re: Oozie(5.2.0)get jhs delegation token occured exception in updateCredentials

Posted by Peter Cseh <ge...@cloudera.com.INVALID>.
Have you set up your kerberos configuration correctly?
Is the JobHistoryServer URL is configured? Is JHS up?
gp

On Mon, Nov 9, 2020 at 9:47 AM 泳... <ch...@foxmail.com> wrote:

> hi:
>
>
> When I use Oozie(5.2.0) Encountered the follow problem.
> please give me some advice,Thanks!
>
>
>
> Operation Environment:
> Apache Oozie 5.2.0
> Apache Hadoop 3.1.1 with Kerberos authentication
>
> Runing Map-reduce exmaple Action:GET JHS_DELEGATION_TOKEN FAIL
> 2020-11-09 10:24:27,193 DEBUG JHSCredentials:526 - SERVER[hadoop301]
> USER[hadoop] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-201109102404406-oozie-hado-W]
> ACTION[0000000-201109102404406-oozie-hado-W@shell-node] exception in
> updateCredentials
> java.io.IOException: DestHost:destPort hadoop301:10020 ,
> LocalHost:localPort hadoop301.bonc.com/172.16.13.11:0. Failed on local
> exception: java.io.IOException:
> org.apache.hadoop.security.AccessControlException: Client cannot
> authenticate via:[TOKEN, KERBEROS]
>
>
>
>
> If modify this part of the code,just shell action will normal
> running,Map-reduce action Still failed.
> &nbsp;&nbsp;&nbsp; org.apache.oozie.action.hadoop.JavaActionExecutor
> ...
> &nbsp;&nbsp;&nbsp; private void
> addHadoopCredentialPropertiesToActionConf(Map<String,
> CredentialsProperties&gt; credentialsProperties) {
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LOG.info("Adding default
> credentials for action: hdfs, yarn and jhs");
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> addHadoopCredentialProperties(credentialsProperties,
> CredentialsProviderFactory.HDFS);
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> addHadoopCredentialProperties(credentialsProperties,
> CredentialsProviderFactory.YARN);
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> //addHadoopCredentialProperties(credentialsProperties,
> CredentialsProviderFactory.JHS);
> &nbsp;&nbsp;&nbsp; }
> ...



-- 
*Peter Cseh* | Software Engineer, Cloudera Search
cloudera.com <https://www.cloudera.com>
[image: Cloudera] <https://www.cloudera.com/>
[image: Cloudera on Twitter] <https://twitter.com/cloudera> [image:
Cloudera on Facebook] <https://www.facebook.com/cloudera> [image: Cloudera
on LinkedIn] <https://www.linkedin.com/company/cloudera>
<https://www.cloudera.com/>
------------------------------