You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Flink Jira Bot (Jira)" <ji...@apache.org> on 2021/11/07 22:39:00 UTC
[jira] [Updated] (FLINK-16861) Adding delegation token to the AM
container Failed
[ https://issues.apache.org/jira/browse/FLINK-16861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Flink Jira Bot updated FLINK-16861:
-----------------------------------
Labels: auto-deprioritized-major stale-minor (was: auto-deprioritized-major)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Minor but is unassigned and neither itself nor its Sub-Tasks have been updated for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is still Minor, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized.
> Adding delegation token to the AM container Failed
> --------------------------------------------------
>
> Key: FLINK-16861
> URL: https://issues.apache.org/jira/browse/FLINK-16861
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
> Affects Versions: 1.9.1, 1.10.0
> Reporter: Xianxun Ye
> Priority: Minor
> Labels: auto-deprioritized-major, stale-minor
>
> This EXP happended When I use hive connector with kerberos auth.
> Althrough modify the 'yarn-site.xml' yarn.resourcemanager.principal value to the special principal, I can fix this. But I have to change this value every times by modify yarn-site.xml file, when submit a hive conncetor job. This is not very convenient for dev.
>
> {code:java}
> //代码占位符
> 2020-03-06 22:58:01,778 INFO org.apache.flink.yarn.AbstractYarnClusterDescriptor - Adding delegation token to the AM container..
> 2020-03-06 22:58:01,781 ERROR org.apache.flink.client.cli.CliFrontend - Error while running the command.
> org.apache.flink.client.deployment.ClusterDeploymentException: Could not deploy Yarn job cluster.
> at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:82)
> at org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:230)
> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205)
> at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010)
> at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1754)
> at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083)
> Caused by: java.io.IOException: Can't get Master Kerberos principal for use as renewer
> at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:116)
> at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
> at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
> at org.apache.flink.yarn.Utils.setTokensFor(Utils.java:269)
> at org.apache.flink.yarn.AbstractYarnClusterDescriptor.startAppMaster(AbstractYarnClusterDescriptor.java:929)
> at org.apache.flink.yarn.AbstractYarnClusterDescriptor.deployInternal(AbstractYarnClusterDescriptor.java:507)
> at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:75)
> ... 9 more
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)