You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/10/19 16:47:00 UTC
[jira] [Updated] (FLINK-16595) Support extra hadoop filesystem URLs
for which to request delegation tokens
[ https://issues.apache.org/jira/browse/FLINK-16595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated FLINK-16595:
-----------------------------------
Labels: pull-request-available (was: )
> Support extra hadoop filesystem URLs for which to request delegation tokens
> ---------------------------------------------------------------------------
>
> Key: FLINK-16595
> URL: https://issues.apache.org/jira/browse/FLINK-16595
> Project: Flink
> Issue Type: Improvement
> Components: Deployment / YARN
> Affects Versions: 1.10.0
> Reporter: fa zheng
> Assignee: Husky Zeng
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.12.0
>
>
> When the cluster has multiple nameservices, the client only can obtain the token of default nameservice. We should add an configuration in YarnConfigOptions to obtain all nameservices refer to spark.yarn.access.hadoopFileSystems. [yarn-specific-kerberos-configuration|https://spark.apache.org/docs/latest/running-on-yarn.html#yarn-specific-kerberos-configuration].
> I encountered this problem when the directory of yarn logs is in another nameservice. It will lead a long waiting for application to run and the log can not be aggregated finally.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)