[jira] [Closed] (FLINK-16595) Support extra hadoop filesystem URLs for which to request delegation tokens

["Robert Metzger (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-16595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Metzger closed FLINK-16595.
----------------------------------
    Resolution: Fixed

Merged in https://github.com/apache/flink/commit/f0f6e50f700d46f13002fddd93d1d073c890227a

> Support extra hadoop filesystem URLs for which to request delegation tokens
> ---------------------------------------------------------------------------
>
>                 Key: FLINK-16595
>                 URL: https://issues.apache.org/jira/browse/FLINK-16595
>             Project: Flink
>          Issue Type: Improvement
>          Components: Deployment / YARN
>    Affects Versions: 1.10.0
>            Reporter: fa zheng
>            Assignee: Husky Zeng
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.12.0
>
>
> When the cluster has multiple nameservices, the client only can obtain the token of default nameservice. We should add an configuration in YarnConfigOptions to obtain all nameservices refer to spark.yarn.access.hadoopFileSystems. [yarn-specific-kerberos-configuration|https://spark.apache.org/docs/latest/running-on-yarn.html#yarn-specific-kerberos-configuration].
> I encountered this problem when the directory of yarn logs is in another nameservice.  It will lead a long waiting for application to run and the log can not  be aggregated finally.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)