[jira] [Commented] (FLINK-14360) Flink on yarn should support obtain delegation tokens of multi hdfs namespaces

["Shen Yinjie (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-14360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949209#comment-16949209 ] 

Shen Yinjie commented on FLINK-14360:
-------------------------------------

Hi ,[~karmagyz] ,We deploy flink on yarn with RM federation and multi hdfs namespaces and hdfs clusters,flink  would fail to connect to some hdfs namenodes  due to lack of delegation tokens.
We provide a configuration for users to set a list of hdfs scheme names.So that before flink appmaster start,it will obtain these delegation tokens for specified hdfs namenodes.

> Flink on yarn should support obtain delegation tokens of multi hdfs namespaces
> ------------------------------------------------------------------------------
>
>                 Key: FLINK-14360
>                 URL: https://issues.apache.org/jira/browse/FLINK-14360
>             Project: Flink
>          Issue Type: Improvement
>          Components: Deployment / YARN
>            Reporter: Shen Yinjie
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> There's a scenario when deploy flink on yarn with multi hdfs cluster or hdfs federation, Flink need to get delegation tokens of all the namespaces before start appmaster.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)