You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Zhen Wang (Jira)" <ji...@apache.org> on 2024/06/05 08:06:00 UTC

[jira] [Created] (FLINK-35525) HDFS delegation token fetched by custom DelegationTokenProvider is not passed to Yarn AM

Zhen Wang created FLINK-35525:
---------------------------------

             Summary: HDFS  delegation token fetched by custom DelegationTokenProvider is not passed to Yarn AM
                 Key: FLINK-35525
                 URL: https://issues.apache.org/jira/browse/FLINK-35525
             Project: Flink
          Issue Type: Bug
          Components: Deployment / YARN
    Affects Versions: 1.18.1, 1.19.0
            Reporter: Zhen Wang


I tried running flink with hadoop proxy user by disabling HadoopModuleFactory and flink built-in token providers, and implementing a custom token provider.

However, only the hdfs token obtained by hadoopfs provider was added in YarnClusterDescriptor, which resulted in Yarn AM submission failure.

Discussion: https://github.com/apache/flink/pull/22009#issuecomment-2132676114



--
This message was sent by Atlassian Jira
(v8.20.10#820010)