[jira] [Commented] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN

["Apache Spark (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-37205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445395#comment-17445395 ] 

Apache Spark commented on SPARK-37205:
--------------------------------------

User 'sunchao' has created a pull request for this issue:
https://github.com/apache/spark/pull/34635

> Support mapreduce.job.send-token-conf when starting containers in YARN
> ----------------------------------------------------------------------
>
>                 Key: SPARK-37205
>                 URL: https://issues.apache.org/jira/browse/SPARK-37205
>             Project: Spark
>          Issue Type: New Feature
>          Components: YARN
>    Affects Versions: 3.3.0
>            Reporter: Chao Sun
>            Priority: Major
>
> {{mapreduce.job.send-token-conf}} is a useful feature in Hadoop (see [YARN-5910|https://issues.apache.org/jira/browse/YARN-5910] with which RM is not required to statically have config for all the secure HDFS clusters. Currently it only works for MRv2 but it'd be nice if Spark can also use this feature. I think we only need to pass the config to {{LaunchContainerContext}} in {{Client.createContainerLaunchContext}}.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org