[jira] [Commented] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes

["Ravi Sanwal (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18071832#comment-18071832 ] 

Ravi Sanwal commented on SPARK-25500:
-------------------------------------

This would have been a really good feature [~liyinan926] , I wish we reconsidered this.
While pod templates works as a jackhammer, sometimes all we need is make a configmap available to the executors. Pod templates also become clunky where we have a monorepo style codebase hosting many jobs.

> Specify configmap and secrets in Spark driver and executor pods in Kubernetes
> -----------------------------------------------------------------------------
>
>                 Key: SPARK-25500
>                 URL: https://issues.apache.org/jira/browse/SPARK-25500
>             Project: Spark
>          Issue Type: Improvement
>          Components: Kubernetes, Spark Core
>    Affects Versions: 2.3.1
>            Reporter: Abhishek Rao
>            Priority: Minor
>
> This uses SPARK-23529. Support for specifying configmap and secrets as spark-configuration is requested.
> Using PR #22146, the above functionality can be achieved by passing template file. However, for spark properties (like log4j.properties, fairscheduler.xml and metrics.properties), we are proposing this approach as this is native to other configuration options specifications in spark.
> The configmaps and secrets have to be pre-created before using this as spark configuration.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org