You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Anirudh Ramanathan (JIRA)" <ji...@apache.org> on 2018/07/12 07:51:00 UTC

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

    [ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16541272#comment-16541272 ] 

Anirudh Ramanathan commented on SPARK-24434:
--------------------------------------------

Thanks for kicking this design off Stavros. 
The proposal is a great start - I made some comments about some of the details.


> Support user-specified driver and executor pod templates
> --------------------------------------------------------
>
>                 Key: SPARK-24434
>                 URL: https://issues.apache.org/jira/browse/SPARK-24434
>             Project: Spark
>          Issue Type: New Feature
>          Components: Kubernetes
>    Affects Versions: 2.4.0
>            Reporter: Yinan Li
>            Priority: Major
>
> With more requests for customizing the driver and executor pods coming, the current approach of adding new Spark configuration options has some serious drawbacks: 1) it means more Kubernetes specific configuration options to maintain, and 2) it widens the gap between the declarative model used by Kubernetes and the configuration model used by Spark. We should start designing a solution that allows users to specify pod templates as central places for all customization needs for the driver and executor pods. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org