You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2016/02/26 15:12:18 UTC
[jira] [Commented] (SPARK-3374) Spark on Yarn remove deprecated
configs for 2.0
[ https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15169068#comment-15169068 ]
Thomas Graves commented on SPARK-3374:
--------------------------------------
Just adding some more detail:
Note we should remove all environment variable configs. These were mostly used in yarn-client mode (see YarnClientSchedulerBackend). We should check all yarn code for deprecated configs and remove. We should also look at the yarn.ClientArguments and ApplicationMasterArguments to see if we really need these or if we can just do it through configs.
> Spark on Yarn remove deprecated configs for 2.0
> -----------------------------------------------
>
> Key: SPARK-3374
> URL: https://issues.apache.org/jira/browse/SPARK-3374
> Project: Spark
> Issue Type: Sub-task
> Components: YARN
> Affects Versions: 1.1.0
> Reporter: Thomas Graves
>
> The configs in yarn have gotten scattered and inconsistent between cluster and client modes and supporting backwards compatibility. We should try to clean this up, move things to common places and support configs across both cluster and client modes where we want to make them public.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org