You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/04/05 23:08:34 UTC

[jira] [Assigned] (SPARK-6716) Change SparkContext.DRIVER_IDENTIFIER from '' to 'driver'

     [ https://issues.apache.org/jira/browse/SPARK-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-6716:
-----------------------------------

    Assignee: Josh Rosen  (was: Apache Spark)

> Change SparkContext.DRIVER_IDENTIFIER from '<driver>' to 'driver'
> -----------------------------------------------------------------
>
>                 Key: SPARK-6716
>                 URL: https://issues.apache.org/jira/browse/SPARK-6716
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>            Reporter: Josh Rosen
>            Assignee: Josh Rosen
>
> Currently, the driver's executorId is set to {{<driver>}}.  This choice of ID was present in older Spark versions, but it has started to cause problems now that executorIds are used in more contexts, such as Ganglia metric names or driver thread-dump links the web UI.  The angle brackets must be escaped when embedding this ID in XML or as part of URLs and this has led to multiple problems:
> - https://issues.apache.org/jira/browse/SPARK-6484
> - https://issues.apache.org/jira/browse/SPARK-4313
> The simplest solution seems to be to change this id to something that does not contain any special characters, such as {{driver}}. 
> I'm not sure whether we can perform this change in a patch release, since this ID may be considered a stable API by metrics users, but it's probably okay to do this in a major release as long as we document it in the release notes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org