You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Andrew Or (JIRA)" <ji...@apache.org> on 2015/11/20 02:37:11 UTC

[jira] [Resolved] (SPARK-11843) Isolate staging directory across applications on same YARN cluster

     [ https://issues.apache.org/jira/browse/SPARK-11843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Or resolved SPARK-11843.
-------------------------------
    Resolution: Won't Fix

> Isolate staging directory across applications on same YARN cluster
> ------------------------------------------------------------------
>
>                 Key: SPARK-11843
>                 URL: https://issues.apache.org/jira/browse/SPARK-11843
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>            Reporter: Andrew Or
>            Priority: Minor
>
> If multiple clients share the same YARN cluster and file system they may end up using the same `.sparkStaging` directory. This may be a problem if their jars are called something similar, for instance. It would be easier to enforce isolation for both security and user experience if the staging directories are isolated. We can either:
> (1) allow users to configure the directory name
> (2) add an identifier to the directory name, which I prefer



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org