You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Kousuke Saruta (JIRA)" <ji...@apache.org> on 2015/05/09 12:04:59 UTC

[jira] [Created] (SPARK-7503) Resources in .sparkStaging directory can't be cleaned up on error

Kousuke Saruta created SPARK-7503:
-------------------------------------

             Summary: Resources in .sparkStaging directory can't be cleaned up on error
                 Key: SPARK-7503
                 URL: https://issues.apache.org/jira/browse/SPARK-7503
             Project: Spark
          Issue Type: Bug
          Components: YARN
    Affects Versions: 1.4.0
            Reporter: Kousuke Saruta


When we run applications on YARN with cluster mode, uploaded resources on .sparkStaging directory can't be cleaned up in case of failure of uploading local resources.

You can see this issue by running following command.
{code}
bin/spark-submit --master yarn --deploy-mode cluster --class <someClassName> <non-existing-jar>
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org