You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Aaron Davidson (JIRA)" <ji...@apache.org> on 2014/05/16 13:08:33 UTC

[jira] [Created] (SPARK-1860) Standalone Worker cleanup should not clean up running applications by default

Aaron Davidson created SPARK-1860:
-------------------------------------

             Summary: Standalone Worker cleanup should not clean up running applications by default
                 Key: SPARK-1860
                 URL: https://issues.apache.org/jira/browse/SPARK-1860
             Project: Spark
          Issue Type: Bug
          Components: Deploy
    Affects Versions: 1.0.0
            Reporter: Aaron Davidson
            Priority: Critical


The default values of the standalone worker cleanup code cleanup all application data every 7 days. This includes jars that were added to any applications that happen to be running for longer than 7 days, hitting streaming jobs especially hard.

Applications should not be cleaned up if they're still running. Until then, this behavior should not be enabled by default.



--
This message was sent by Atlassian JIRA
(v6.2#6252)