[jira] [Resolved] (SPARK-6036) EventLog process logic has race condition with Akka actor system

["Sean Owen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved SPARK-6036.
------------------------------
          Resolution: Fixed
       Fix Version/s: 1.3.1
    Target Version/s:   (was: 1.4.0, 1.3.1)

> EventLog process logic has race condition with Akka actor system
> ----------------------------------------------------------------
>
>                 Key: SPARK-6036
>                 URL: https://issues.apache.org/jira/browse/SPARK-6036
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Web UI
>    Affects Versions: 1.3.0
>            Reporter: Zhang, Liye
>            Assignee: Zhang, Liye
>             Fix For: 1.4.0, 1.3.1
>
>
> when application finished, akka actor system will trigger disassociated event, and Master will rebuild SparkUI on web, in which progress will check whether the eventlog files are still in progress. The current logic in SparkContext is first stop the actorsystem, and then stop enentLogListener. This will cause that the enentLogListener has not finished renaming the eventLog dir name (from app-xxxx.inprogress to app-xxxx)  when Spark Master try to access the dir. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org