You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Kan Zhang (JIRA)" <ji...@apache.org> on 2014/04/12 01:34:14 UTC

[jira] [Updated] (SPARK-1475) Draining event logging queue before stopping event logger

     [ https://issues.apache.org/jira/browse/SPARK-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kan Zhang updated SPARK-1475:
-----------------------------

    Description: When stopping SparkListenerBus, its event queue needs to be drained. And this needs to happen before event logger is stopped. Otherwise, any events still waiting to be processed in the queue will be lost and consequently event log file may be incomplete.   (was: When SparkListenerBus thread is stopped, its event queue needs to be drained. And this needs to happen before event logger is stopped. Otherwise, any events still waiting to be processed in queue will be lost and consequently event log file may be incomplete. )

> Draining event logging queue before stopping event logger
> ---------------------------------------------------------
>
>                 Key: SPARK-1475
>                 URL: https://issues.apache.org/jira/browse/SPARK-1475
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>            Reporter: Kan Zhang
>            Assignee: Kan Zhang
>            Priority: Blocker
>             Fix For: 1.0.0
>
>
> When stopping SparkListenerBus, its event queue needs to be drained. And this needs to happen before event logger is stopped. Otherwise, any events still waiting to be processed in the queue will be lost and consequently event log file may be incomplete. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)