You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2016/01/20 21:01:39 UTC

[jira] [Resolved] (SPARK-12847) Remove StreamingListenerBus and post all Streaming events to the same thread as Spark events

     [ https://issues.apache.org/jira/browse/SPARK-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tathagata Das resolved SPARK-12847.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

> Remove StreamingListenerBus and post all Streaming events to the same thread as Spark events
> --------------------------------------------------------------------------------------------
>
>                 Key: SPARK-12847
>                 URL: https://issues.apache.org/jira/browse/SPARK-12847
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core, Streaming
>            Reporter: Shixiong Zhu
>            Assignee: Shixiong Zhu
>             Fix For: 2.0.0
>
>
> SparkListener.onOtherEvent  was added in https://github.com/apache/spark/pull/10061. SQLListener uses it to dispatch SQL special events instead of creating a new separate listener bus.
> Streaming can also use the similar approach to eliminate the StreamingListenerBus. Right now, nondeterministic message order in two listener buses are really tricky when someone implements both SparkListener and StreamingListener. And if we can use only one listener bus in Spark, the nondeterministic message order will be eliminated and we can also remove a lot of codes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org