[jira] [Created] (SPARK-12847) Remove StreamingListenerBus and post all Streaming events to the same thread as Spark events

["Shixiong Zhu (JIRA)" <ji...@apache.org>]

Shixiong Zhu created SPARK-12847:
------------------------------------

             Summary: Remove StreamingListenerBus and post all Streaming events to the same thread as Spark events
                 Key: SPARK-12847
                 URL: https://issues.apache.org/jira/browse/SPARK-12847
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core, Streaming
            Reporter: Shixiong Zhu
            Assignee: Shixiong Zhu


SparkListener.onOtherEvent  was added in https://github.com/apache/spark/pull/10061. SQLListener uses it to dispatch SQL special events instead of creating a new separate listener bus.

Streaming can also use the similar approach to eliminate the StreamingListenerBus. Right now, nondeterministic message order in two listener buses are really tricky when someone implements both SparkListener and StreamingListener. And if we can use only one listener bus in Spark, the nondeterministic message order will be eliminated and we can also remove a lot of codes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org