You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2016/12/07 03:28:58 UTC
[jira] [Updated] (SPARK-18758) StreamingQueryListener events from a
StreamingQuery should be sent only to the listeners in the same session as
the query
[ https://issues.apache.org/jira/browse/SPARK-18758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tathagata Das updated SPARK-18758:
----------------------------------
Description:
Listeners added with `sparkSession.streams.addListener(l)` are added to a SparkSession. So events only from queries in the same session as a listener should be posted to the listener.
Currently, all the events gets routed through the Spark's main listener bus, and therefore all StreamingQueryListener events gets posted to StreamingQueryListeners in all sessions. This is wrong.
was:Listeners added with `sparkSession.streams.addListener(l)` are added to a SparkSession. So events only from queries in the same session as a listener should be posted to the listener.
> StreamingQueryListener events from a StreamingQuery should be sent only to the listeners in the same session as the query
> -------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-18758
> URL: https://issues.apache.org/jira/browse/SPARK-18758
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming
> Affects Versions: 2.0.2
> Reporter: Tathagata Das
> Priority: Critical
>
> Listeners added with `sparkSession.streams.addListener(l)` are added to a SparkSession. So events only from queries in the same session as a listener should be posted to the listener.
> Currently, all the events gets routed through the Spark's main listener bus, and therefore all StreamingQueryListener events gets posted to StreamingQueryListeners in all sessions. This is wrong.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org