You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/09/11 14:55:00 UTC

[jira] [Commented] (SPARK-21765) Ensure all leaf nodes that are derived from streaming sources have isStreaming=true

    [ https://issues.apache.org/jira/browse/SPARK-21765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161394#comment-16161394 ] 

Apache Spark commented on SPARK-21765:
--------------------------------------

User 'joseph-torres' has created a pull request for this issue:
https://github.com/apache/spark/pull/18973

> Ensure all leaf nodes that are derived from streaming sources have isStreaming=true
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-21765
>                 URL: https://issues.apache.org/jira/browse/SPARK-21765
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL, Structured Streaming
>    Affects Versions: 2.2.0
>            Reporter: Jose Torres
>            Assignee: Jose Torres
>             Fix For: 3.0.0
>
>
> LogicalPlan has an isStreaming bit, but it's incompletely implemented. Some streaming sources don't set the bit, and the bit can sometimes be lost in rewriting. Setting the bit for all plans that are logically streaming will help us simplify the logic around checking query plan validity.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org