You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/11/16 20:44:00 UTC

[jira] [Resolved] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators

     [ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jungtaek Lim resolved SPARK-40940.
----------------------------------
    Fix Version/s: 3.4.0
       Resolution: Fixed

Issue resolved by pull request 38503
[https://github.com/apache/spark/pull/38503]

> Fix the unsupported ops checker to allow chaining of stateful operators
> -----------------------------------------------------------------------
>
>                 Key: SPARK-40940
>                 URL: https://issues.apache.org/jira/browse/SPARK-40940
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 3.4.0
>            Reporter: Alex Balikov
>            Assignee: Wei Liu
>            Priority: Major
>             Fix For: 3.4.0
>
>
> This is follow up ticket on https://issues.apache.org/jira/browse/SPARK-40925 - once we allow chaining of stateful operators in Spark SS, we need to fix the unsupported ops checker to allow these (currently they are blocked and require setting spark.sql.streaming.unsupportedOperationCheck to false



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org