You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/02/27 04:55:00 UTC

[jira] [Commented] (SPARK-42592) Document SS guide doc for supporting multiple stateful operators (especially chained aggregations)

    [ https://issues.apache.org/jira/browse/SPARK-42592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693786#comment-17693786 ] 

Jungtaek Lim commented on SPARK-42592:
--------------------------------------

Ideally this should be a part of Spark 3.4.0... Since RC already happened, I'll try to see whether I can add the doc before RC2.

> Document SS guide doc for supporting multiple stateful operators (especially chained aggregations)
> --------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-42592
>                 URL: https://issues.apache.org/jira/browse/SPARK-42592
>             Project: Spark
>          Issue Type: Documentation
>          Components: Structured Streaming
>    Affects Versions: 3.5.0
>            Reporter: Jungtaek Lim
>            Priority: Major
>
> We made a change on the guide doc for SPARK-40925 via SPARK-42105, but from SPARK-42105 we only removed the section of "limitation of global watermark". That said, we haven't provided any example of new functionality, especially that users need to know about the change of SQL function (window) in chained time window aggregations.
> In this ticket, we will add the example of chained time window aggregations, with introducing new functionality of SQL function.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org