You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2021/03/23 00:55:00 UTC

[jira] [Commented] (SPARK-10816) EventTime based sessionization (session window)

    [ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306676#comment-17306676 ] 

Apache Spark commented on SPARK-10816:
--------------------------------------

User 'HeartSaVioR' has created a pull request for this issue:
https://github.com/apache/spark/pull/31937

> EventTime based sessionization (session window)
> -----------------------------------------------
>
>                 Key: SPARK-10816
>                 URL: https://issues.apache.org/jira/browse/SPARK-10816
>             Project: Spark
>          Issue Type: New Feature
>          Components: Structured Streaming
>            Reporter: Reynold Xin
>            Priority: Major
>         Attachments: SPARK-10816 Support session window natively.pdf, Session Window Support For Structure Streaming.pdf
>
>
> Currently structured streaming supports two kinds of windows: tumbling window and sliding window. Another useful window function is session window. Which is not supported by SS.
> Unlike time window (tumbling window and sliding window), session window doesn't have static window begin and end time. Session window creation depends on defined session gap which can be static or dynamic.
> For static session gap, the events which are falling in a certain period of time (gap) are considered as a session window. A session window closes when it does not receive events for the gap. For dynamic gap, the gap could be changed from event to event.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org