[jira] [Commented] (SPARK-10816) EventTime based sessionization

["L. C. Hsieh (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284931#comment-17284931 ] 

L. C. Hsieh commented on SPARK-10816:
-------------------------------------

This feature is inactive in last two years. We have interests to revive this feature due to customer requirement. I realize there are existing two implementations and they looks solid. I read the design doc but not the code (the change is big).

I'd like to review both implementations and see if we can consolidate them. Currently I'm not sure if it works because from the design doc looks like they are different.

For now I tend to use Yuanjian's implementation (smaller change) as baseline and consolidate some ideas from Jungtaek's if possible.

Please note that our intention is facilitating this feature in Spark community for all users, instead of getting the credit implementing it. Either Jungtaek or Yuanjian want to pick this up sounds okay to me. So even we submit the consolidated PR, I'd like to have both authors as main authors.

Welcome for any suggestion.

cc [~dbtsai]

> EventTime based sessionization
> ------------------------------
>
>                 Key: SPARK-10816
>                 URL: https://issues.apache.org/jira/browse/SPARK-10816
>             Project: Spark
>          Issue Type: New Feature
>          Components: Structured Streaming
>            Reporter: Reynold Xin
>            Priority: Major
>         Attachments: SPARK-10816 Support session window natively.pdf, Session Window Support For Structure Streaming.pdf
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org