You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@calcite.apache.org by "Rui Wang (Jira)" <ji...@apache.org> on 2020/08/04 03:02:00 UTC

[jira] [Updated] (CALCITE-4153) Implement EMIT AFTER WATERMARK

     [ https://issues.apache.org/jira/browse/CALCITE-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rui Wang updated CALCITE-4153:
------------------------------
    Description: 
The goal is to support the following syntax:

{code:sql}
SELECT clause
FROM TUMBLE/HOP/SESSION
EMIT AFTER WATERMARK
{code}

note that "EMIT AFTER WATERMARK" is the new thing.

"EMIT AFTER WATERMARK" is proposed in [One SQL to Rule Them All|https://arxiv.org/pdf/1905.12133.pdf]. This idea proposes a way to allow streaming SQL queries control materialization latency. More specifically, it means emit elements in a window once the watermark passes the end of that window.


There are more context discussed in [CALCITE-3272|https://issues.apache.org/jira/browse/CALCITE-3272?focusedCommentId=17166580&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17166580] and the [EMIT syntax proposal for event-timestamp semantic windowing|https://lists.apache.org/thread.html/r5bd9a6f7af2c0cd81aecd4de512fd889fbf15f112cc3704f188b1d4f%40%3Cdev.calcite.apache.org%3E] email thread.

> Implement EMIT AFTER WATERMARK
> ------------------------------
>
>                 Key: CALCITE-4153
>                 URL: https://issues.apache.org/jira/browse/CALCITE-4153
>             Project: Calcite
>          Issue Type: Sub-task
>            Reporter: Rui Wang
>            Assignee: Rui Wang
>            Priority: Major
>
> The goal is to support the following syntax:
> {code:sql}
> SELECT clause
> FROM TUMBLE/HOP/SESSION
> EMIT AFTER WATERMARK
> {code}
> note that "EMIT AFTER WATERMARK" is the new thing.
> "EMIT AFTER WATERMARK" is proposed in [One SQL to Rule Them All|https://arxiv.org/pdf/1905.12133.pdf]. This idea proposes a way to allow streaming SQL queries control materialization latency. More specifically, it means emit elements in a window once the watermark passes the end of that window.
> There are more context discussed in [CALCITE-3272|https://issues.apache.org/jira/browse/CALCITE-3272?focusedCommentId=17166580&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17166580] and the [EMIT syntax proposal for event-timestamp semantic windowing|https://lists.apache.org/thread.html/r5bd9a6f7af2c0cd81aecd4de512fd889fbf15f112cc3704f188b1d4f%40%3Cdev.calcite.apache.org%3E] email thread.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)