You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@calcite.apache.org by "Rui Wang (Jira)" <ji...@apache.org> on 2019/11/17 20:57:00 UTC

[jira] [Updated] (CALCITE-3509) Watermark Propagation

     [ https://issues.apache.org/jira/browse/CALCITE-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rui Wang updated CALCITE-3509:
------------------------------
    Description: 
To have a useful enumerable implementation for streaming windowing semantic in Calcite,  and also make Emit syntax useful, we will need to introduce watermark into Calcite. More specifically, the following should be discussed:

1. How is watermark generated? What changes are required on source/table scan?
2. How does watermark propagate through the whole plan? How are watermarks from multiple inputs aggregated together?  
3. Where watermark is used to control the time to emit data? 
4. How are event timestamp combined per key (typical in aggregation/join).

  was:
To have a useful enumerable implementation for streaming windowing semantic in Calcite,  and also make Emit syntax useful, we will need to introduce watermark into Calcite. More specifically, the following should be discussed:

1. How is watermark generated? What changes are required on source/table scan?
2. How does watermark propagate through the whole plan?
3. Where watermark is used to control the time to emit data?  


> Watermark Propagation 
> ----------------------
>
>                 Key: CALCITE-3509
>                 URL: https://issues.apache.org/jira/browse/CALCITE-3509
>             Project: Calcite
>          Issue Type: Sub-task
>            Reporter: Rui Wang
>            Priority: Major
>
> To have a useful enumerable implementation for streaming windowing semantic in Calcite,  and also make Emit syntax useful, we will need to introduce watermark into Calcite. More specifically, the following should be discussed:
> 1. How is watermark generated? What changes are required on source/table scan?
> 2. How does watermark propagate through the whole plan? How are watermarks from multiple inputs aggregated together?  
> 3. Where watermark is used to control the time to emit data? 
> 4. How are event timestamp combined per key (typical in aggregation/join).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)