[jira] [Commented] (FLINK-2489) Improve the streaming window join

["Stephan Ewen (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-2489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14658779#comment-14658779 ] 

Stephan Ewen commented on FLINK-2489:
-------------------------------------

Here is a wiki page stub for further discussion: https://cwiki.apache.org/confluence/display/FLINK/Streaming+Window+Join+Rework

> Improve the streaming window join
> ---------------------------------
>
>                 Key: FLINK-2489
>                 URL: https://issues.apache.org/jira/browse/FLINK-2489
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>    Affects Versions: 0.10
>            Reporter: Stephan Ewen
>
> This issue tracks the ideas and discussion to improve the current window join.
> Here is an initial list of desiderata for an improved window join:
>   - Joins should initially run only on time windows
>   - Support for operator time and event time
>   - Event time version must support multiple windows being in progress (or buffered) while waiting for watermarks
>   - Support for simple Java heap and Flink-managed memory
>   - Flink-managed memory variant should support out-of-core operation
>   - Join buffers or hashtables need to be checkpointed.
>   - Join buffers or hashtables need to support incremental checkpointing
>   - Join buffers or hashtables should support asynchronous checkpointing
>   - For sliding time windows, we should consider variants to reuse the join candidates across multiple windows they are contained in.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)