[jira] [Created] (FLINK-5089) Introduce Loop functions and Enforce Nesting on Data Streams

["Paris Carbone (JIRA)" <ji...@apache.org>]

Paris Carbone created FLINK-5089:
------------------------------------

             Summary: Introduce Loop functions and Enforce Nesting on Data Streams
                 Key: FLINK-5089
                 URL: https://issues.apache.org/jira/browse/FLINK-5089
             Project: Flink
          Issue Type: Improvement
          Components: DataStream API
            Reporter: Paris Carbone
            Assignee: Paris Carbone


The current programming model of stream iterations in the DataStream API is exposed through low-level dataflow operations for placing arbitrary feedback-edges. This strategy does not enforce proper nesting and requires user-defined timeouts to enforce termination. It further impacts correctness, resulting to incomplete processing or/and inconsistent state when iterations exist in the topology. There is a need for a new functional, yet compositional API (i.e. nested loops) for expressing asynchronous DataStream loops to be able to build easily decentralized progress establishment algorithms such as distributed termination and parallel structured or fixpoint iterations.

This Jira explains parts of the needs addressed by FLIP-15 on Loops and Terminations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)