You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Zhipeng Zhang (Jira)" <ji...@apache.org> on 2023/02/22 02:32:00 UTC

[jira] [Created] (FLINK-31173) TailOperator should only have one input

Zhipeng Zhang created FLINK-31173:
-------------------------------------

             Summary: TailOperator should only have one input
                 Key: FLINK-31173
                 URL: https://issues.apache.org/jira/browse/FLINK-31173
             Project: Flink
          Issue Type: Bug
          Components: Library / Machine Learning
    Affects Versions: ml-2.1.0, ml-2.0.0, ml-2.2.0
            Reporter: Zhipeng Zhang


In flink-ml-iteration, we have added a Tail operator to increment the epoch watermark at each iteration. We have made an assumption that each Tail operator have only one input and did not align the epoch watermarks from different inputs. This assumption might not be true if the input is an `union`.

 

I propose to add an explicit check to prevent from having multiple input for the TailOperator. If a the input does contain multiple inputs, then users can add a map operator after union.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)