You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dong Lin (Jira)" <ji...@apache.org> on 2023/04/20 08:41:00 UTC

[jira] [Commented] (FLINK-31173) Fix several bugs in flink-ml-iteration module

    [ https://issues.apache.org/jira/browse/FLINK-31173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714490#comment-17714490 ] 

Dong Lin commented on FLINK-31173:
----------------------------------

Merged to apache/flink-ml master branch:
- 92ecb0e591f30ff7dc4bd4db027350ad4edf4000
- 0c852da7a1b87bc632e21a19148dbb8d19a8bd30

> Fix several bugs in flink-ml-iteration module
> ---------------------------------------------
>
>                 Key: FLINK-31173
>                 URL: https://issues.apache.org/jira/browse/FLINK-31173
>             Project: Flink
>          Issue Type: Bug
>          Components: Library / Machine Learning
>    Affects Versions: ml-2.0.0, ml-2.1.0, ml-2.2.0
>            Reporter: Zhipeng Zhang
>            Assignee: Zhipeng Zhang
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: ml-2.3.0
>
>
> In flink-ml-iteration, there are several bugs as follows:
>  # TailOperator should have one input operator. We have added a Tail operator to increment the epoch watermark at each iteration. We have made an assumption that each Tail operator have only one input and did not align the epoch watermarks from different inputs. This assumption might not be true if the input is an `union`.
>  # ReplayOperator should replay the records when it receives max epochwatermark. Currently ReplayOperator does not replay the records when it receives the max epochwatermark. However, it is inconsistent with the HeadOperator. As HeadOperator will always forward the record to downstreams.  
>  # ProxyOperatorStateBackend does not correctly initialize the state descriptor.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)