[jira] [Created] (FLINK-23959) FLIP-175: Add GraphBuilder to compose Estimator/Transformer/AlgoOperator from a DAG of stages

["Dong Lin (Jira)" <ji...@apache.org>]

Dong Lin created FLINK-23959:
--------------------------------

             Summary: FLIP-175: Add GraphBuilder to compose Estimator/Transformer/AlgoOperator from a DAG of stages
                 Key: FLINK-23959
                 URL: https://issues.apache.org/jira/browse/FLINK-23959
             Project: Flink
          Issue Type: Improvement
            Reporter: Dong Lin


The existing Flink ML library allows users to compose an Estimator/Transformer from a pipeline (i.e. linear sequence) of Estimator/Transformer. Users only need to construct this Pipeline once and generate the corresponding PipelineModel, without having to explicitly construct the fitted PipelineModel as a linear sequence of stages.

However, in the use-case that needs a DAG of Estimator/Transformer, users currently needs to separately build the DAG separately, once for the training logic and once for the inference logic. This experience is inferior to the cases supported by the Pipeline.

To improve the user experience, we propose to add several helper classes that allow users to compose Estimator/Transformer/AlgoOperator from a DAG of Estimator/Transformer/AlgoOperator.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)