You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Flink Jira Bot (Jira)" <ji...@apache.org> on 2022/01/05 22:39:00 UTC

[jira] [Updated] (FLINK-5888) ForwardedFields annotation is not generating optimised execution plan in example KMeans job

     [ https://issues.apache.org/jira/browse/FLINK-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Flink Jira Bot updated FLINK-5888:
----------------------------------
      Labels: auto-deprioritized-major auto-deprioritized-minor  (was: auto-deprioritized-major stale-minor)
    Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion.


> ForwardedFields annotation is not generating optimised execution plan in example KMeans job
> -------------------------------------------------------------------------------------------
>
>                 Key: FLINK-5888
>                 URL: https://issues.apache.org/jira/browse/FLINK-5888
>             Project: Flink
>          Issue Type: Bug
>          Components: API / DataSet, Examples
>    Affects Versions: 1.1.3
>            Reporter: Ziyad Muhammed Mohiyudheen
>            Priority: Not a Priority
>              Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> Flink KMeans java example [1] shows the usage of ForwardedFields function annotation. How ever, the example job was taking more time than expected on medium sized data itself. By merely removing the function annotation from the example code (with out any other change), a better execution plan and run time was obtained. The execution plan shows that no combiner is used and the two Map tasks are not chained when ForwardedFields is enabled. The experiment is documented in [2]
> [1] https://github.com/apache/flink/blob/master/flink-examples/flink-examples-batch/src/main/java/org/apache/flink/examples/java/clustering/KMeans.java
> [2] https://drive.google.com/open?id=0B0IlZv0uHBuvVEZ5ZmNpN19jVVU



--
This message was sent by Atlassian Jira
(v8.20.1#820001)