You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Ben Sidhom (JIRA)" <ji...@apache.org> on 2018/04/13 19:07:00 UTC

[jira] [Commented] (BEAM-2898) Flink supports chaining/fusion of single-SDK stages

    [ https://issues.apache.org/jira/browse/BEAM-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16437763#comment-16437763 ] 

Ben Sidhom commented on BEAM-2898:
----------------------------------

Pipeline fusion has been implemented in runner-core. With support for impulse, the Flink runner will support pipeline fusion once translation by proto has been implemented.

> Flink supports chaining/fusion of single-SDK stages
> ---------------------------------------------------
>
>                 Key: BEAM-2898
>                 URL: https://issues.apache.org/jira/browse/BEAM-2898
>             Project: Beam
>          Issue Type: Sub-task
>          Components: runner-flink
>            Reporter: Henning Rohde
>            Assignee: Ben Sidhom
>            Priority: Major
>              Labels: portability
>          Time Spent: 4h 50m
>  Remaining Estimate: 0h
>
> The Fn API supports fused stages, which avoids unnecessarily round-tripping the data over the Fn API between stages. The Flink runner should use that capability for better performance.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)