You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2016/08/26 05:49:21 UTC

[jira] [Resolved] (BEAM-253) Unify Flink Operator Wrappers

     [ https://issues.apache.org/jira/browse/BEAM-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aljoscha Krettek resolved BEAM-253.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: 0.3.0-incubating

Implemented here: https://github.com/apache/incubator-beam/commit/1de76b7a5169a46ef9f14406e5a6e1284832f7f9

> Unify Flink Operator Wrappers
> -----------------------------
>
>                 Key: BEAM-253
>                 URL: https://issues.apache.org/jira/browse/BEAM-253
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Aljoscha Krettek
>            Assignee: Aljoscha Krettek
>             Fix For: 0.3.0-incubating
>
>
> Right now, we have {{FlinkAbstractParDoWrapper}} with subclasses {{FlinkParDoBoundWrapper}} and {{FlinkParDoBoundMultiWrapper}} as well as {{FlinkGroupAlsoByWindowWrapper}}. They do essentially the same thing, but slightly differently. The first three are implemented as a {{FlatMapFunction}} while the latter is implemented as a {{StreamOperator}} (which is more low-level and gives access to state and timers and such).
> We should unify this into one wrapper. (With possibly a more concise name...)
> In the process of this we should also make sure that we always use a {{DoFnRunner}} via {{DoFnRunners.createDefault}}. This will help reduce bugs such as [BEAM-241].



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)