You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2016/08/26 05:49:21 UTC
[jira] [Resolved] (BEAM-253) Unify Flink Operator Wrappers
[ https://issues.apache.org/jira/browse/BEAM-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aljoscha Krettek resolved BEAM-253.
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.3.0-incubating
Implemented here: https://github.com/apache/incubator-beam/commit/1de76b7a5169a46ef9f14406e5a6e1284832f7f9
> Unify Flink Operator Wrappers
> -----------------------------
>
> Key: BEAM-253
> URL: https://issues.apache.org/jira/browse/BEAM-253
> Project: Beam
> Issue Type: Improvement
> Components: runner-flink
> Reporter: Aljoscha Krettek
> Assignee: Aljoscha Krettek
> Fix For: 0.3.0-incubating
>
>
> Right now, we have {{FlinkAbstractParDoWrapper}} with subclasses {{FlinkParDoBoundWrapper}} and {{FlinkParDoBoundMultiWrapper}} as well as {{FlinkGroupAlsoByWindowWrapper}}. They do essentially the same thing, but slightly differently. The first three are implemented as a {{FlatMapFunction}} while the latter is implemented as a {{StreamOperator}} (which is more low-level and gives access to state and timers and such).
> We should unify this into one wrapper. (With possibly a more concise name...)
> In the process of this we should also make sure that we always use a {{DoFnRunner}} via {{DoFnRunners.createDefault}}. This will help reduce bugs such as [BEAM-241].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)