You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Márton Balassi (JIRA)" <ji...@apache.org> on 2015/01/21 19:00:44 UTC
[jira] [Resolved] (FLINK-1345) Add operator chaining to the
streaming runtime
[ https://issues.apache.org/jira/browse/FLINK-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Márton Balassi resolved FLINK-1345.
-----------------------------------
Resolution: Implemented
Implemented via 26535c4...7dbb55e.
> Add operator chaining to the streaming runtime
> -----------------------------------------------
>
> Key: FLINK-1345
> URL: https://issues.apache.org/jira/browse/FLINK-1345
> Project: Flink
> Issue Type: Improvement
> Components: Streaming
> Reporter: Gyula Fora
> Assignee: Gyula Fora
> Priority: Minor
>
> Operator chaining should be added as a runtime optimisation to the streaming system as well.
> A straightforward way to implement this is to add a new ChainableStreamInvokable class which also implements the collector interface. Operators like map, filter ... should extend this class.
> After this the jobgraphbuilder should analyze the invokables to determine if chaining should be used: check if the invokable is a ChainableInvokable and all connections are forward with the same parallelism.
> The chained invokables should then be passed as collectors to the previous ones as in the batch runtime.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)