You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jark Wu (JIRA)" <ji...@apache.org> on 2016/07/28 06:15:20 UTC
[jira] [Commented] (FLINK-4271) There is no way to set parallelism
of operators produced by CoGroupedStreams
[ https://issues.apache.org/jira/browse/FLINK-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397004#comment-15397004 ]
Jark Wu commented on FLINK-4271:
--------------------------------
The CoGroupStream will construct the following graph.
{code}
source -> MAP ---
|-> WindowOp -> Sink
source -> MAP ---
{code}
By now , the MAP and WindowOp can not set parallelism. We can keep the MAP has same parallelism as previous operator. And we can change {{WindowedStream.apply}} to return a {{SingleOutputStreamOperator}} instead of {{DataStream}}, so that we can change WindowOp's parallelism.
> There is no way to set parallelism of operators produced by CoGroupedStreams
> ----------------------------------------------------------------------------
>
> Key: FLINK-4271
> URL: https://issues.apache.org/jira/browse/FLINK-4271
> Project: Flink
> Issue Type: Bug
> Components: DataStream API
> Reporter: Wenlong Lyu
> Assignee: Jark Wu
>
> Currently, CoGroupStreams package the map/keyBy/window operators with a human friendly interface, like: dataStreamA.cogroup(streamB).where(...).equalsTo().window().apply(), both the intermediate operators and final window operators can not be accessed by users, and we cannot set attributes of the operators, which make co-group hard to use in production environment.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)