[jira] [Comment Edited] (FLINK-4271) There is no way to set parallelism of operators produced by CoGroupedStreams

["Jark Wu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397004#comment-15397004 ] 

Jark Wu edited comment on FLINK-4271 at 7/28/16 6:17 AM:
---------------------------------------------------------

The CoGroupStream will construct the following graph. 

{code}
source -> MAP ---
                            |->  WindowOp -> Sink
source -> MAP ---
{code}

By now , the MAP and WindowOp can not set parallelism.  We can keep the MAP has same parallelism as previous operator. And we can change {{CoGroupedStreams.apply}} to return a  {{SingleOutputStreamOperator}} instead of {{DataStream}}, so that we can change WindowOp's parallelism.  The same thing should be done to {{JoinedStream}}.


was (Author: jark):
The CoGroupStream will construct the following graph. 

{code}
source -> MAP ---
                            |->  WindowOp -> Sink
source -> MAP ---
{code}

By now , the MAP and WindowOp can not set parallelism.  We can keep the MAP has same parallelism as previous operator. And we can change {{WindowedStream.apply}} to return a  {{SingleOutputStreamOperator}} instead of {{DataStream}}, so that we can change WindowOp's parallelism.

> There is no way to set parallelism of operators produced by CoGroupedStreams
> ----------------------------------------------------------------------------
>
>                 Key: FLINK-4271
>                 URL: https://issues.apache.org/jira/browse/FLINK-4271
>             Project: Flink
>          Issue Type: Bug
>          Components: DataStream API
>            Reporter: Wenlong Lyu
>            Assignee: Jark Wu
>
> Currently, CoGroupStreams package the map/keyBy/window operators with a human friendly interface, like: dataStreamA.cogroup(streamB).where(...).equalsTo().window().apply(), both the intermediate operators and final window operators can not be accessed by users, and we cannot set attributes of the operators, which make co-group hard to use in production environment.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)