chained operator with different parallelism question

[makeyang <ri...@hotmail.com>]

someStream.filter(...).map(...).map(...);
there operators are supposed to chained.
but what if there are set different parallelism like below:
someStream.filter(...).setParallelism(X).map(...).setParallelism(Y).map(...).setParallelism(Z);
X != Y != Z
what will happen?



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: chained operator with different parallelism question

[Fabian Hueske <fh...@gmail.com>]

Functions with different parallelism cannot be chained.
Chaining means that Functions are fused into a single operator and that
records are passed by method calls (instead of serializing them into an
in-memory or network channel).
Hence, chaining does not work if you have different parallelism.

Best, Fabian

2018-05-18 13:42 GMT+02:00 makeyang <ri...@hotmail.com>:

> someStream.filter(...).map(...).map(...);
> there operators are supposed to chained.
> but what if there are set different parallelism like below:
> someStream.filter(...).setParallelism(X).map(...).
> setParallelism(Y).map(...).setParallelism(Z);
> X != Y != Z
> what will happen?
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.
> n4.nabble.com/
>