You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by godfrey he <go...@gmail.com> on 2020/10/13 14:55:50 UTC

[DISCUSS] Support Multiple Input for Blink Planner

Hi devs,

I would like to start the discussion about supporting multiple input for
blink planner.

As FLIP-92[1] introduces multiple-input stream operator, we can merge the
operators connected by forward shuffle into multiple input operator. So
that the network shuffle can be changed to local function calls,
and significantly performance improvement can be achieved when there is
plenty of data to shuffle.

We have written a design document[2] to describe the details. Please feel
free to join the discussion and any feedback is welcome!
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-92%3A+Add+N-Ary+Stream+Operator+in+Flink
[2]
https://docs.google.com/document/d/1qKVohV12qn-bM51cBZ8Hcgp31ntwClxjoiNBUOqVHsI


Best,
Godfrey & Caizhi