You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/07/28 10:08:42 UTC

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #2274: [ST-Engine][Checkpoint] The design of Checkpoint

Hisoka-X commented on issue #2274:
URL: https://github.com/apache/incubator-seatunnel/issues/2274#issuecomment-1197940156

   > @EricJoy2048 Now how do we deal with the union of multiple upstream operators? That's the same thing as the following <img alt="image" width="343" src="https://user-images.githubusercontent.com/36807946/181452486-e150e98c-7af7-425c-8afd-e53752677c99.png"> Users need `union (all)` post-processing, and we cannot separate them
   
   We should create a special transform `union`. It can union all upstream data. Then `union` will have parallelism parameter, take this picture as an example, if parallelism = 8 (4+4), just send data to next action, if parallelism != 8, we should use queue( like Partition Transform) to change parallelism.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org