You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/01/18 05:53:54 UTC

[GitHub] [hudi] xushiyan commented on issue #4082: [SUPPORT] How to write multiple HUDi tables simultaneously in a Spark Streaming task?

xushiyan commented on issue #4082:
URL: https://github.com/apache/hudi/issues/4082#issuecomment-1015092759


   > @xuranyang : are you referring to MultiTableDeltastreamer. I don't think we have any such functionality for now to stream from multiple and write to diff hudi tables. Had to be done manually at the application layer by the user. If you can build some simple framework to get this, please consider upstreaming the functionality to benefit others in the community. thanks!
   
   +1. @xuranyang You can do this with MultiTableDeltaStreamer or using other orchestration tools like kubernetes for example to manage large number of streaming jobs. If you have ideas, feel free to start an RFC or contribute to hudi codebase.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org