You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/03/19 01:34:34 UTC

[GitHub] [incubator-seatunnel] ruanwenjun commented on pull request #1509: [Bug][Spark] When have empty data source, transform not execute

ruanwenjun commented on pull request #1509:
URL: https://github.com/apache/incubator-seatunnel/pull/1509#issuecomment-1072913823


   > @ruanwenjun
   > 
   > > For example, in the below picture, if we have 3 sources, 2 two transforms, 2 sinks. In the current code, there only source1 will be transformed and sinked.
   > 
   > At now, 3 sources, 2 two transforms, 2 sinks both will execute. The problem is if first source no data, then all transforms will not execute. (If first source' data isn't empty, all plugin will execute)
   > 
   > > I know what you want to fix in this PR, but I want to discuss this problem, otherwise we may still need to repair this again.
   > 
   > We can use multiple source, transform, sink. Because one source/transform will registe as table. So user can join multiple source or transform. Also can do complex data process.
   
   Okay, I just misunderstand something. The source and transform data will be registered as a table.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org