You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/03/04 13:09:02 UTC

[GitHub] [spark] cloud-fan commented on pull request #31700: [SPARK-34183][SS] DataSource V2: Support required distribution and ordering in SS

cloud-fan commented on pull request #31700:
URL: https://github.com/apache/spark/pull/31700#issuecomment-790605892


   Micro-batch is an implementation detail and shouldn't be used to define the semantic.
   
   If a streaming sink has a distribution requirement, I can understand it and the data should be properly partitioned before entering the streaming sink. However, if a streaming sink has an ordering requirement, I can't imagine how a data stream can satisfy an ordering requirement.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org