[GitHub] [spark] aokolnychyi commented on a change in pull request #35374: [SPARK-34183][SS] DataSource V2: Required distribution and ordering in micro-batch execution

[GitBox <gi...@apache.org>]

aokolnychyi commented on a change in pull request #35374:
URL: https://github.com/apache/spark/pull/35374#discussion_r801017841



##########
File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/write/RequiresDistributionAndOrdering.java
##########
@@ -35,6 +35,11 @@
    * Spark will distribute incoming records across partitions to satisfy the required distribution
    * before passing the records to the data source table on write.
    * <p>
+   * Batch and micro-batch writes can request a particular data distribution.

Review comment:
       I agree. Let me see what can be done to add validation to continuous execution.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org