Re: [PR] [SPARK-46124][FOLLOWUP][CONNECT][SS] Send missing fields in StreamingQueryProgress to client [spark]

["WweiL (via GitHub)" <gi...@apache.org>]

WweiL commented on code in PR #46886:
URL: https://github.com/apache/spark/pull/46886#discussion_r1628549021


##########
python/pyspark/sql/tests/streaming/test_streaming.py:
##########
@@ -28,7 +28,7 @@
 
 class StreamingTestsMixin:
     def test_streaming_query_functions_basic(self):
-        df = self.spark.readStream.format("rate").option("rowsPerSecond", 10).load()
+        df = self.spark.readStream.format("text").load("python/test_support/sql/streaming")

Review Comment:
   this is just a minor fix it will make the test more stable. We call `query.processAllAvailable` below, which has a very small chance of being a indefinite blocking call on rate source.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org