You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/06/30 06:59:47 UTC

[GitHub] [spark] HeartSaVioR commented on pull request #37026: [SPARK-39632][SQL][Tests] Add state utils to StreamTest to check states during streaming queries

HeartSaVioR commented on PR #37026:
URL: https://github.com/apache/spark/pull/37026#issuecomment-1170842397

   Hello, I see it's more likely ease of tests for flatMapGroupsWithState. We added the utility class in Spark 3.2.0 which allows end users to test the user function of flatMapGroupsWithState with test-purpose GroupState implementation. With this approach, end users don't even need to run the streaming query - they just need to call their user function with the TestGroupState.
   https://spark.apache.org/docs/latest/api/scala/org/apache/spark/sql/streaming/TestGroupState.html
   
   Could you please check whether this utility class fulfills your requirement? Thanks in advance.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org