You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by koertkuipers <gi...@git.apache.org> on 2018/08/20 14:33:02 UTC

[GitHub] spark issue #21345: [SPARK-24159] [SS] Enable no-data micro batches for stre...

Github user koertkuipers commented on the issue:

    https://github.com/apache/spark/pull/21345
  
    we are testing spark 2.4 internally and had some unit tests break because of this change i believe.
    
    i am not suggesting this should be changed or undone, just wanted to point out that it might have minor implications for people upgrading. so this is just an FYI.
    
    it seems that our unit tests for logic that uses flatMapGroupsWithState with GroupStateTimeout.ProcessingTimeTimeout now will hang if query.processAllAvailable() is called. so i am looking for an alternative way to test now that does not involve usage of processAllAvailable.



---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org