[GitHub] [beam] damccorm opened a new issue, #20429: Spark portable streaming: failing window-related tests

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #20429:
URL: https://github.com/apache/beam/issues/20429

   When running validatesPortableRunnerStreaming on Spark, the following tests fail. They all seem to be related to windowing. The underlying issue may have to do with incorrect handling of watermarks (they may not be getting held back properly). 
   
   Fails from timeout:
   PAssertTest. testWindowedContainsInAnyOrder
   PAssertTest. testWindowedSerializablePredicate
   WindowTest. testNoWindowFnDoesNotReassignWindows
   
   Fails from incorrect assertion:
   CombineTest$BasicTests. testHotKeyCombining
   
   Fails from empty assertion ("Expected: iterable with items [*] in any order
        but: no item matches: * in []"): 
   CombineTest$WindowingTests. testFixedWindowsCombine
   CombineTest$WindowingTests. testSessionsCombine
   ReshuffleTest. testReshuffleAfterFixedWindowsAndGroupByKey
   ReshuffleTest. testReshuffleAfterSessionsAndGroupByKey
   ReshuffleTest. testReshuffleAfterSlidingWindowsAndGroupByKey
   CoGroupByKeyTest. testCoGroupByKeyWithWindowing
   WindowingTest. testMergingWindowing
   WindowingTest. testNonPartitioningWindowing
   WindowingTest. testPartitioningWindowing
   WindowingTest. testWindowPreservation
   
   Imported from Jira [BEAM-10784](https://issues.apache.org/jira/browse/BEAM-10784). Original Jira may contain additional context.
   Reported by: annaqin.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org