[jira] [Updated] (BEAM-10784) Spark portable streaming: failing window-related tests

["Anonymous (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Anonymous updated BEAM-10784:
-----------------------------
    Status: Triage Needed  (was: Open)

> Spark portable streaming: failing window-related tests 
> -------------------------------------------------------
>
>                 Key: BEAM-10784
>                 URL: https://issues.apache.org/jira/browse/BEAM-10784
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-spark
>            Reporter: Anna Qin
>            Priority: P3
>              Labels: portability-spark
>
> When running validatesPortableRunnerStreaming on Spark, the following tests fail. They all seem to be related to windowing. The underlying issue may have to do with incorrect handling of watermarks (they may not be getting held back properly). 
> Fails from timeout:
> PAssertTest. testWindowedContainsInAnyOrder
> PAssertTest. testWindowedSerializablePredicate
> WindowTest. testNoWindowFnDoesNotReassignWindows
> Fails from incorrect assertion:
> CombineTest$BasicTests. testHotKeyCombining
> Fails from empty assertion ("Expected: iterable with items [*] in any order
>      but: no item matches: * in []"): 
> CombineTest$WindowingTests. testFixedWindowsCombine
> CombineTest$WindowingTests. testSessionsCombine
> ReshuffleTest. testReshuffleAfterFixedWindowsAndGroupByKey
> ReshuffleTest. testReshuffleAfterSessionsAndGroupByKey
> ReshuffleTest. testReshuffleAfterSlidingWindowsAndGroupByKey
> CoGroupByKeyTest. testCoGroupByKeyWithWindowing
> WindowingTest. testMergingWindowing
> WindowingTest. testNonPartitioningWindowing
> WindowingTest. testPartitioningWindowing
> WindowingTest. testWindowPreservation



--
This message was sent by Atlassian Jira
(v8.20.10#820010)