You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ismaël Mejía (JIRA)" <ji...@apache.org> on 2019/05/22 08:53:00 UTC

[jira] [Assigned] (BEAM-2409) Spark runner produces exactly twice the number of results in streaming mode when use triggers to re-window results on global window.

     [ https://issues.apache.org/jira/browse/BEAM-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ismaël Mejía reassigned BEAM-2409:
----------------------------------

    Assignee:     (was: Amit Sela)

> Spark runner produces exactly twice the number of results in streaming mode when use triggers to re-window results on global window.
> ------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-2409
>                 URL: https://issues.apache.org/jira/browse/BEAM-2409
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-spark
>    Affects Versions: 2.0.0
>            Reporter: Ismaël Mejía
>            Priority: Major
>              Labels: triaged
>
> This can be tested with Nexmark query 6. Sorry I don’t have a smaller test case than this, but I think the part of the pipeline that produces the result is this one.
> {code:java}
>         .apply(
>             Window.<KV<Long, Bid>>into(new GlobalWindows())
>                 .triggering(Repeatedly.forever(AfterPane.elementCountAtLeast(1)))
>                 .accumulatingFiredPanes()
>                 .withAllowedLateness(Duration.ZERO))
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)