You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Ismaël Mejía (JIRA)" <ji...@apache.org> on 2017/06/05 14:28:04 UTC
[jira] [Created] (BEAM-2409) Spark runner produces exactly twice
the number of results in streaming mode when use triggers to re-window
results on global window.
Ismaël Mejía created BEAM-2409:
----------------------------------
Summary: Spark runner produces exactly twice the number of results in streaming mode when use triggers to re-window results on global window.
Key: BEAM-2409
URL: https://issues.apache.org/jira/browse/BEAM-2409
Project: Beam
Issue Type: Bug
Components: runner-spark
Affects Versions: 2.0.0
Reporter: Ismaël Mejía
Assignee: Aviem Zur
This can be tested with Nexmark query 6. Sorry I don’t have a smaller test case than this, but I think the part of the pipeline that produces the result is this one.
{code:java}
.apply(
Window.<KV<Long, Bid>>into(new GlobalWindows())
.triggering(Repeatedly.forever(AfterPane.elementCountAtLeast(1)))
.accumulatingFiredPanes()
.withAllowedLateness(Duration.ZERO))
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)