You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Zachary Houfek (Jira)" <ji...@apache.org> on 2021/10/18 19:44:00 UTC
[jira] [Created] (BEAM-13078) Python DirectRunner does not emit
data at GC time
Zachary Houfek created BEAM-13078:
-------------------------------------
Summary: Python DirectRunner does not emit data at GC time
Key: BEAM-13078
URL: https://issues.apache.org/jira/browse/BEAM-13078
Project: Beam
Issue Type: Bug
Components: sdk-py-core
Reporter: Zachary Houfek
The following should succeed but does not:
{code:java}
test_options = PipelineOptions(flags=['--allow_unsafe_triggers'])
with TestPipeline(options=test_options) as pipeline:
pcoll = (
pipeline
| beam.Create([(1, 1), (1, 2), (1, 3), (1, 4)])
| WindowInto(
window.GlobalWindows(),
trigger=trigger.AfterCount(5),
accumulation_mode=trigger.AccumulationMode.ACCUMULATING)
| beam.GroupByKey())
assert_that(pcoll, equal_to([(1, [1, 2, 3, 4])])){code}
However, it currently fails, because pcoll will be empty. It appears that the Direct Runner drops data if the trigger never fired.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)