You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Zachary Houfek (Jira)" <ji...@apache.org> on 2021/10/18 19:44:00 UTC

[jira] [Created] (BEAM-13078) Python DirectRunner does not emit data at GC time

Zachary Houfek created BEAM-13078:
-------------------------------------

             Summary: Python DirectRunner does not emit data at GC time
                 Key: BEAM-13078
                 URL: https://issues.apache.org/jira/browse/BEAM-13078
             Project: Beam
          Issue Type: Bug
          Components: sdk-py-core
            Reporter: Zachary Houfek


The following should succeed but does not:
{code:java}
test_options = PipelineOptions(flags=['--allow_unsafe_triggers'])
 with TestPipeline(options=test_options) as pipeline:
  pcoll = (
    pipeline
    | beam.Create([(1, 1), (1, 2), (1, 3), (1, 4)])
    | WindowInto(
      window.GlobalWindows(),
      trigger=trigger.AfterCount(5),
      accumulation_mode=trigger.AccumulationMode.ACCUMULATING)
    | beam.GroupByKey())
  assert_that(pcoll, equal_to([(1, [1, 2, 3, 4])])){code}
However, it  currently fails, because  pcoll will be empty. It appears that the Direct Runner drops data if the trigger never fired.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)