[jira] [Updated] (BEAM-3152) AfterProcessingTime trigger doesn't create any file panes

["Beam JIRA Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Beam JIRA Bot updated BEAM-3152:
--------------------------------
    Priority: P3  (was: P2)

> AfterProcessingTime trigger doesn't create any file panes
> ---------------------------------------------------------
>
>                 Key: BEAM-3152
>                 URL: https://issues.apache.org/jira/browse/BEAM-3152
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>    Affects Versions: 2.0.0
>            Reporter: Pawel Bartoszek
>            Priority: P3
>              Labels: stale-P2
>
> Scenario:
> I want to count how many events A and B I am getting for given 30 window. I require that every pane has all events types (A and B) with corresponding counters - this is why I am using Combine.globally.
> The calculation logic works fine the problem is with writing files. The files are not written.
> For debugging purposes I created some transformations (Simulate ApplyShardLabel, Simulate GroupIntoShards etc) that mimics that logic implemented by WriteFiles.
> If you push string "A" and "B" to kinesis stream I am seeing the following system.out from the job:
> {code:java}
> AFTER COMBINE: {A=1, B=1}
> {code}
> According to my test transformations I should also see:
> {code:java}
> AFTER COMBINE: {A=1, B=1}
> Simulating ApplyShardLabel
> Simulating finalizing writer: KV{null, [KV{0, [{A=1, B=1}]}]}
> {code}
> Using DirectRunner and Beam 2.0.0. When I switch to Beam 2.1.0 I see the expected debug output and files being written out.
> I think that there is some issue with AfterSynchronizedProcessingTime trigger support.
> I cannot replicate the issue when using `TestStream`
> The test code can be found at
> [https://gist.github.com/pbartoszek/9dd58c4fcfc5171eafba3520cb3040fa|https://gist.github.com/pbartoszek/9dd58c4fcfc5171eafba3520cb3040fa]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)