You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2022/03/17 17:56:00 UTC
[jira] [Updated] (BEAM-14023) Slowly updating global window side inputs example reads singleton side input with multiple elements per window
[ https://issues.apache.org/jira/browse/BEAM-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kenneth Knowles updated BEAM-14023:
-----------------------------------
Summary: Slowly updating global window side inputs example reads singleton side input with multiple elements per window (was: Slowly updating global window side inputs)
> Slowly updating global window side inputs example reads singleton side input with multiple elements per window
> --------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-14023
> URL: https://issues.apache.org/jira/browse/BEAM-14023
> Project: Beam
> Issue Type: Bug
> Components: examples-java, sdk-java-core
> Reporter: John Gerassimou
> Priority: P2
>
> The example "The Slowly updating global window side inputs" [1] produces an unexpected error. Our implementation follows the example but uses a 30-second duration. The error first occurred after 4000 triggers. The pipeline ran on Dataflow using Java 1.8 and Beam SDK 2.33.0.
>
> {code:java}
> Caused by: org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalArgumentException: PCollection with more than one element accessed as a singleton view. {code}
>
>
> Applying a combine function before applying the view singleton has no positive effect. Changing the refresh duration to 5 minutes alleviates or delays the error.
> +Relevant post:+
> * [https://lists.apache.org/thread/v005b7osqxv774wjpjhg103bqto4v7yh]
> * [https://lists.apache.org/thread/wfm77wkqrkwlrhgbnq9f3x8nyzsn51xm]
> * [https://github.com/spotify/scio/issues/1190]
> * [https://github.com/spotify/scio/issues/3521]
> Please let me know if you have any questions.
> {+}References{+}:
> [1] [https://beam.apache.org/documentation/patterns/side-inputs/]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)