[jira] [Commented] (BEAM-11252) Writing to BigQuery raises a TypeError "GlobalWindow -> ._IntervalWindowBase"

["Tudor Plugaru (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317978#comment-17317978 ] 

Tudor Plugaru commented on BEAM-11252:
--------------------------------------

[~kenn], this would be nice to fix as from my understanding, you can't really use the "Dead letter pattern" for BigQuery sink because of this bug. Let me know if there is something I can help with.

> Writing to BigQuery raises a TypeError "GlobalWindow -> ._IntervalWindowBase"
> -----------------------------------------------------------------------------
>
>                 Key: BEAM-11252
>                 URL: https://issues.apache.org/jira/browse/BEAM-11252
>             Project: Beam
>          Issue Type: Bug
>          Components: io-py-gcp
>    Affects Versions: 2.24.0, 2.25.0, 2.26.0, 2.27.0, 2.28.0
>            Reporter: Tudor Plugaru
>            Priority: P2
>              Labels: bigquery
>
> I have a pipeline that reads from a PubSub topic, does some transforms and then writes to BigQuery. The exception message is this: {{Cannot convert GlobalWindow to apache_beam.utils.windowed_value._IntervalWindowBase}}
> You can find the main part of the pipeline here [https://gist.github.com/PlugaruT/4666406bd8792b7b196dc1519c8885a2]
> The first part is basically reading from Pub/Sub and then I apply this PTranform.
> And here is the gigantic stack trace: [https://gist.github.com/PlugaruT/52bf3834eec95fd5cc5779d3332e1433]
>  
> I've tried to downgrade to 2.24.0 version but this is still happening.
> Also, I can't reproduce the exception locally when I run the pipeline with DirectRunner. It's happening only when running on Dataflow.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)