[jira] [Created] (BEAM-11252) Writing to BigQuery raises a TypeError

["Tudor Plugaru (Jira)" <ji...@apache.org>]

Tudor Plugaru created BEAM-11252:
------------------------------------

             Summary: Writing to BigQuery raises a TypeError
                 Key: BEAM-11252
                 URL: https://issues.apache.org/jira/browse/BEAM-11252
             Project: Beam
          Issue Type: Bug
          Components: beam-model
    Affects Versions: 2.25.0, 2.24.0
            Reporter: Tudor Plugaru


I have a pipeline that reads from a PubSub topic, does some transforms and then writes to BigQuery. The exception message is this: {{Cannot convert GlobalWindow to apache_beam.utils.windowed_value._IntervalWindowBase}}

You can find the main part of the pipeline here [https://gist.github.com/PlugaruT/4666406bd8792b7b196dc1519c8885a2]

The first part is basically reading from Pub/Sub and then I apply this PTranform.

And here is the gigantic stack trace: [https://gist.github.com/PlugaruT/52bf3834eec95fd5cc5779d3332e1433]

 

I've tried to downgrade to 2.24.0 version but this is still happening.

Also, I can't reproduce the exception locally when I run the pipeline with DirectRunner. It's happening only when running on Dataflow.

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)