[jira] [Created] (BEAM-14100) Dataflow interactive runner throws exception when there is BigQuery I/O in the pipeline

["Ning (Jira)" <ji...@apache.org>]

Ning created BEAM-14100:
---------------------------

             Summary: Dataflow interactive runner throws exception when there is BigQuery I/O in the pipeline
                 Key: BEAM-14100
                 URL: https://issues.apache.org/jira/browse/BEAM-14100
             Project: Beam
          Issue Type: Bug
          Components: runner-py-interactive
    Affects Versions: 2.37.0, 2.36.0, 2.35.0
            Reporter: Ning
            Assignee: Ning


{code:java}
~/apache-beam-2.37.0/lib/python3.7/site-packages/apache_beam/coders/coders.py in <lambda>(x)
    800     protocol = pickle.HIGHEST_PROTOCOL
    801     return coder_impl.CallbackCoderImpl(
--> 802         lambda x: dumps(x, protocol), pickle.loads)
    803 
    804   def as_deterministic_coder(self, step_label, error_message=None):

TypeError: can't pickle generator objects [while running '[1]: ReadFromBigQuery/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSizeRestriction'] {code}
Issue occurred since 2.35.0, culprit changes that went in 2.35.0 for [coder_impl.py|https://github.com/apache/beam/commits/master/sdks/python/apache_beam/coders/coder_impl.py] are:

!image-2022-03-14-13-33-17-715.png!

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)