[GitHub] [beam] damccorm opened a new issue, #17883: Pickling error when pickling a nested function

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #17883:
URL: https://github.com/apache/beam/issues/17883

   There is a pickling error under the following conditions all happen:
   - a function is defined inside a transforms' apply method
   - then using it as MapFn
   - that function references an instance variable of the outer transform.
   
   Rewriting the nested function as an unnested DoFn appears to solve the problem.
   
   If the limitations of pickling make it difficult to support nested functions then perhaps there's a way to make it easier for users to detect problems caused by nested functions and recommend appropriate fixes
   
   Imported from Jira [BEAM-527](https://issues.apache.org/jira/browse/BEAM-527). Original Jira may contain additional context.
   Reported by: altay.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] damccorm closed issue #17883: Pickling error when pickling a nested function

[GitBox <gi...@apache.org>]

damccorm closed issue #17883: Pickling error when pickling a nested function 
URL: https://github.com/apache/beam/issues/17883


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org