You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "shoyer (via GitHub)" <gi...@apache.org> on 2023/02/09 23:47:01 UTC

[GitHub] [beam] shoyer opened a new issue, #25413: [Feature Request]: eagerly evaluating pipeline starting with Create() in Python

shoyer opened a new issue, #25413:
URL: https://github.com/apache/beam/issues/25413

   ### What would you like to happen?
   
   For documentation and testing, I find it super convenient to be able to pass Python objects such as a list into a PTransform, which causes the PTransform to be evaluated eagerly, e.g.,
   ```
   >>> [1, 2, 3] | beam.Map(lambda x: x ** 2)
   [1, 4, 9]
   ```
   
   I would like to be able to do the same sort of thing for pipelines that start with `beam.Create()` rather than an existing PCollection.
   
   For example, maybe 
   
   ### Issue Priority
   
   Priority: 2 (default / most feature requests should be filed as P2)
   
   ### Issue Components
   
   - [X] Component: Python SDK
   - [ ] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] tvalentyn commented on issue #25413: [Feature Request]: eagerly evaluating pipeline starting with Create() in Python

Posted by "tvalentyn (via GitHub)" <gi...@apache.org>.
tvalentyn commented on issue #25413:
URL: https://github.com/apache/beam/issues/25413#issuecomment-1457483233

   thanks for filing.  how do you use eager evaluation in documentation and testing?
   
   something similar is possible with interactive runner but is more verbose.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org