You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "robertwb (via GitHub)" <gi...@apache.org> on 2023/04/19 21:41:06 UTC

[GitHub] [beam] robertwb opened a new issue, #26359: [Bug]: WriteToFiles uses expensive ToList when all that's required is ToIterable.

robertwb opened a new issue, #26359:
URL: https://github.com/apache/beam/issues/26359

   ### What happened?
   
   This can double the runtime of pipelines writing small files. 
   
   ### Issue Priority
   
   Priority: 3 (minor)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [X] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [X] Component: IO connector
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [X] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] jrmccluskey closed issue #26359: [Bug]: WriteToFiles uses expensive ToList when all that's required is ToIterable.

Posted by "jrmccluskey (via GitHub)" <gi...@apache.org>.
jrmccluskey closed issue #26359: [Bug]: WriteToFiles uses expensive ToList when all that's required is ToIterable.
URL: https://github.com/apache/beam/issues/26359


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] jrmccluskey commented on issue #26359: [Bug]: WriteToFiles uses expensive ToList when all that's required is ToIterable.

Posted by "jrmccluskey (via GitHub)" <gi...@apache.org>.
jrmccluskey commented on issue #26359:
URL: https://github.com/apache/beam/issues/26359#issuecomment-1523879473

   This has been cherrypicked 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] robertwb commented on issue #26359: [Bug]: WriteToFiles uses expensive ToList when all that's required is ToIterable.

Posted by "robertwb (via GitHub)" <gi...@apache.org>.
robertwb commented on issue #26359:
URL: https://github.com/apache/beam/issues/26359#issuecomment-1515422963

   This is fixed in HEAD at https://github.com/apache/beam/pull/26289


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org