You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 20:06:06 UTC

[GitHub] [beam] damccorm opened a new issue, #20892: combine should be parallelizable in many cases

damccorm opened a new issue, #20892:
URL: https://github.com/apache/beam/issues/20892

   Relevant discussion: https://lists.apache.org/thread.html/r9e7d9527eb1d4c9c097c91c010a25dabf4a5f8053d50dc3b6d90d36a%40%3Cdev.beam.apache.org%3E
   
   Currently we require Singleton partitioning for combine() because func *might* operate on the full dataset, but in many cases func is actually an elementwise method. We should detect this when possible (e.g. when func is an np.ufunc), and/or provide a flag to let the user indicate the function is elementwise.
   
   Imported from Jira [BEAM-12351](https://issues.apache.org/jira/browse/BEAM-12351). Original Jira may contain additional context.
   Reported by: bhulette.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org