You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/11/25 13:36:54 UTC

[GitHub] [arrow] jhorstmann commented on pull request #8664: ARROW-10588: [Rust] Safe and parallel bit operations for Arrow

jhorstmann commented on pull request #8664:
URL: https://github.com/apache/arrow/pull/8664#issuecomment-733710712


   > Introducing thread parallelism at a compute kernel level
   
   Conceptually this is not a small change. Personally I think parallelizing on the datafusion level and keeping kernels single-threaded is the better model.
   
   The benchmark is now also testing a much larger array (2^20 elements) than what is usually used as a chunk size, so in reality the speedup due to parallelism would be much smaller.
   
   I'm totally fine with a small slowdown if that leads to cleaner and safer code.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org