You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/10/13 04:43:51 UTC

[GitHub] [arrow] jorgecarleitao commented on pull request #8453: ARROW-10292: [Rust] [DataFusion] Simplify merge

jorgecarleitao commented on pull request #8453:
URL: https://github.com/apache/arrow/pull/8453#issuecomment-707483047


   Note that there is an important note in [Tokio's documentation](https://docs.rs/tokio/0.2.22/tokio/index.html#cpu-bound-tasks-and-blocking-code):
   
   > If your code is CPU-bound and you wish to limit the number of threads used to run it, you should run it on another thread pool such as rayon. You can use an oneshot channel to send the result back to Tokio when the rayon task finishes.
   
   I.e. Tokio's `spawn` is suitable for non-blocking, non-CPU-bound tasks. This may explain why we do not see a significant performance increase when using `tokio::spawn`: most of our tasks are CPU-bounded.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org