You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/10/13 14:42:16 UTC

[GitHub] [arrow] andygrove commented on pull request #8453: ARROW-10292: [Rust] [DataFusion] Simplify merge

andygrove commented on pull request #8453:
URL: https://github.com/apache/arrow/pull/8453#issuecomment-707783648


   This looks great, but how do we control the concurrency now? The `concurrency` attribute in `ExecutionConfig` is now effectively unused.  think we should either create the tokio thread pool explicitly using the `ExecutionConfig.concurrency` value or remove this config entirely since it is no longer used.
   
   Without being able to control the concurrency level it will be difficult (but not impossible) to run scalability benchmarks to see how we scale with an increasing concurrency level.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org