You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Andy Grove (JIRA)" <ji...@apache.org> on 2019/02/26 05:42:00 UTC
[jira] [Created] (ARROW-4681) [Rust] [DataFusion] Implement
parallel query execution using threads
Andy Grove created ARROW-4681:
---------------------------------
Summary: [Rust] [DataFusion] Implement parallel query execution using threads
Key: ARROW-4681
URL: https://issues.apache.org/jira/browse/ARROW-4681
Project: Apache Arrow
Issue Type: Improvement
Components: Rust, Rust - DataFusion
Affects Versions: 0.12.0
Reporter: Andy Grove
Assignee: Andy Grove
Fix For: 0.13.0
I am planning on tackling this soon. The basic plan is to change the table scan() method to return multiple scanners (one per partition) so that the query execution can process each partition on a separate thread.
This will involve changing some of the DataFusion APIs to use Arc instead of Rc.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)