You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Andy Grove (JIRA)" <ji...@apache.org> on 2019/02/26 05:42:00 UTC

[jira] [Created] (ARROW-4681) [Rust] [DataFusion] Implement parallel query execution using threads

Andy Grove created ARROW-4681:
---------------------------------

             Summary: [Rust] [DataFusion] Implement parallel query execution using threads
                 Key: ARROW-4681
                 URL: https://issues.apache.org/jira/browse/ARROW-4681
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Rust, Rust - DataFusion
    Affects Versions: 0.12.0
            Reporter: Andy Grove
            Assignee: Andy Grove
             Fix For: 0.13.0


I am planning on tackling this soon. The basic plan is to change the table scan() method to return multiple scanners (one per partition) so that the query execution can process each partition on a separate thread.

This will involve changing some of the DataFusion APIs to use Arc instead of Rc.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)