You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Andy Grove (Jira)" <ji...@apache.org> on 2021/03/23 14:28:00 UTC

[jira] [Created] (ARROW-12064) [Rust] [DataFusion] Make DataFrame extensible

Andy Grove created ARROW-12064:
----------------------------------

             Summary: [Rust] [DataFusion] Make DataFrame extensible
                 Key: ARROW-12064
                 URL: https://issues.apache.org/jira/browse/ARROW-12064
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Rust - DataFusion
            Reporter: Andy Grove
            Assignee: Andy Grove


The DataFrame implementation currently has two types of logic:
 # Logic for building a logical query plan
 # Logic for executing a query using the DataFusion context

We can make DataFrame more extensible by having it always delegate to the context for execution, allowing the same DataFrame logic to be used for local and distributed execution.

We will likely need to introduce a new ExecutionContext trait with different implementations for DataFusion and Ballista.

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)