You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Andy Grove (JIRA)" <ji...@apache.org> on 2019/02/17 16:05:00 UTC

[jira] [Created] (ARROW-4603) [Rust] [DataFusion] Execution context should allow in-memory data sources to be registered

Andy Grove created ARROW-4603:
---------------------------------

             Summary: [Rust] [DataFusion] Execution context should allow in-memory data sources to be registered
                 Key: ARROW-4603
                 URL: https://issues.apache.org/jira/browse/ARROW-4603
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Rust, Rust - DataFusion
    Affects Versions: 0.12.0
            Reporter: Andy Grove
             Fix For: 0.13.0


Currently it is only possible to run SQL queries against CSV files. I would like to be able to run SQL queries against data that is already loaded into memory in a single RecordBatch or an iterator over RecordBatch.

There are two reasons I want this feature:
 # Ability to call DataFusion via IPC or JNI from Java to run queries
 # Ability to create benchmarks for the query engine that do not involve disk I/O

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)