You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Andy Grove (Jira)" <ji...@apache.org> on 2021/01/09 20:40:00 UTC

[jira] [Created] (ARROW-11195) [Rust] [DataFusiion] Built-in table providers should expose relevant fields

Andy Grove created ARROW-11195:
----------------------------------

             Summary: [Rust] [DataFusiion] Built-in table providers should expose relevant fields
                 Key: ARROW-11195
                 URL: https://issues.apache.org/jira/browse/ARROW-11195
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Rust - DataFusion
            Reporter: Andy Grove
            Assignee: Andy Grove
             Fix For: 3.0.0


For projects that depend on the DataFusion logical plan, there is a breaking change currently compared to 2.0.0 where it is not possible to introspect the TableScan node for CSV and Parquet files to get the file path and other meta-data (such as delimiter for CSV).

I propose adding public methods to the specific providers so that other crates can downcast to specific implementations in order to access this data.

My specific use case is the ability to serialize a DataFusion logical plan.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)