You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Andy Grove (Jira)" <ji...@apache.org> on 2021/01/09 20:40:00 UTC
[jira] [Created] (ARROW-11195) [Rust] [DataFusiion] Built-in table
providers should expose relevant fields
Andy Grove created ARROW-11195:
----------------------------------
Summary: [Rust] [DataFusiion] Built-in table providers should expose relevant fields
Key: ARROW-11195
URL: https://issues.apache.org/jira/browse/ARROW-11195
Project: Apache Arrow
Issue Type: Improvement
Components: Rust - DataFusion
Reporter: Andy Grove
Assignee: Andy Grove
Fix For: 3.0.0
For projects that depend on the DataFusion logical plan, there is a breaking change currently compared to 2.0.0 where it is not possible to introspect the TableScan node for CSV and Parquet files to get the file path and other meta-data (such as delimiter for CSV).
I propose adding public methods to the specific providers so that other crates can downcast to specific implementations in order to access this data.
My specific use case is the ability to serialize a DataFusion logical plan.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)