You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Andrew Lamb (Jira)" <ji...@apache.org> on 2021/04/09 18:19:00 UTC

[jira] [Commented] (ARROW-12306) [Rust] Read CSV format text from stdin or memory

    [ https://issues.apache.org/jira/browse/ARROW-12306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318190#comment-17318190 ] 

Andrew Lamb commented on ARROW-12306:
-------------------------------------

[~heymind] I think having the CsvExec be able to read from stdin (aka anything that impl `Read`) is a good idea


Perhaps you an extend CsvFile https://github.com/apache/arrow/blob/master/rust/datafusion/src/datasource/csv.rs#L50 so that it can take either a `Path` or something that implements `Read` and then pass that information down to the `CsvExec`

> [Rust] Read CSV format text from stdin or memory
> ------------------------------------------------
>
>                 Key: ARROW-12306
>                 URL: https://issues.apache.org/jira/browse/ARROW-12306
>             Project: Apache Arrow
>          Issue Type: Wish
>          Components: Rust - DataFusion
>            Reporter: Siwei
>            Priority: Minor
>
> Hello,
> I'm building a command line tool that can run SQL queries on text files (csv, json-line ..) . But the `CsvExec` in datafusion can only read csv text from files currently. I have checked its inner implantation the csv reader in arrow, anything impl `Read` could be a valid input.
>  
> Should this feature ( read csv from stdin) come with datafusion ? Or I just make it into my own crate.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)