[jira] [Commented] (ARROW-10300) [Rust] Improve benchmark documentation for generating/converting TPC-H data

["Andy Grove (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17224176#comment-17224176 ] 

Andy Grove commented on ARROW-10300:
------------------------------------

I've been using Apache Spark but I'm not sure how helpful it would be to add that code to the Rust project. I imagine that others would more naturally use something like PyArrow or Pandas to perform the conversion, but I don't have experience with either of those currently (although I do intend to learn them).

> [Rust] Improve benchmark documentation for generating/converting TPC-H data
> ---------------------------------------------------------------------------
>
>                 Key: ARROW-10300
>                 URL: https://issues.apache.org/jira/browse/ARROW-10300
>             Project: Apache Arrow
>          Issue Type: Wish
>          Components: Rust
>            Reporter: Remi Dettai
>            Assignee: Andy Grove
>            Priority: Minor
>
> The TPC-H benchmark for datafusion works with Parquet/CSV data but the data generation routine described in the README generates `.tbl` data.
> Could we describe how the TPC-H Parquet/CSV data can be generated to make the benchmark easier to setup and more reproducible ?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)