You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2017/09/05 01:13:00 UTC

[jira] [Commented] (ARROW-1377) [Python] Add function to assist with benchmarking Parquet scan performance

    [ https://issues.apache.org/jira/browse/ARROW-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153010#comment-16153010 ] 

Wes McKinney commented on ARROW-1377:
-------------------------------------

PR: https://github.com/apache/arrow/pull/1039

> [Python] Add function to assist with benchmarking Parquet scan performance
> --------------------------------------------------------------------------
>
>                 Key: ARROW-1377
>                 URL: https://issues.apache.org/jira/browse/ARROW-1377
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Python
>            Reporter: Wes McKinney
>            Assignee: Wes McKinney
>             Fix For: 0.7.0
>
>
> It would be simpler to assess the raw performance of parquet-cpp Parquet scans to have something akin to https://github.com/apache/parquet-cpp/blob/master/tools/parquet-scan.cc available as a callable Python function. This way we can isolate the performance of scanning the file from converting it to Arrow (and to pandas)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)