You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2017/08/19 18:51:02 UTC

[jira] [Created] (ARROW-1377) [Python] Add function to assist with benchmarking Parquet scan performance

Wes McKinney created ARROW-1377:
-----------------------------------

             Summary: [Python] Add function to assist with benchmarking Parquet scan performance
                 Key: ARROW-1377
                 URL: https://issues.apache.org/jira/browse/ARROW-1377
             Project: Apache Arrow
          Issue Type: New Feature
          Components: Python
            Reporter: Wes McKinney
             Fix For: 0.7.0


It would be simpler to assess the raw performance of parquet-cpp Parquet scans to have something akin to https://github.com/apache/parquet-cpp/blob/master/tools/parquet-scan.cc available as a callable Python function. This way we can isolate the performance of scanning the file from converting it to Arrow (and to pandas)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)