You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "xiangxiang Shen (Jira)" <ji...@apache.org> on 2022/09/15 07:17:00 UTC
[jira] [Comment Edited] (ARROW-17735) Improve parquet reading performance for String/Binary type based on Buffer operations instead of BinaryArrayBuilder
[ https://issues.apache.org/jira/browse/ARROW-17735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17605157#comment-17605157 ]
xiangxiang Shen edited comment on ARROW-17735 at 9/15/22 7:16 AM:
------------------------------------------------------------------
Hi [~apitrou] , yes, C++.
Related code:
cpp/src/parquet/column_reader.cc
cpp/src/parquet/encoding.cc
cpp/src/parquet/encoding.cc
Also, I can submit one pull request
was (Author: zhixingheyi-tian):
Hi [~apitrou] , yes, C++
> Improve parquet reading performance for String/Binary type based on Buffer operations instead of BinaryArrayBuilder
> -------------------------------------------------------------------------------------------------------------------
>
> Key: ARROW-17735
> URL: https://issues.apache.org/jira/browse/ARROW-17735
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Parquet
> Affects Versions: 8.0.1
> Reporter: xiangxiang Shen
> Priority: Major
>
> Improve parquet reading performance for String/Binary type based on Buffer operations instead of BinaryArrayBuilder.
>
> Currently, parquet String/Binary type reading performance is not good enough. For fixedwidth types, the Reader has adopted Buffer operations instead of ArrayBuilder interfaces.
>
> So it‘s better to use Buffer operations in String/Binary type reading.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)