You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Daniel Becker (JIRA)" <ji...@apache.org> on 2019/04/29 13:55:00 UTC

[jira] [Resolved] (IMPALA-8381) Remove branch from ParquetPlainEncoder::Decode()

     [ https://issues.apache.org/jira/browse/IMPALA-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Becker resolved IMPALA-8381.
-----------------------------------
    Resolution: Done

Implemented and merged.

> Remove branch from ParquetPlainEncoder::Decode()
> ------------------------------------------------
>
>                 Key: IMPALA-8381
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8381
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Backend
>            Reporter: Csaba Ringhofer
>            Assignee: Daniel Becker
>            Priority: Minor
>              Labels: newbie, parquet, performance, ramp-up
>
> Removing the "if" at
> https://github.com/apache/impala/blob/5670f96b828d57f9e36510bb9af02bcc31de775c/be/src/exec/parquet/parquet-common.h#L203
> can lead to 1.5x speed up in plain decoding (type=int32, stride=16). For primitive types, the same check can be done for a whole batch, so the speedup can be gained for large batches without loosing safety. The only Parquet type where this check is needed per element is BYTE_ARRAY (typically used for STRING columns), which already has a template specialization for  ParquetPlainEncoder::Decode().



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)