You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2021/01/27 14:31:00 UTC

[jira] [Updated] (PARQUET-1717) parquet-thrift converts Thrift i16 to parquet INT32 instead of INT_16

     [ https://issues.apache.org/jira/browse/PARQUET-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gabor Szadovszky updated PARQUET-1717:
--------------------------------------
    Fix Version/s:     (was: 1.11.0)
                   1.12.0

> parquet-thrift converts Thrift i16 to parquet INT32 instead of INT_16
> ---------------------------------------------------------------------
>
>                 Key: PARQUET-1717
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1717
>             Project: Parquet
>          Issue Type: Wish
>          Components: parquet-thrift
>    Affects Versions: 1.11.0
>            Reporter: Emmanuel Brard
>            Assignee: Emmanuel Brard
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 1.12.0
>
>
> Currently when converting Thrift to Parquet, the ThriftSchemaConverter will convert a i16 thrift data type as a INT32 Parquet data type even if the logical type INT(16, false) would be more representative, especially for downstream consumers of the parquet files.
> Using the logical data type requires a change in this method:
> {code:java}
>  @Override
>   public ConvertedField visit(I16Type i16Type, State state) {
>     return visitPrimitiveType(INT32, state);
>   }
> {code}
> from the ThriftSchemaConvertVisitor



--
This message was sent by Atlassian Jira
(v8.3.4#803005)