[jira] [Work started] (IMPALA-6373) Allow type widening primitive conversion on parquet tables

["Fredy Wijaya (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on IMPALA-6373 started by Fredy Wijaya.
--------------------------------------------
> Allow type widening primitive conversion on parquet tables
> ----------------------------------------------------------
>
>                 Key: IMPALA-6373
>                 URL: https://issues.apache.org/jira/browse/IMPALA-6373
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Backend
>    Affects Versions: Impala 2.10.0
>            Reporter: Patrick Bayne
>            Assignee: Fredy Wijaya
>            Priority: Major
>              Labels: parquet
>
> This improvement is very useful for users who have schema evolution on their tables, or users that use Impala and Hive for querying data and are allowing for this. Beings this improvement is in Hive, a Hive table with a "bigint" can read parquet files with "int32" and "int64" types. This same query will fail in Impala due to the unexpected data type, with an error similar to: "Column type: BIGINT, Parquet schema: optional int32"
> Hive 2.x's addition of type widening is found in the following JIRAs:
> https://issues.apache.org/jira/browse/HIVE-12080
> https://issues.apache.org/jira/browse/HIVE-14085
> Here's a list of widening conversions the upstream Hive improvement supports:
> tinyint     ->  smallint,int,bigint,float,double
> smallint  -> int,bigint,float,double
> int          -> bigint,float,double
> bigint     -> float,double
> float       ->  double
> double   ->  --



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org