[jira] [Created] (IMPALA-6373) Allow type widening primitive conversion on parquet tables

["Patrick Bayne (JIRA)" <ji...@apache.org>]

Patrick Bayne created IMPALA-6373:
-------------------------------------

             Summary: Allow type widening primitive conversion on parquet tables
                 Key: IMPALA-6373
                 URL: https://issues.apache.org/jira/browse/IMPALA-6373
             Project: IMPALA
          Issue Type: New Feature
          Components: Backend
    Affects Versions: Impala 2.10.0
            Reporter: Patrick Bayne


This improvement is very useful for users who have schema evolution on their tables, or users that use Impala and Hive for querying data and are allowing for this. Beings this improvement is in Hive, a Hive table with a "bigint" can read parquet files with "int32" and "int64" types. This same query will fail in Impala due to the unexpected data type, with an error similar to: "Column type: BIGINT, Parquet schema: optional int32"

Hive 2.x's addition of type widening is found in the following JIRAs:
https://issues.apache.org/jira/browse/HIVE-12080
https://issues.apache.org/jira/browse/HIVE-14085

Here's a list of widening conversions the upstream Hive improvement supports:

tinyint     ->  smallint,int,bigint,float,double
smallint  -> int,bigint,float,double
int          -> bigint,float,double
bigint     -> float,double
float       ->  double
double   ->  --



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)