[jira] [Resolved] (IMPALA-2525) Impala CREATE TABLE LIKE PARQUET breaks on ENUM logical type

["Jakub Kukul (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jakub Kukul resolved IMPALA-2525.
---------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 2.10.0

IMPALA-2525: Treat parquet ENUMs as STRINGs when creating impala tables.

Change-Id: Ia7a2e20c3ab83eb3fac422c3b33c117856fec475
Reviewed-on: http://gerrit.cloudera.org:8080/6550
Reviewed-by: Alex Behm <al...@cloudera.com>
Tested-by: Impala Public Jenkins

> Impala CREATE TABLE LIKE PARQUET breaks on ENUM logical type
> ------------------------------------------------------------
>
>                 Key: IMPALA-2525
>                 URL: https://issues.apache.org/jira/browse/IMPALA-2525
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Frontend
>    Affects Versions: Impala 2.2
>            Reporter: Uri Laserson
>            Assignee: Jakub Kukul
>            Priority: Minor
>              Labels: parquet, usability
>             Fix For: Impala 2.10.0
>
>
> I'm trying to DDL a table backed by a parquet file with the following schema:
> {code}
> message org.bdgenomics.formats.avro.Variant_flat {
>   optional int32 variantErrorProbability;
>   optional binary contig__contigName (UTF8);
>   optional int64 contig__contigLength;
>   optional binary contig__contigMD5 (UTF8);
>   optional binary contig__referenceURL (UTF8);
>   optional binary contig__assembly (UTF8);
>   optional binary contig__species (UTF8);
>   optional int32 contig__referenceIndex;
>   optional int64 start;
>   optional int64 end;
>   optional binary referenceAllele (UTF8);
>   optional binary alternateAllele (UTF8);
>   optional binary svAllele__type (ENUM);
>   optional binary svAllele__assembly (UTF8);
>   optional boolean svAllele__precise;
>   optional int32 svAllele__startWindow;
>   optional int32 svAllele__endWindow;
>   optional boolean isSomatic;
> }
> {code}
> I get the following error:
> {code}
> Query: create EXTERNAL TABLE prepartition LIKE PARQUET '/user/ec2-user/dbsnp/adam_flat_variants/part-r-00000.gz.parquet' STORED AS PARQUET LOCATION 'hdfs:///user/ec2-user/dbsnp/adam_flat_variants'
> ERROR: AnalysisException: Unsupported logical parquet type ENUM (primitive type is BINARY) for field svAllele__type
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)