You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Thomas Tauber-Marshall (JIRA)" <ji...@apache.org> on 2017/10/02 15:10:02 UTC

[jira] [Resolved] (IMPALA-5994) Failure in star expansion on struct fields

     [ https://issues.apache.org/jira/browse/IMPALA-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Tauber-Marshall resolved IMPALA-5994.
--------------------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 2.11.0

commit c07391ce518ffec0441839f70a822f78683acffc
Author: Thomas Tauber-Marshall <tm...@cloudera.com>
Date:   Thu Sep 28 14:13:42 2017 -0700

    IMPALA-5994: Lower case struct-field names
    
    Impala tries to always store column names in lower case. As part of a
    cleanup of issues related to upper case Kudu column names, a check was
    added in Analyzer to enforce this.
    
    The check fails when doing star expansion on a struct to select all
    fields in the case where a table was created in Hive with upper case
    letters in a struct field name. This happens because Hive does not
    covert struct field names to all lower case in HMS.
    
    The solution is to force StructField names to lower case.
    
    Testing:
    - Added a test in test_nested_types.py
    - Fixed FE test that expected struct field to be output in upper case.
    
    Change-Id: Iacd9714ac2301a55ee8b64f0102f6f156fb0370e
    Reviewed-on: http://gerrit.cloudera.org:8080/8169
    Reviewed-by: Thomas Tauber-Marshall <tm...@cloudera.com>
    Tested-by: Impala Public Jenkins

> Failure in star expansion on struct fields
> ------------------------------------------
>
>                 Key: IMPALA-5994
>                 URL: https://issues.apache.org/jira/browse/IMPALA-5994
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Catalog
>    Affects Versions: Impala 2.10.0
>            Reporter: Thomas Tauber-Marshall
>            Priority: Blocker
>             Fix For: Impala 2.11.0
>
>
> If a table is created externally in hive with struct field names containing upper case letters, selecting the fields of the struct with a '*' fails with the error 'IllegalStateException: Slot paths should be lower case'
> Repro:
> {noformat}
> hive> create table case_test (s struct<FIELD:int>);
> impala> invalidate metadata;
> impala> select s.* from case_test;
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)