You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Thomas Tauber-Marshall (JIRA)" <ji...@apache.org> on 2017/10/02 15:10:02 UTC
[jira] [Resolved] (IMPALA-5994) Failure in star expansion on struct
fields
[ https://issues.apache.org/jira/browse/IMPALA-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Tauber-Marshall resolved IMPALA-5994.
--------------------------------------------
Resolution: Fixed
Fix Version/s: Impala 2.11.0
commit c07391ce518ffec0441839f70a822f78683acffc
Author: Thomas Tauber-Marshall <tm...@cloudera.com>
Date: Thu Sep 28 14:13:42 2017 -0700
IMPALA-5994: Lower case struct-field names
Impala tries to always store column names in lower case. As part of a
cleanup of issues related to upper case Kudu column names, a check was
added in Analyzer to enforce this.
The check fails when doing star expansion on a struct to select all
fields in the case where a table was created in Hive with upper case
letters in a struct field name. This happens because Hive does not
covert struct field names to all lower case in HMS.
The solution is to force StructField names to lower case.
Testing:
- Added a test in test_nested_types.py
- Fixed FE test that expected struct field to be output in upper case.
Change-Id: Iacd9714ac2301a55ee8b64f0102f6f156fb0370e
Reviewed-on: http://gerrit.cloudera.org:8080/8169
Reviewed-by: Thomas Tauber-Marshall <tm...@cloudera.com>
Tested-by: Impala Public Jenkins
> Failure in star expansion on struct fields
> ------------------------------------------
>
> Key: IMPALA-5994
> URL: https://issues.apache.org/jira/browse/IMPALA-5994
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Affects Versions: Impala 2.10.0
> Reporter: Thomas Tauber-Marshall
> Priority: Blocker
> Fix For: Impala 2.11.0
>
>
> If a table is created externally in hive with struct field names containing upper case letters, selecting the fields of the struct with a '*' fails with the error 'IllegalStateException: Slot paths should be lower case'
> Repro:
> {noformat}
> hive> create table case_test (s struct<FIELD:int>);
> impala> invalidate metadata;
> impala> select s.* from case_test;
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)