[jira] [Created] (IMPALA-11210) Impala can only handle lowercase schema elements of Iceberg table

["Zoltán Borók-Nagy (Jira)" <ji...@apache.org>]

Zoltán Borók-Nagy created IMPALA-11210:
------------------------------------------

             Summary: Impala can only handle lowercase schema elements of Iceberg table
                 Key: IMPALA-11210
                 URL: https://issues.apache.org/jira/browse/IMPALA-11210
             Project: IMPALA
          Issue Type: Bug
          Components: Catalog
            Reporter: Zoltán Borók-Nagy


When Impala/Hive creates a table they lowercase the schema elements.

Impala even has precondition checks that the schema elements are lower case:
[https://github.com/apache/impala/blob/b1c1be12f3cceed48e93eddae8b9512737e3e0d2/fe/src/main/java/org/apache/impala/catalog/Column.java#L56]

But when an Iceberg table is created via Spark it doesn't lowercase the column names, so the metadata.json file looks like this:
{noformat}
...
  "schema" : {
    "type" : "struct",
    "schema-id" : 0,
    "fields" : [ {
      "id" : 1,
      "name" : "Region",
      "required" : false,
      "type" : "string"
    }, {
...
{noformat}
Hence when Impala tries to load such tables it runs to the above precondition check which raises an IllegalStateException.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org