You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2023/02/16 20:34:00 UTC

[jira] [Created] (IMPALA-11926) Ignore avro.schema.url if table doesn't have Avro data

Zoltán Borók-Nagy created IMPALA-11926:
------------------------------------------

             Summary: Ignore avro.schema.url if table doesn't have Avro data
                 Key: IMPALA-11926
                 URL: https://issues.apache.org/jira/browse/IMPALA-11926
             Project: IMPALA
          Issue Type: Bug
          Components: Catalog
            Reporter: Zoltán Borók-Nagy


In local catalog mode we always try to load the Avro schema if the table property 'avro.schema.url' is present:

https://github.com/apache/impala/blob/80fc49abe6c574f8d6bea8bb56ff4917f6281a41/fe/src/main/java/org/apache/impala/catalog/local/LocalFsTable.java#L142

This makes tables unloadable if the value of this table property is invalid. Even if the actual table doesn't have any Avro partitions.

This is a regression from legacy catalog mode where we only tried to load the Avro schema if the table actually had Avro data:

https://github.com/apache/impala/blob/80fc49abe6c574f8d6bea8bb56ff4917f6281a41/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java#L1758



--
This message was sent by Atlassian Jira
(v8.20.10#820010)