You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2023/02/16 20:34:00 UTC
[jira] [Created] (IMPALA-11926) Ignore avro.schema.url if table doesn't have Avro data
Zoltán Borók-Nagy created IMPALA-11926:
------------------------------------------
Summary: Ignore avro.schema.url if table doesn't have Avro data
Key: IMPALA-11926
URL: https://issues.apache.org/jira/browse/IMPALA-11926
Project: IMPALA
Issue Type: Bug
Components: Catalog
Reporter: Zoltán Borók-Nagy
In local catalog mode we always try to load the Avro schema if the table property 'avro.schema.url' is present:
https://github.com/apache/impala/blob/80fc49abe6c574f8d6bea8bb56ff4917f6281a41/fe/src/main/java/org/apache/impala/catalog/local/LocalFsTable.java#L142
This makes tables unloadable if the value of this table property is invalid. Even if the actual table doesn't have any Avro partitions.
This is a regression from legacy catalog mode where we only tried to load the Avro schema if the table actually had Avro data:
https://github.com/apache/impala/blob/80fc49abe6c574f8d6bea8bb56ff4917f6281a41/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java#L1758
--
This message was sent by Atlassian Jira
(v8.20.10#820010)