You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Denys Kuzmenko (Jira)" <ji...@apache.org> on 2023/12/06 10:28:00 UTC

[jira] [Commented] (HIVE-26333) Empty Avro schema when defined by avro.schema.url

    [ https://issues.apache.org/jira/browse/HIVE-26333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793615#comment-17793615 ] 

Denys Kuzmenko commented on HIVE-26333:
---------------------------------------

[~martinbudinsky3], do you plan to contribute the fix

> Empty Avro schema when defined by avro.schema.url
> -------------------------------------------------
>
>                 Key: HIVE-26333
>                 URL: https://issues.apache.org/jira/browse/HIVE-26333
>             Project: Hive
>          Issue Type: Bug
>          Components: kafka integration
>    Affects Versions: 4.0.0-alpha-1, 4.0.0-alpha-2
>            Reporter: Martin Budinský
>            Priority: Major
>
> When I try to create Kafka table with Avro Confluent schema defined by avro.schema.url I get following error:
> {code:java}
> java.lang.IllegalArgumentException: Avro Schema is empty Can not go further
>         at com.google.common.base.Preconditions.checkArgument(Preconditions.java:122) ~[guava-19.0.jar:?]
>         at org.apache.hadoop.hive.kafka.KafkaSerDe.initialize(KafkaSerDe.java:133) ~[kafka-handler-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
> ... {code}
> However if schema is defined by avro.schema.literal property everything works fine.
> I think that bug is caused by this expression in KafkaSerDe.initialize method:
> {code:java}
> String schemaFromProperty = properties.getProperty(AvroSerdeUtils.AvroTableProperties.SCHEMA_LITERAL.getPropName(), ""); {code}
> The schema literal value should be read from tableProperties instead of properties attribute, because AvroSerDe object write parsed schema to tableProperties object before.
> So the fixed expression should look as follows:
> {code:java}
> String schemaFromProperty = tableProperties.getProperty(AvroSerdeUtils.AvroTableProperties.SCHEMA_LITERAL.getPropName(), ""); {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)