You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2023/01/17 17:32:00 UTC
[jira] [Commented] (FLINK-30721) The confluent schema registry is not compatible with Apicurio shcema registry
[ https://issues.apache.org/jira/browse/FLINK-30721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677861#comment-17677861 ]
Martijn Visser commented on FLINK-30721:
----------------------------------------
[~pedromazala] Thanks for filing the ticket. I do wonder if this is a bug; Flink officially doesn't support Apicurio (see FLINK-26654).
> The confluent schema registry is not compatible with Apicurio shcema registry
> -----------------------------------------------------------------------------
>
> Key: FLINK-30721
> URL: https://issues.apache.org/jira/browse/FLINK-30721
> Project: Flink
> Issue Type: Bug
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Reporter: Pedro Mázala
> Priority: Major
>
> With the format `avro-confluent`, it is impossible to use [Apicurio|https://www.apicur.io/].
> [The code|https://github.com/apache/flink/blob/master/flink-formats/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/ConfluentSchemaRegistryCoder.java#L71] reads a 4-byte integer (see `readInt` documentation [here|https://docs.oracle.com/javase/7/docs/api/java/io/DataInput.html#readInt()]) and Apicurio stores its schema ids as a long ([8 bytes|https://docs.oracle.com/javase/7/docs/api/java/io/DataInput.html#readLong()]).
> The solution could be adding the schema size to be read from the log message.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)