You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Michael Lorenzi (Jira)" <ji...@apache.org> on 2023/09/06 08:03:00 UTC

[jira] [Created] (FLINK-33045) format avro-confluent - disable auto-registering schema in registry

Michael Lorenzi created FLINK-33045:
---------------------------------------

             Summary: format avro-confluent - disable auto-registering schema in registry
                 Key: FLINK-33045
                 URL: https://issues.apache.org/jira/browse/FLINK-33045
             Project: Flink
          Issue Type: Improvement
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
    Affects Versions: 1.17.1
         Environment: Flink-Kubernetes-Operator

format avro-confluent
            Reporter: Michael Lorenzi


{code:java}
'value.format' = 'avro-confluent',
'value.avro-confluent.url' = '<url>',
'value.avro-confluent.schema' = '<schema>', -- available in 1.18.x{code}

Currently the format {{avro-confluent}} seems to always try to register the schema to the schema-registry, be it computed out of the table-schema or set by property {{schema}} (if 1.18.x is used).

In our setup we would like to prevent our flink-jobs from registering schemas. Flink should only lookup the schema-id by calling {{getId}} from confluents schema-registry-client. We control publishing of new schema-versions outside of flink.

The bevaviour is expected to be similar to the behvaiour of KafkaAvroSerializer from confluent when {{auto.register.schemas=false}} is set.

Could there be a option like
{code:java}
'value.avro-confluent.auto-register.schema' = 'false'{code}
to disable auto-registering schema to the schema-registry?

Thank you for your help!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)