You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2020/11/25 15:10:00 UTC

[jira] [Created] (FLINK-20348) Make "schema-registry.subject" optional for Kafka sink with avro-confluent format

Jark Wu created FLINK-20348:
-------------------------------

             Summary: Make "schema-registry.subject" optional for Kafka sink with avro-confluent format
                 Key: FLINK-20348
                 URL: https://issues.apache.org/jira/browse/FLINK-20348
             Project: Flink
          Issue Type: Improvement
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
            Reporter: Jark Wu
             Fix For: 1.12.0


Currently, configuration "schema-registry.subject" in avro-confluent format is required by sink. However, this is quite verbose set it manually. By default, it can be to set to {{<topic_name>-key}} and {{<topic_name>-value}} if it works with kafka or upsert-kafka connector. This can also makes 'avro-confluent' format to be more handy and works better with Kafka/Confluent ecosystem. 

{code:sql}
CREATE TABLE kafka_gmv (
  day_str STRING,
  gmv BIGINT,
  PRIMARY KEY (day_str) NOT ENFORCED
) WITH (
    'connector' = 'upsert-kafka',
    'topic' = 'kafka_gmv',
    'properties.bootstrap.servers' = 'localhost:9092',
    -- 'key.format' = 'raw',
    'key.format' = 'avro-confluent',
    'key.avro-confluent.schema-registry.url' = 'http://localhost:8181',
    'key.avro-confluent.schema-registry.subject' = 'kafka_gmv-key',
    'value.format' = 'avro-confluent',
    'value.avro-confluent.schema-registry.url' = 'http://localhost:8181',
    'value.avro-confluent.schema-registry.subject' = 'kafka_gmv-value'
);
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)