You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2021/01/15 14:43:00 UTC

[jira] [Closed] (FLINK-20348) Make "schema-registry.subject" optional for Kafka sink with avro-confluent format

     [ https://issues.apache.org/jira/browse/FLINK-20348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jark Wu closed FLINK-20348.
---------------------------
    Resolution: Fixed

Fixed in master: 3786d3b1e55e063c7453d9813335dc5c2906bf7b

> Make "schema-registry.subject" optional for Kafka sink with avro-confluent format
> ---------------------------------------------------------------------------------
>
>                 Key: FLINK-20348
>                 URL: https://issues.apache.org/jira/browse/FLINK-20348
>             Project: Flink
>          Issue Type: Improvement
>          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
>            Reporter: Jark Wu
>            Assignee: zhuxiaoshang
>            Priority: Major
>              Labels: pull-request-available, sprint
>             Fix For: 1.13.0
>
>
> Currently, configuration "schema-registry.subject" in avro-confluent format is required by sink. However, this is quite verbose set it manually. By default, it can be to set to {{<topic_name>-key}} and {{<topic_name>-value}} if it works with kafka or upsert-kafka connector. This can also makes 'avro-confluent' format to be more handy and works better with Kafka/Confluent ecosystem. 
> {code:sql}
> CREATE TABLE kafka_gmv (
>   day_str STRING,
>   gmv BIGINT,
>   PRIMARY KEY (day_str) NOT ENFORCED
> ) WITH (
>     'connector' = 'upsert-kafka',
>     'topic' = 'kafka_gmv',
>     'properties.bootstrap.servers' = 'localhost:9092',
>     -- 'key.format' = 'raw',
>     'key.format' = 'avro-confluent',
>     'key.avro-confluent.schema-registry.url' = 'http://localhost:8181',
>     'key.avro-confluent.schema-registry.subject' = 'kafka_gmv-key',
>     'value.format' = 'avro-confluent',
>     'value.avro-confluent.schema-registry.url' = 'http://localhost:8181',
>     'value.avro-confluent.schema-registry.subject' = 'kafka_gmv-value'
> );
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)