[jira] [Created] (FLINK-19517) Support for Confluent Kafka on table creation

["Kevin Kwon (Jira)" <ji...@apache.org>]

Kevin Kwon created FLINK-19517:
----------------------------------

             Summary: Support for Confluent Kafka on table creation
                 Key: FLINK-19517
                 URL: https://issues.apache.org/jira/browse/FLINK-19517
             Project: Flink
          Issue Type: Wish
    Affects Versions: 1.12.0
            Reporter: Kevin Kwon


Currently, table creation from SQL client such as below works well
{code:sql}
CREATE TABLE kafkaTable (
  user_id BIGINT,
  item_id BIGINT,
  category_id BIGINT,
  behavior STRING,
  ts TIMESTAMP(3)
) WITH (
  'connector' = 'kafka',
  'topic' = 'user_behavior',
  'properties.bootstrap.servers' = 'localhost:9092',
  'properties.group.id' = 'testGroup',
  'format' = 'avro',
  'scan.startup.mode' = 'earliest-offset'
)
{code}
Although I would wish for the table creation to support Confluent Kafka configuration as well. For example some think like
{code:sql}
CREATE TABLE kafkaTable (
  user_id BIGINT,
  item_id BIGINT,
  category_id BIGINT,
  behavior STRING,
  ts TIMESTAMP(3)
) WITH (
  'connector' = 'kafka-confluent',
  'topic' = 'user_behavior',
  'properties.bootstrap.servers' = 'localhost:9092',
  'properties.group.id' = 'testGroup',
  'schema-registry' = 'http://schema-registry.com',
  'scan.startup.mode' = 'earliest-offset'
)
{code}
Additionally, it will be better if we can
 - specify 'parallelism' within WITH clause to support parallel partition processing
 - specify custom properties within WITH clause specified in [https://docs.confluent.io/5.4.2/installation/configuration/consumer-configs.html]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)