[jira] [Created] (FLINK-24512) Allow metadata columns can also be part of primary key

["Jark Wu (Jira)" <ji...@apache.org>]

Jark Wu created FLINK-24512:
-------------------------------

             Summary: Allow metadata columns can also be part of primary key
                 Key: FLINK-24512
                 URL: https://issues.apache.org/jira/browse/FLINK-24512
             Project: Flink
          Issue Type: Bug
          Components: Table SQL / API
            Reporter: Jark Wu


Currently, primary key can only be defined on physical columns. However, we encountered some cases need to define primary key on metadata columns. 

For example, there is MySQL sharding tables {{user_01}}, {{user_02}}, ..., {{user_99}} and they all use snowflake algorithm to generate global unique ID as the PK of each table. The user would like to read the sharding tables as one table and load into an OLAP with primary key of table name and ID. A Flink SQL can be following:

{code}
CREATE TABLE mysql_users (
  table_name STRING NOT NULL METADATA,
  id BIGINT NOT NULL,
  user_name STRING,
  address STRING,
  PRIMARY KEY (table_name, id) NOT ENFORCED
) WITH (
  'connector' = 'mysql-cdc',
  'database-name' = 'mydb',
  'table-name' = 'user_.*',
  'username' = 'xxx',
  'password' = 'yyy' 
); 
{code}










--
This message was sent by Atlassian Jira
(v8.3.4#803005)