[jira] [Created] (FLINK-41058) Fluss pipeline sink ignores table options defined in transform rules

["Hongshun Wang (Jira)" <ji...@apache.org>]

Hongshun Wang created FLINK-41058:
-------------------------------------

             Summary: Fluss pipeline sink ignores table options defined in transform rules
                 Key: FLINK-41058
                 URL: https://issues.apache.org/jira/browse/FLINK-41058
             Project: Flink
          Issue Type: New Feature
          Components: Flink CDC
    Affects Versions: cdc-3.7.0
            Reporter: Hongshun Wang
             Fix For: cdc-3.8.0


The Fluss pipeline sink currently ignores {{table-options}}?? ??configured in transform rules when automatically creating tables.

 

Transform rules propagate these options through {{{}Schema.options(){}}}. However, {{FlussMetaDataApplier}} only uses the global {{properties.table.*}} options from the sink configuration. The Paimon sink already merges both sources.

 

For example,
{code:java}
transform:
  - source-table: inventory.products
    projection: "*"
    table-options: table.replication.factor=2,table.log.ttl=7d

sink:
  type: fluss
  bootstrap.servers: localhost:9123
  properties.table.replication.factor: 3 {code}
Expected behavior:
 * The table created for inventory.products has a replication factor of 2 and a log retention time of 7 days.
 * Table-specific options override matching global sink options.
 * Other global options remain effective, and other tables are unaffected.

 

Actual behavior:
 * The table uses the global replication factor of 3.
 * The transform-defined log retention setting is ignored.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)