[jira] [Assigned] (FLINK-41058) Fluss pipeline sink ignores table options defined in transform rules

["Hongshun Wang (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hongshun Wang reassigned FLINK-41058:
-------------------------------------

    Assignee: Hongshun Wang

> Fluss pipeline sink ignores table options defined in transform rules
> --------------------------------------------------------------------
>
>                 Key: FLINK-41058
>                 URL: https://issues.apache.org/jira/browse/FLINK-41058
>             Project: Flink
>          Issue Type: New Feature
>          Components: Flink CDC
>    Affects Versions: cdc-3.7.0
>            Reporter: Hongshun Wang
>            Assignee: Hongshun Wang
>            Priority: Major
>             Fix For: cdc-3.8.0
>
>
> The Fluss pipeline sink currently ignores {{table-options}}?? ??configured in transform rules when automatically creating tables.
>  
> Transform rules propagate these options through {{{}Schema.options(){}}}. However, {{FlussMetaDataApplier}} only uses the global {{properties.table.*}} options from the sink configuration. The Paimon sink already merges both sources.
>  
> For example,
> {code:java}
> transform:
>   - source-table: inventory.products
>     projection: "*"
>     table-options: table.replication.factor=2,table.log.ttl=7d
> sink:
>   type: fluss
>   bootstrap.servers: localhost:9123
>   properties.table.replication.factor: 3 {code}
> Expected behavior:
>  * The table created for inventory.products has a replication factor of 2 and a log retention time of 7 days.
>  * Table-specific options override matching global sink options.
>  * Other global options remain effective, and other tables are unaffected.
>  
> Actual behavior:
>  * The table uses the global replication factor of 3.
>  * The transform-defined log retention setting is ignored.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)