You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "haruki-830 (via GitHub)" <gi...@apache.org> on 2026/07/13 07:23:47 UTC

[PR] [FLINK-40130][connect/paimon] Fix missing primary key type compatibility check of Paimon sink [flink-cdc]

haruki-830 opened a new pull request, #4471:
URL: https://github.com/apache/flink-cdc/pull/4471

   #### Summary
   
   This commit adds primary key type compatibility validation to the Flink CDC pipeline Paimon sink. When writing to an existing Paimon table, the sink now rejects incompatible upstream primary key types before entering the record coercion path, preventing unexpected conversion failures or incorrect behavior.
   
   #### Key Changes
   
   1. Primary Key Type Compatibility Validation
   - Added validation in `BucketAssignOperator` for existing Paimon tables.
   - Checks whether each existing Paimon primary key column is type-compatible with the corresponding upstream primary key column before record coercion.
   - Reports a clear error when the primary key type is incompatible.
   
   2. Compatibility Handling
   - Ignores nullability during the type compatibility check, so the validation focuses only on whether the primary key data types can be safely converted.
   - Keeps nullability enforcement in the normal write/table validation path.
   
   3. Test Coverage
   - Added coverage for incompatible primary key types.
   - Added coverage for compatible primary key type changes to ensure valid cases continue to work.
   
   #### JIRA Reference
   
   [https://issues.apache.org/jira/browse/FLINK-40130](url)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [FLINK-40130][connect/paimon] Fix missing primary key type compatibility check of Paimon sink [flink-cdc]

Posted by "lvyanquan (via GitHub)" <gi...@apache.org>.
lvyanquan merged PR #4471:
URL: https://github.com/apache/flink-cdc/pull/4471


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [FLINK-40130][connect/paimon] Fix missing primary key type compatibility check of Paimon sink [flink-cdc]

Posted by "haruki-830 (via GitHub)" <gi...@apache.org>.
haruki-830 commented on PR #4471:
URL: https://github.com/apache/flink-cdc/pull/4471#issuecomment-4955612901

   Hi @lvyanquan, could you please help review this PR when you have time? Thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org