You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "newsuperchao (via GitHub)" <gi...@apache.org> on 2023/06/28 11:01:13 UTC

[GitHub] [incubator-paimon] newsuperchao opened a new issue, #1447: [Feature] MySQL CDC to Paimon: Length validation issue for char/varchar types with special characters

newsuperchao opened a new issue, #1447:
URL: https://github.com/apache/incubator-paimon/issues/1447

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   I am using Flink CDC to capture changes from a MySQL database and write into a Paimon table. I'm facing an issue related to length validation for `char` and `varchar` types.
   
   When the fields contain special characters or garbled characters, Paimon's field validation fails due to mismatched lengths. The system interprets this as a schema change and keeps waiting for an updated schema to be passed in, blocking the process indefinitely.
   
   This can cause significant problems when dealing with real-world data that often includes special or unexpected characters.
   
   I'm wondering if there's a way to either disable this validation, or make it optional specifically for these field types (`char`, `varchar`). This would improve the flexibility and robustness of the CDC integration with Paimon.
   
   Thanks for considering this issue.
   
   
   ### Solution
   
   The system should either ignore length mismatches for `char` and `varchar` types, or provide an option to disable this validation.
   
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] JingsongLi commented on issue #1447: [Feature] MySQL CDC to Paimon: Length validation issue for char/varchar types with special characters

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on issue #1447:
URL: https://github.com/apache/incubator-paimon/issues/1447#issuecomment-1627970166

   We can provide a wide schema mode, such as converting all char and varchar to String no matter what


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] JingsongLi closed issue #1447: [Feature] MySQL CDC to Paimon: Length validation issue for char/varchar types with special characters

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi closed issue #1447: [Feature] MySQL CDC to Paimon: Length validation issue for char/varchar types with special characters
URL: https://github.com/apache/incubator-paimon/issues/1447


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org