You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by "knightting (via GitHub)" <gi...@apache.org> on 2025/04/18 12:19:47 UTC
[I] Data truncation: Invalid JSON text: "Invalid encoding in string." [shardingsphere]
knightting opened a new issue, #35221:
URL: https://github.com/apache/shardingsphere/issues/35221
## Bug Report
**For English only**, other languages will not accept.
Error reported when JSON data exists during incremental migration
Before report a bug, make sure you have:
- Searched open and closed [GitHub issues](https://github.com/apache/shardingsphere/issues).
- Read documentation: [ShardingSphere Doc](https://shardingsphere.apache.org/document/current/en/overview).
Please pay attention on issues you submitted, because we maybe need more details.
If no response anymore and we cannot reproduce it on current information, we will **close it**.
Please answer these questions before submitting your issue. Thanks!
### Which version of ShardingSphere did you use?
4.2.1
### Which project did you use? ShardingSphere-JDBC or ShardingSphere-Proxy?
ShardingSphere-Proxy
### Expected behavior
Incremental migration is executing normally
### Actual behavior
Incremental migration not executed
### Reason analyze (If you can)
Incremental migration may convert `\\r` to `\r` when reading binlog logs
### Steps to reproduce the behavior, such as: SQL to execute, sharding rule configuration, when exception occur etc.
1, setup proxy cluster use hell
2, create a source table with json colum
3, start migrate this table and complete migration all the rows
4, then insert a row with and row's json field value contains \ r
5, incremental migration should failed with error
### Example codes for reproduce this issue (such as a github link).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Data truncation: Invalid JSON text: "Invalid encoding in string." [shardingsphere]
Posted by "terrymanu (via GitHub)" <gi...@apache.org>.
terrymanu closed issue #35221: Data truncation: Invalid JSON text: "Invalid encoding in string."
URL: https://github.com/apache/shardingsphere/issues/35221
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Data truncation: Invalid JSON text: "Invalid encoding in string." [shardingsphere]
Posted by "RaigorJiang (via GitHub)" <gi...@apache.org>.
RaigorJiang commented on issue #35221:
URL: https://github.com/apache/shardingsphere/issues/35221#issuecomment-2816566105
Version 4.2.1 is too old. Please try the latest version (5.5.2) to see if the same problem occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Data truncation: Invalid JSON text: "Invalid encoding in string." [shardingsphere]
Posted by "anhuisunfei (via GitHub)" <gi...@apache.org>.
anhuisunfei commented on issue #35221:
URL: https://github.com/apache/shardingsphere/issues/35221#issuecomment-2816559893
> ## Bug Report
> **For English only**, other languages will not accept. Error reported when JSON data exists during incremental migration
>
> Before report a bug, make sure you have:
>
> * Searched open and closed [GitHub issues](https://github.com/apache/shardingsphere/issues).
> * Read documentation: [ShardingSphere Doc](https://shardingsphere.apache.org/document/current/en/overview).
>
> Please pay attention on issues you submitted, because we maybe need more details. If no response anymore and we cannot reproduce it on current information, we will **close it**.
>
> Please answer these questions before submitting your issue. Thanks!
>
> ### Which version of ShardingSphere did you use?
> 4.2.1
>
> ### Which project did you use? ShardingSphere-JDBC or ShardingSphere-Proxy?
> ShardingSphere-Proxy
>
> ### Expected behavior
> Incremental migration is executing normally
>
> ### Actual behavior
> Incremental migration not executed
>
> ### Reason analyze (If you can)
> Incremental migration may convert `\\r` to `\r` when reading binlog logs
>
> ### Steps to reproduce the behavior, such as: SQL to execute, sharding rule configuration, when exception occur etc.
> 1, setup proxy cluster use hell 2, create a source table with json colum 3, start migrate this table and complete migration all the rows 4, then insert a row with and row's json field value contains \ r 5, incremental migration should failed with error
>
> ### Example codes for reproduce this issue (such as a github link).
example json column value
```json
{"tag": "{\"keywords\": \"\"}", "role": "assistant", "tips": "很抱歉，暂无找到相关播放视频，\\r但是，你可以在各大视频网站（如腾讯视频、爱奇艺、B站、抖音等）搜索相关视频", "intent": "查找视频", "receiver": "user", "textContent": {"text": ""}, "audioContent": [], "videoContent": []}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Data truncation: Invalid JSON text: "Invalid encoding in string." [shardingsphere]
Posted by "syzpig (via GitHub)" <gi...@apache.org>.
syzpig commented on issue #35221:
URL: https://github.com/apache/shardingsphere/issues/35221#issuecomment-2815381004
ShardingSphere-jdbc对现有运行业务做mysql分库分表。然后采用ShardingSphere-proxy做数据同步迁移。在迁移数据过程中,先把历史全量数据同步过去了，mysql表中有个json字段。但在增量实时同步数据的时候，报这个字段Invalid encoding in string." at position 325 in value for column 't_aigc_62.chat_snapshot'这个问题，但全量同步没问题.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Data truncation: Invalid JSON text: "Invalid encoding in string." [shardingsphere]
Posted by "syzpig (via GitHub)" <gi...@apache.org>.
syzpig commented on issue #35221:
URL: https://github.com/apache/shardingsphere/issues/35221#issuecomment-2816566597
您好，我们试过5.4.0，发现还是不行
流光飞尽泪无痕
***@***.***
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Data truncation: Invalid JSON text: "Invalid encoding in string." [shardingsphere]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #35221:
URL: https://github.com/apache/shardingsphere/issues/35221#issuecomment-2836968595
There hasn't been any activity on this issue recently, and in order to prioritize active issues, it will be marked as stale.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Data truncation: Invalid JSON text: "Invalid encoding in string." [shardingsphere]
Posted by "syzpig (via GitHub)" <gi...@apache.org>.
syzpig commented on issue #35221:
URL: https://github.com/apache/shardingsphere/issues/35221#issuecomment-2816662668
> 版本 4.2.1 太旧了。请尝试最新版本 （5.5.2） 以查看是否出现相同的问题。
我们使用的5.4.0版本测试了一下，发现还不行，一样问题。请问5.5.2这个有什么大的版本修复嘛
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Data truncation: Invalid JSON text: "Invalid encoding in string." [shardingsphere]
Posted by "syzpig (via GitHub)" <gi...@apache.org>.
syzpig commented on issue #35221:
URL: https://github.com/apache/shardingsphere/issues/35221#issuecomment-2815384434
可能是json中的数据存在//引起的
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org