You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "zheng_shengsheng (Jira)" <ji...@apache.org> on 2024/07/16 06:45:00 UTC
[jira] [Created] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to the target table.
zheng_shengsheng created FLINK-35852:
----------------------------------------
Summary: When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to the target table.
Key: FLINK-35852
URL: https://issues.apache.org/jira/browse/FLINK-35852
Project: Flink
Issue Type: Bug
Components: Flink CDC
Affects Versions: cdc-3.1.1
Environment: flink-1.18.0、 flink-cdc-3.1.1、mysql-5.7.43、Doris-2.0.6、CentOS Linux release 8.5.2111
Reporter: zheng_shengsheng
Attachments: sp20240716_144157_519.png, sp20240716_144344_710.png
When I use CDC's yaml mode to collect MySQL data to Doris, I use the latest supported transform feature.
Finally, I found that the database table in MySQL collected and the decimal(10,2) type fields in the Mysql source table were automatically converted into decimal(19,0) in Doris, and then the value size became 100 times the original size. As follows
The core part of yaml is as follows:
{code:java}
// code placeholder
source:
type: mysql
hostname: node2
port: 3306
username: ****
password: ****
tables: sys_canteen_consume_conf,sys_canteen_consume_rec,sys_order_course,
server-id: 5513
connectionTimeZone: GMT+8
scan.startup.mode: initialsink:
type: doris
fenodes: node3:8030
username: admin
password: ****
table.create.properties.light_schema_change: true
table.create.properties.replication_num: 1transform:
- source-table: jeecg-boot2.sys_\.*
projection: concat('LYDB2','') as tenant_code, *
primary-keys: tenant_code,id
- source-table: jeecg-boot2.sys_user_depart
projection: concat('LYDB2','') as tenant_code, *
primary-keys: tenant_code,ID pipeline:
name: test,server-id-5513,flinkCDC-3.1.1
parallelism: 1 {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)