[GitHub] [incubator-doris] hxianshun commented on issue #5557: 1、mysql开启binlog，写入kafka消息队列。但是doris 无法解析binlog的数据，有什么好的办法做mysql实时同步到doris吗？

[GitBox <gi...@apache.org>]

hxianshun commented on issue #5557:
URL: https://github.com/apache/incubator-doris/issues/5557#issuecomment-804677866


   > Reason: actual column number is less than schema column number. actual number: 1 sep: , schema number: 4; . src line: [{"data":[{"id":"26","name":"222","status":"22","date":"0000-00-00"}],"database":"test","es":1616467578000,"id":7,"isDdl":false,"mysqlType":{"id":"bigint(20)","name":"varchar(45)","status":"varchar(45)","date":"date"},"old":null,"pkNames":["id"],"sql":"","sqlType":{"id":-5,"name":12,"status":12,"date":91},"table":"canal_test","ts":1616467578825,"type":"INSERT"}];
   
   u can use flink to preprocess your json data, and write into a new topic, then use Routine load to consume data.
   
   你可以用flink预处理下json数据，处理成doris认识的数据格式，然后写进一个新topic，再使用doris的Routine load导入 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org