You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2021/12/14 05:58:26 UTC
[GitHub] [incubator-doris] weilianchang opened a new issue #7390: binlog load 同步到doris，可以insert和delete，但是无法update[Bug]
weilianchang opened a new issue #7390:
URL: https://github.com/apache/incubator-doris/issues/7390
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Version
0.15
### What's Wrong?
通过binlog load 同步doris，新增和删除好用，但是更新失败，日志如下：
2021-12-14 13:53:28,336 INFO (Thread-92|739) [DatabaseTransactionMgr.beginTransaction():304] begin transaction: txn id 102037 with label label_job43043_channel43044_db11001_tbl43029_batch425_1639461208336 from coordinator FE: 192.168.176.139, listner id: -1
2021-12-14 13:53:28,342 INFO (Thread-92|739) [CanalSyncChannel.beginTxn():162] begin txn in channel 43044, table: testdoris, label:label_job43043_channel43044_db11001_tbl43029_batch425_1639461208336, txn id: 102037
2021-12-14 13:53:28,342 INFO (Thread-92|739) [CanalUtils.printRow():122]
----------------> binlog[mysql-bin.000002:50412866] , name[vwmobility,testdoris] , eventType : UPDATE , executeTime : 1639461208000(2021-12-14 13:53:28) , gtid : () , delay : 342 ms
2021-12-14 13:53:28,342 INFO (Thread-92|739) [CanalUtils.printColumn():166] value : ffffdddddddddddd type=varchar(50) update=true
--- 以上日志可以看到，从canal server 中已经获取更新的列，但是无法更新成功
2021-12-14 13:53:30,089 INFO (thrift-server-pool-9|198) [DatabaseTransactionMgr.abortTransaction():1019] abort transaction: TransactionState. transaction id: 102037, label: label_job43043_channel43044_db11001_tbl43029_batch425_1639461208336, db id: 11001, table id list: 43029, callback id: -1, coordinator: FE: 192.168.176.139, transaction status: ABORTED, error replicas num: 0, replica ids: , prepare time: 1639461208336, commit time: -1, finish time: 1639461210085, reason: too many filtered rows successfully
-- 会中断事务处理，原因是: too many filtered rows successfully
### What You Expected?
从mysql同步到doris，可以进行更新操作
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] aihai commented on issue #7390: [Bug] binlog load 同步到doris，可以insert和delete，但是无法update
Posted by GitBox <gi...@apache.org>.
aihai commented on issue #7390:
URL: https://github.com/apache/incubator-doris/issues/7390#issuecomment-995399830
http://doris.incubator.apache.org/master/zh-CN/administrator-guide/load-data/stream-load-manual.html#%E5%AF%BC%E5%85%A5%E4%BB%BB%E5%8A%A1%E5%8F%82%E6%95%B0
max_filter_ratio
It may be the reason.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org