You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/03/28 14:31:03 UTC
[GitHub] [incubator-doris] caiconghui opened a new issue #3223:
commitAndPublishTransaction function sometimes may has poor performance
caiconghui opened a new issue #3223: commitAndPublishTransaction function sometimes may has poor performance
URL: https://github.com/apache/incubator-doris/issues/3223
2020-03-27 21:13:25,079 WARN 949 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55403103 cost 5022 ms
2020-03-27 21:13:25,117 WARN 1593 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55402986 cost 5024 ms
2020-03-27 21:13:25,134 WARN 943 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55403105 cost 5005 ms
2020-03-27 21:13:25,325 WARN 1022 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55403118 cost 5031 ms
2020-03-27 21:13:25,398 WARN 1341 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55403003 cost 5011 ms
2020-03-27 21:13:25,450 WARN 907 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55403005 cost 5018 ms
2020-03-27 21:13:25,452 WARN 1581 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55403019 cost 5009 ms
2020-03-27 21:13:25,455 WARN 1282 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55402953 cost 5005 ms
2020-03-27 21:13:25,461 WARN 970 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55403059 cost 5002 ms
2020-03-27 21:13:25,488 WARN 1231 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55403119 cost 5014 ms
2020-03-27 21:13:25,495 WARN 1197 [GlobalTransactionMgr.commitAndPublishTransaction():527] commit and publish transaction 55403122 cost 5001 ms
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] caiconghui commented on issue #3223:
commitAndPublishTransaction function sometimes may has poor performance
Posted by GitBox <gi...@apache.org>.
caiconghui commented on issue #3223: commitAndPublishTransaction function sometimes may has poor performance
URL: https://github.com/apache/incubator-doris/issues/3223#issuecomment-605455630
and we find the root cause is be publish txn slowly, with the following log:
2020-03-28 11:04:44,835 DEBUG 27 [AgentTaskQueue.addTask():70] add task: type[PUBLISH_VERSION], backend[63831820], signature[55597313]
2020-03-28 11:04:51,099 DEBUG 11764 [AgentTaskQueue.removeTask():97] remove task: type[PUBLISH_VERSION], backend[63831820], signature[55597313]
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] caiconghui commented on issue #3223:
commitAndPublishTransaction function sometimes may has poor performance
Posted by GitBox <gi...@apache.org>.
caiconghui commented on issue #3223: commitAndPublishTransaction function sometimes may has poor performance
URL: https://github.com/apache/incubator-doris/issues/3223#issuecomment-605455680
I0328 11:04:47.570737 89492 engine_publish_version_task.cpp:34] begin to process publish version. transaction_id=55597171
I0328 11:04:47.596947 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907283, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:47.605113 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907283.380491756.6c4129c851765910-de8218fa34238d9e, transaction_id=55597171, version=11809, res=0
I0328 11:04:47.605124 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907351, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:48.168877 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907351.380491756.424c83ca757f72fd-199b58eb32c74c96, transaction_id=55597171, version=11809, res=0
I0328 11:04:48.168896 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907395, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:48.205399 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907395.380491756.ec4dd46f2eb59c76-7c4c7fffd832bf99, transaction_id=55597171, version=11809, res=0
I0328 11:04:48.205412 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907423, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:48.264698 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907423.380491756.814a23c27cdf354a-342dedf0ace2fd8f, transaction_id=55597171, version=11809, res=0
I0328 11:04:48.264710 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907443, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:48.323990 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907443.380491756.b8439d7f613e7a5b-db76aa77d4a5b2ac, transaction_id=55597171, version=11809, res=0
I0328 11:04:48.324007 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907455, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:48.576158 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907455.380491756.4e4f5612d7ee5cb6-f7c60e488187dcbe, transaction_id=55597171, version=11809, res=0
I0328 11:04:48.576196 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907503, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:48.894104 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907503.380491756.8f484bab4e316bc9-4bab77941770a3a2, transaction_id=55597171, version=11809, res=0
I0328 11:04:48.894120 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907567, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:49.021507 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907567.380491756.d24c98f62d203d16-d3d2afc801cd51ad, transaction_id=55597171, version=11809, res=0
I0328 11:04:49.021522 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907771, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:49.167023 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907771.380491756.3d484b14913c3e08-54d28d43c3e08b8d, transaction_id=55597171, version=11809, res=0
I0328 11:04:49.167037 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907935, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:49.736409 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907935.380491756.2e4a28cfff704050-353fe8f6dcce928b, transaction_id=55597171, version=11809, res=0
I0328 11:04:49.736424 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907955, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:49.785454 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907955.380491756.f243a34ef075987e-1ff97db7c07546a5, transaction_id=55597171, version=11809, res=0
I0328 11:04:49.785471 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87907983, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:49.809389 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87907983.380491756.fe43a7add10ee798-efd4817ba7a413b3, transaction_id=55597171, version=11809, res=0
I0328 11:04:49.809407 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87908047, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:49.978107 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87908047.380491756.bb4e31f720a52469-f4090c08b13ead96, transaction_id=55597171, version=11809, res=0
I0328 11:04:49.978122 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87908259, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:50.026542 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87908259.380491756.a84a5288adc15708-ebc72dbf6476cb97, transaction_id=55597171, version=11809, res=0
I0328 11:04:50.026556 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87908403, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:50.049088 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87908403.380491756.7f449e14b1aea771-e9e95e0b34103cb0, transaction_id=55597171, version=11809, res=0
I0328 11:04:50.049103 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87908475, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:50.080816 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87908475.380491756.39432addc2624e26-b9a587f1015d5bbe, transaction_id=55597171, version=11809, res=0
I0328 11:04:50.080844 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87908639, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:50.276520 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87908639.380491756.fc47775fd4f6c234-fa1cb75db3ac8d95, transaction_id=55597171, version=11809, res=0
I0328 11:04:50.276533 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87908711, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:50.725987 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87908711.380491756.8e48d2dbfe321e33-b865607d5741c7a8, transaction_id=55597171, version=11809, res=0
I0328 11:04:50.726001 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87908727, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:50.982319 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87908727.380491756.c9495cf7730fe942-4999b35d3143b2be, transaction_id=55597171, version=11809, res=0
I0328 11:04:50.982337 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87909091, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:51.231626 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87909091.380491756.0e47a196afe196ee-1a7a0667f6f4c1b9, transaction_id=55597171, version=11809, res=0
I0328 11:04:51.231637 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87909251, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:51.235010 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87909251.380491756.c340dc08bb34aa39-80c6393550dc61a3, transaction_id=55597171, version=11809, res=0
I0328 11:04:51.235025 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87909339, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:51.241415 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87909339.380491756.a8475ba6a0428b31-9f52d2a6400378be, transaction_id=55597171, version=11809, res=0
I0328 11:04:51.241427 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87909383, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:51.249001 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87909383.380491756.9b4d24161064ed6c-d5c3b166e1fdb7b2, transaction_id=55597171, version=11809, res=0
I0328 11:04:51.249012 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87909571, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:51.260076 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87909571.380491756.f24015efd531a7c8-fc14c8ff31dd7684, transaction_id=55597171, version=11809, res=0
I0328 11:04:51.260087 89492 engine_publish_version_task.cpp:66] begin to publish version on tablet. tablet_id=87909691, schema_hash=380491756, version=11809, version_hash=2513661334374504686, transaction_id=55597171
I0328 11:04:51.280652 89492 engine_publish_version_task.cpp:116] publish version successfully on tablet. tablet=87909691.380491756.e447ba6bcd33da2b-c9013ff17e22f786, transaction_id=55597171, version=11809, res=0
I0328 11:04:51.280680 89492 engine_publish_version_task.cpp:153] finish to publish version on transaction.transaction_id=55597171, error_tablet_size=0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] caiconghui closed issue #3223:
commitAndPublishTransaction function sometimes may has poor performance
Posted by GitBox <gi...@apache.org>.
caiconghui closed issue #3223: commitAndPublishTransaction function sometimes may has poor performance
URL: https://github.com/apache/incubator-doris/issues/3223
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org