You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/04/10 13:59:23 UTC
[GitHub] [incubator-doris] liutang123 opened a new issue #3299:
start_trash_sweep holds tablet map write lock for a long time
liutang123 opened a new issue #3299: start_trash_sweep holds tablet map write lock for a long time
URL: https://github.com/apache/incubator-doris/issues/3299
In our cluster, there are many stream load jobs.
We found that these jobs slow down periodically.
By add logs, we found that TabletManager::start_trash_sweep will take write lock for a long time.
The sample logs are as follows:
```
W0409 19:32:07.205687 13863 tablet_manager.cpp:1085] start_trash_sweep hold tablet lock 10 133861us.
W0409 19:32:08.947813 13863 tablet_manager.cpp:1085] start_trash_sweep hold tablet lock 11 1741955us.
W0409 19:32:08.947955 13891 tablet_manager.cpp:678] TabletManager::get_tablet tablet_map_lock11533467 use 1678416us
W0409 19:32:09.185710 13863 tablet_manager.cpp:1085] start_trash_sweep hold tablet lock 12 237786us.
W0409 19:32:09.462677 13863 tablet_manager.cpp:1085] start_trash_sweep hold tablet lock 14 184842us.
W0409 19:32:11.698195 13863 tablet_manager.cpp:1085] start_trash_sweep hold tablet lock 15 2235442us.
```
We set `tablet_map_shard_size` to 16, this function will holds each lock about 2 seconds.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] liutang123 closed issue #3299: start_trash_sweep
holds tablet map write lock for a long time
Posted by GitBox <gi...@apache.org>.
liutang123 closed issue #3299: start_trash_sweep holds tablet map write lock for a long time
URL: https://github.com/apache/incubator-doris/issues/3299
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org