You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/03/25 13:48:17 UTC

[GitHub] [incubator-doris] vagetablechicken opened a new issue #3199: check_rowset_id_in_unused_rowsets() is inefficient

vagetablechicken opened a new issue #3199: check_rowset_id_in_unused_rowsets() is inefficient
URL: https://github.com/apache/incubator-doris/issues/3199
 
 
   https://github.com/apache/incubator-doris/blob/f6374fa9a5a52135a85e4ecca23bad76d6c7a54b/be/src/olap/storage_engine.h#L299
   
   We have unused_rowsets here, the key of this map is RowSet::unique_id(), as follows.
   https://github.com/apache/incubator-doris/blob/08e4035a41bbff8301ba23d612376aeceb4b9913/be/src/olap/rowset/rowset.h#L208-L210
   
   But in the frequent func check_rowset_id_in_unused_rowsets(), we just iterate through the map.
   https://github.com/apache/incubator-doris/blob/f6374fa9a5a52135a85e4ecca23bad76d6c7a54b/be/src/olap/storage_engine.cpp#L918-L929
   
   so this func uses lots of CPU, the perf result is
   ![image](https://user-images.githubusercontent.com/24697960/77542879-d47ed400-6ee1-11ea-9bb1-5652a7e94a13.png)
   
   ## Solution
   
   We can use unordered_multimap, the key is rowset_id, value is pair<rowset_path, RowsetSharedPtr>.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] imay closed issue #3199: check_rowset_id_in_unused_rowsets() is inefficient

Posted by GitBox <gi...@apache.org>.
imay closed issue #3199: check_rowset_id_in_unused_rowsets() is inefficient
URL: https://github.com/apache/incubator-doris/issues/3199
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org