You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "airborne12 (via GitHub)" <gi...@apache.org> on 2023/04/25 05:04:18 UTC
[GitHub] [doris-thirdparty] airborne12 opened a new pull request, #59: [Improvement](index compaction) improve index compaction perf by introducing priority queue
airborne12 opened a new pull request, #59:
URL: https://github.com/apache/doris-thirdparty/pull/59
Description: This pull request addresses the issue of index compaction performance by introducing a priority queue to better manage the process. This update involves changes in IndexWriter.cpp, SegmentMergeInfo.cpp, and _SegmentMergeInfo.h. The key modifications include:
1. Replacing the previous approach for finding the smallest term and constructing a dest_idx_bitmap with a more efficient priority queue based approach.
2. Introducing a new postingQueue class to manage the document merging process.
3. Implementing a new DestDoc struct to store relevant information for each document in the merging process.
4. Refactoring the mergeTerms() method to use the new priority queue based approach.
These changes have resulted in improved performance during the index compaction process, leading to faster indexing and optimized resource usage.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris-thirdparty] adonis0147 merged pull request #59: [Improvement](index compaction) improve index compaction perf by introducing priority queue
Posted by "adonis0147 (via GitHub)" <gi...@apache.org>.
adonis0147 merged PR #59:
URL: https://github.com/apache/doris-thirdparty/pull/59
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org