[GitHub] [skywalking] hanahmily commented on issue #9417: [Index] Support full text searching

[GitBox <gi...@apache.org>]

hanahmily commented on issue #9417:
URL: https://github.com/apache/skywalking/issues/9417#issuecomment-1223335902

   After some investigation, https://github.com/blugelabs/bluge is an ideal option to support this requirement. Furthermore, we could replace the current primitive inverted index with it. Bluge supports several analyzers and data types that converted our use cases. 
   
   But its writer is a batch-style interface. We have to tweak current index pipeline to support the batch mode. We have found the index pipeline is a blocker in the writing process: The single goroutine is blocking many writing goroutines. The new pipeline implementation would introduce a worker pool and batch mode to improve performance.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org