You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucenenet.apache.org by "Jeevananthan-23 (via GitHub)" <gi...@apache.org> on 2023/04/10 15:15:51 UTC

[GitHub] [lucenenet] Jeevananthan-23 opened a new issue, #817: Support for Concurrency Segments IndexSearch and parallel DrillSideways

Jeevananthan-23 opened a new issue, #817:
URL: https://github.com/apache/lucenenet/issues/817

   It could be great lucenenet support for [Better Segment To Thread Mapping Algorithm](https://issues.apache.org/jira/browse/LUCENE-8757) and [A parallel DrillSideways implementation](https://issues.apache.org/jira/browse/LUCENE-7588) for better concurrency implementation. I also like to know more about Lucenenet concurrency.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@lucenenet.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [lucenenet] Jeevananthan-23 commented on issue #817: Support for Concurrency Segments IndexSearch and parallel DrillSideways

Posted by "Jeevananthan-23 (via GitHub)" <gi...@apache.org>.
Jeevananthan-23 commented on issue #817:
URL: https://github.com/apache/lucenenet/issues/817#issuecomment-1519611247

   cc: @NightOwl888 , @laimis 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@lucenenet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [lucenenet] rclabo commented on issue #817: Support for Concurrency Segments IndexSearch and parallel DrillSideways

Posted by "rclabo (via GitHub)" <gi...@apache.org>.
rclabo commented on issue #817:
URL: https://github.com/apache/lucenenet/issues/817#issuecomment-1502346958

   In general, LuceneNET has great concurrency support.  The parallel DrillSideways implementation you mentioned is specifically for facets.  That particular feature wasn't added until Lucene 9.  As such it won't be added to LuceneNET 4.8.  
   
   However, it is currently hoped that after LuceneNET 4.8 has a production release, we will begin working on catching up LuceneNET to the latest version of Java Lucene.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@lucenenet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [lucenenet] Jeevananthan-23 commented on issue #817: Support for Concurrency Segments IndexSearch and parallel DrillSideways

Posted by "Jeevananthan-23 (via GitHub)" <gi...@apache.org>.
Jeevananthan-23 commented on issue #817:
URL: https://github.com/apache/lucenenet/issues/817#issuecomment-1502965652

   
   > In general, LuceneNET has great concurrency support. The parallel DrillSideways implementation you mentioned is specifically for facets. That particular feature wasn't added until Lucene 9. As such it won't be added to LuceneNET 4.8.
   
   parallel DrillSideways implementation is added back in Lucene 7 and Better Segment Thread Map algo is part of Lucene 9 expecting both the improvements added to LuceneNet 4.8. 
   > 
   > However, it is currently hoped that after LuceneNET 4.8 has a production release, we will begin working on catching up LuceneNET to the latest version of Java Lucene.
   
   Coming back to LuceneNet concurrency is not supported for Async also some of the concurrency works rely on Dedicated ThreadPool with the help of TaskScheduler APIs like IndexSearch, ConcurrentMergerScheduler and etc.., To handle this kind of scenario LuceneNet uses `LimitedConcurrencyLevelTaskScheduler.cs`.   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@lucenenet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org