You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "Rüdiger Kurz (Jira)" <ji...@apache.org> on 2019/11/04 11:33:00 UTC
[jira] [Comment Edited] (SOLR-11208) Usage SynchronousQueue in
Executors prevent large scale operations
[ https://issues.apache.org/jira/browse/SOLR-11208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966577#comment-16966577 ]
Rüdiger Kurz edited comment on SOLR-11208 at 11/4/19 11:32 AM:
---------------------------------------------------------------
I've a similar problem here. Running 27 collections (1 shard with 3 replicas per collection) on a kubernetes based OpenShift cluster. Executing:
{code:java}
curl https://<solr-host>/solr/admin/collections?action=DELETENODE&node=10.130.13.61:8983_solr{code}
results in this [^response.json]
running on 7.7.1
was (Author: rukurz):
I've a similar problem here. Running 27 collections (1 shard with 3 replicas per collection) on a kubernetes based OpenShift cluster. Executing:
{code:java}
curl https://<solr-host>/solr/admin/collections?action=DELETENODE&node=10.130.13.61:8983_solr{code}
results in this [^response.json]
> Usage SynchronousQueue in Executors prevent large scale operations
> ------------------------------------------------------------------
>
> Key: SOLR-11208
> URL: https://issues.apache.org/jira/browse/SOLR-11208
> Project: Solr
> Issue Type: Bug
> Affects Versions: 6.6
> Reporter: Björn Häuser
> Priority: Major
> Attachments: response.json
>
>
> I am not sure where to start with this one.
> I tried to post this already on the mailing list: https://mail-archives.apache.org/mod_mbox/lucene-solr-user/201708.mbox/%3c48C49426-33A2-4D79-AE26-A4515B8F834E@gmail.com%3e
> In short: the usage of a SynchronousQueue as the workQeue prevents more tasks than max threads.
> For example, taken from OverseerCollectionMessageHandler:
> {code:java}
> ExecutorService tpe = new ExecutorUtil.MDCAwareThreadPoolExecutor(5, 10, 0L, TimeUnit.MILLISECONDS,
> new SynchronousQueue<>(),
> new DefaultSolrThreadFactory("OverseerCollectionMessageHandlerThreadFactory"));
> {code}
> This Executor is used when doing a REPLACENODE (= ADDREPLICA) command. When the node has more than 10 collections this will fail with the mentioned java.util.concurrent.RejectedExecutionException.
> I am also not sure how to fix this. Just replacing the queue with a different implementation feels wrong to me or could cause unwanted side behaviour.
> Thanks
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org