You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by apoorvqwerty <ap...@unbxd.com> on 2017/04/21 13:04:49 UTC
Overseer session expires on multiple collection creation
Hi,
I am trying to create multiple collections with 2 shards and 2 replications
each.
After 5-6 successful
overseer status response for 5 creations shows 40k requests for
collection_operations=>am_i_leader which is a bit odd.
and I get
Am I not supposed to create 8-10 collections one after the other or is there
some configuration that I'm missing.
On creation of 8th collection I get following overseer session expired
exception
nExpiredException: KeeperErrorCode = Session expired for
/overseer/collection-queue-work/qnr-0000000024
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:322)
at
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:319)
at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:319)
at
org.apache.solr.cloud.OverseerTaskQueue.remove(OverseerTaskQueue.java:93)
at
org.apache.solr.cloud.OverseerTaskProcessor$Runner.markTaskComplete(OverseerTaskProcessor.java:525)
at
org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:483)
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
--
View this message in context: http://lucene.472066.n3.nabble.com/Overseer-session-expires-on-multiple-collection-creation-tp4331265.html
Sent from the Solr - User mailing list archive at Nabble.com.
RE: Overseer session expires on multiple collection creation
Posted by apoorvqwerty <ap...@unbxd.com>.
So i figured out the issue i was facing
https://issues.apache.org/jira/browse/SOLR-9803
<updateHandler class="solr.DirectUpdateHandler2">
<updateLog>
<str name="dir">${solr.ulog.dir:}</str>
<int
name="numVersionBuckets">${solr.ulog.numVersionBuckets:8388608}</int>
</updateLog>
i had a huge value set fir numVersioinBuckets which was causing memory leak
as stated in issue 9803
Changing to default value solved my problem
--
View this message in context: http://lucene.472066.n3.nabble.com/Overseer-session-expires-on-multiple-collection-creation-tp4331265p4333692.html
Sent from the Solr - User mailing list archive at Nabble.com.
RE: Overseer session expires on multiple collection creation
Posted by Markus Jelsma <ma...@openindex.io>.
Hi - any ideas on this one?
Many thanks,
Markus
-----Original message-----
> From:apoorvqwerty <ap...@unbxd.com>
> Sent: Friday 21st April 2017 15:04
> To: solr-user@lucene.apache.org
> Subject: Overseer session expires on multiple collection creation
>
> Hi,
> I am trying to create multiple collections with 2 shards and 2 replications
> each.
> After 5-6 successful
> overseer status response for 5 creations shows 40k requests for
> collection_operations=>am_i_leader which is a bit odd.
> and I get
> Am I not supposed to create 8-10 collections one after the other or is there
> some configuration that I'm missing.
> On creation of 8th collection I get following overseer session expired
> exception
>
> nExpiredException: KeeperErrorCode = Session expired for
> /overseer/collection-queue-work/qnr-0000000024
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
> at
> org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:322)
> at
> org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:319)
> at
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:319)
> at
> org.apache.solr.cloud.OverseerTaskQueue.remove(OverseerTaskQueue.java:93)
> at
> org.apache.solr.cloud.OverseerTaskProcessor$Runner.markTaskComplete(OverseerTaskProcessor.java:525)
> at
> org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:483)
> at
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Overseer-session-expires-on-multiple-collection-creation-tp4331265.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>