You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by cwhi <ch...@gmail.com> on 2014/01/06 23:04:47 UTC

Seemingly arbitrary error on document adds to SolrCloud - "Server Error request: http://10.0.0.5:8443/solr/collection1/update?update.distrib=TOLEADER&distrib.from=..."

I'm adding dozens of documents every few minutes to a SolrCloud instance with
3 machines and ~ 25 million documents.  I'm starting to see issues where
adds are throwing these ugly errors that seem to indicate there might be
some issues with the nodes communicating to one another.  My posts are of
the following form, but with about 30 fields rather than just 1: 
<add>
<doc>
<field name="id">112370241</field>
</doc>
</add>

And here is the error that Solr is throwing:

null:org.apache.solr.common.SolrException: Server Error

request:
http://10.0.0.5:8443/solr/collection1/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F10.0.0.229%3A8443%2Fsolr%2Fcollection1%2F&wt=javabin&version=2
	at
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer$Runner.run(ConcurrentUpdateSolrServer.java:240)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)


What is the source of these errors, and how can I resolve them?



--
View this message in context: http://lucene.472066.n3.nabble.com/Seemingly-arbitrary-error-on-document-adds-to-SolrCloud-Server-Error-request-http-10-0-0-5-8443-solr-tp4109864.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Seemingly arbitrary error on document adds to SolrCloud - "Server Error request: http://10.0.0.5:8443/solr/collection1/update?update.distrib=TOLEADER&distrib.from=..."

Posted by cwhi <ch...@gmail.com>.
I agree, but that's the only information that was returned from the
interface.  I had a look through the logs and there isn't a deeper stack
trace, but I noticed these errors directly before that exception that might
be helpful:

ERROR - 2014-01-06 16:23:12.426; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 1
ERROR - 2014-01-06 16:23:12.926; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 2
ERROR - 2014-01-06 16:23:16.765; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 3
ERROR - 2014-01-06 16:23:17.385; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 4
ERROR - 2014-01-06 16:23:18.331; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 5
ERROR - 2014-01-06 16:23:18.945; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 6
ERROR - 2014-01-06 16:23:19.561; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 7
ERROR - 2014-01-06 16:23:20.173; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 8
ERROR - 2014-01-06 16:23:20.805; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 9
ERROR - 2014-01-06 16:23:21.631; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 10
ERROR - 2014-01-06 16:23:22.202; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 11
ERROR - 2014-01-06 16:23:22.811; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 12
ERROR - 2014-01-06 16:23:23.588; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 13
ERROR - 2014-01-06 16:23:24.197; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 14
ERROR - 2014-01-06 16:23:24.779; org.apache.solr.common.SolrException;
forwarding update to http://10.0.0.5:8443/solr/collection1/ failed -
retrying ... retries: 15
ERROR - 2014-01-06 16:23:25.990;
org.apache.solr.update.StreamingSolrServers$1; error
org.apache.solr.common.SolrException: Server Error

request:
http://10.0.0.5:8443/solr/collection1/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F10.0.0.229%3A8443%2Fsolr%2Fcollection1%2F&wt=javabin&version=2
	at
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer$Runner.run(ConcurrentUpdateSolrServer.java:240)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)



--
View this message in context: http://lucene.472066.n3.nabble.com/Seemingly-arbitrary-error-on-document-adds-to-SolrCloud-Server-Error-request-http-10-0-0-5-8443-solr-tp4109864p4109994.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Seemingly arbitrary error on document adds to SolrCloud - "Server Error request: http://10.0.0.5:8443/solr/collection1/update?update.distrib=TOLEADER&distrib.from=..."

Posted by Erick Erickson <er...@gmail.com>.
You need to give us a more complete stack trace to say anything
intelligent, what you provided doesn't give us much to go on.

Best,
Erick
On Jan 6, 2014 6:05 PM, "cwhi" <ch...@gmail.com> wrote:

> I'm adding dozens of documents every few minutes to a SolrCloud instance
> with
> 3 machines and ~ 25 million documents.  I'm starting to see issues where
> adds are throwing these ugly errors that seem to indicate there might be
> some issues with the nodes communicating to one another.  My posts are of
> the following form, but with about 30 fields rather than just 1:
> <add>
> <doc>
> <field name="id">112370241</field>
> </doc>
> </add>
>
> And here is the error that Solr is throwing:
>
> null:org.apache.solr.common.SolrException: Server Error
>
> request:
>
> http://10.0.0.5:8443/solr/collection1/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F10.0.0.229%3A8443%2Fsolr%2Fcollection1%2F&wt=javabin&version=2
>         at
>
> org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer$Runner.run(ConcurrentUpdateSolrServer.java:240)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> Source)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
>         at java.lang.Thread.run(Unknown Source)
>
>
> What is the source of these errors, and how can I resolve them?
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Seemingly-arbitrary-error-on-document-adds-to-SolrCloud-Server-Error-request-http-10-0-0-5-8443-solr-tp4109864.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>