You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by "Karl Wright (JIRA)" <ji...@apache.org> on 2013/01/15 17:24:14 UTC

[jira] [Comment Edited] (CONNECTORS-608) Solr connector gets socket timeouts on slow documents

    [ https://issues.apache.org/jira/browse/CONNECTORS-608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13553950#comment-13553950 ] 

Karl Wright edited comment on CONNECTORS-608 at 1/15/13 4:24 PM:
-----------------------------------------------------------------

Can you try increasing the connect timeout in your Solr connection, and see if that makes any difference?  The default is 60; try making it 300.

I think what is happening is that your Solr is extremely overloaded and simply cannot process the requests in a timely manner.  The other thing you may want to find out is how many Solr threads there are, and make sure you have no more Solr connections than there are Solr threads.



                
      was (Author: kwright@metacarta.com):
    Can you try increasing the connect timeout in your Solr connection, and see if that makes any difference?  The default is 60; try making it 300.


                  
> Solr connector gets socket timeouts on slow documents
> -----------------------------------------------------
>
>                 Key: CONNECTORS-608
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-608
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Lucene/SOLR connector
>    Affects Versions: ManifoldCF 1.1
>            Reporter: Karl Wright
>            Assignee: Karl Wright
>             Fix For: ManifoldCF 1.1
>
>
> The Solr connector fails on some documents with the following exception.
> {code}
>                 ERROR 2013-01-11 11:13:59,372 (Worker thread '36') - Exception tossed: Repeated service interruptions - failure processing document: Software caused connection abort: recv failed
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Repeated service interruptions - failure processing document: Software caused connection abort: recv failed
>                 at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:585)
> Caused by: java.net.SocketException: Software caused connection abort: recv failed
>                 at java.net.SocketInputStream.socketRead0(Native Method)
>                 at java.net.SocketInputStream.read(Unknown Source)
>                 at java.net.SocketInputStream.read(Unknown Source)
>                 at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
>                 at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
>                 at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
>                 at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
>                 at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:61)
>                 at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
>                 at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
>                 at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
>                 at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
>                 at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
>                 at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
>                 at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:716)
>                 at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:521)
>                 at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
>                 at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
>                 at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
>                 at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352)
>                 at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
>                 at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
>                 at org.apache.manifoldcf.agents.output.solr.HttpPoster$IngestThread.run(HttpPoster.java:742)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira