[jira] [Commented] (CONNECTORS-897) IO exception during indexing: missing CR

["Karl Wright (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CONNECTORS-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117110#comment-14117110 ] 

Karl Wright commented on CONNECTORS-897:
----------------------------------------

Turns out problem was insufficient Solr memory:

{quote}
 i could verify that different documents failed each time previously as i could check in simple history.

After your suggestion, we moved our setup to higher platform having 12 G of RAM with more processing powers as previously we could see "Out of memory" error as well as heap issues. After movement, i could not see this issue again till now but i have put system under observation for any surprises.
{quote}

> IO exception during indexing: missing CR
> ----------------------------------------
>
>                 Key: CONNECTORS-897
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-897
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: CMIS connector
>    Affects Versions: ManifoldCF 1.4.1
>         Environment: Windows 7 with bundled mcf 1.4.1, solr 4.6
>            Reporter: lalit
>
> Hi,
> I have downloaded mcf(ManifoldCF) 1.4.1 source from tag site & build it as per instructions. Now i am using cmis connector to connect to alfresco repo & using solr as output channel.
> When i am crawling alfresco repo for indexing into solr, whenever mcf crawls any media such as image or video, i am getting this error into mcf logs. I have also added adm4.1.jar & xmpcore.jar into ..\contrib\extraction\lib.
> ERROR 2014-02-20 12:50:45,251 (Worker thread '3') - Exception tossed: Repeated service interruptions - failure processing document: missing CR
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Repeated service interruptions - failure processing document: missing CR
> 	at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:586)
> Caused by: java.io.IOException: missing CR
> 	at sun.net.www.http.ChunkedInputStream.processRaw(Unknown Source)
> 	at sun.net.www.http.ChunkedInputStream.readAheadBlocking(Unknown Source)
> 	at sun.net.www.http.ChunkedInputStream.readAhead(Unknown Source)
> 	at sun.net.www.http.ChunkedInputStream.read(Unknown Source)
> 	at java.io.FilterInputStream.read(Unknown Source)
> 	at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(Unknown Source)
> 	at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(Unknown Source)
> 	at org.apache.http.entity.mime.content.InputStreamBody.writeTo(InputStreamBody.java:69)
> 	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpMultipart.doWriteTo(ModifiedHttpMultipart.java:211)
> 	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpMultipart.writeTo(ModifiedHttpMultipart.java:229)
> 	at org.apache.manifoldcf.agents.output.solr.ModifiedMultipartEntity.writeTo(ModifiedMultipartEntity.java:186)
> 	at org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:98)
> 	at org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:108)
> 	at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:122)
> 	at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:271)
> 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:197)
> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:257)
> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
> 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:715)
> 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:520)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
> 	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpSolrServer.request(ModifiedHttpSolrServer.java:291)
> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
> 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
> 	at org.apache.manifoldcf.agents.output.solr.HttpPoster$IngestThread.run(HttpPoster.java:919)
> Regards,
> Lalit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)