[jira] [Comment Edited] (CONNECTORS-897) IO exception during indexing: missing CR

["Karl Wright (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CONNECTORS-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13908065#comment-13908065 ] 

Karl Wright edited comment on CONNECTORS-897 at 2/21/14 7:32 AM:
-----------------------------------------------------------------

Solr 4.6 no longer uses Jetty and has built-in (configurable) restrictions on the size of the document that you can post to it.  I'd recommend doing some research to find out what that size is. A 1MB default limit is not unlikely.  The other question to ask is whether you get any value out of images or movies, etc -- if not, it might be a good idea to configure your solr connection to reject documents of content types you can't use anyway.


was (Author: kwright@metacarta.com):
Solr 4.6 no longer uses Jetty and has built-in (configurable) restrictions on the size of the document that you can post to it.  I'd recommend doing some research to find out what that size is. A 1MB default limit is not unlikely.

> IO exception during indexing: missing CR
> ----------------------------------------
>
>                 Key: CONNECTORS-897
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-897
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: CMIS connector
>    Affects Versions: ManifoldCF 1.4.1
>         Environment: Windows 7 with bundled mcf 1.4.1, solr 4.6
>            Reporter: lalit
>
> Hi,
> I have downloaded mcf(ManifoldCF) 1.4.1 source from tag site & build it as per instructions. Now i am using cmis connector to connect to alfresco repo & using solr as output channel.
> When i am crawling alfresco repo for indexing into solr, whenever mcf crawls any media such as image or video, i am getting this error into mcf logs. I have also added adm4.1.jar & xmpcore.jar into ..\contrib\extraction\lib.
> ERROR 2014-02-20 12:50:45,251 (Worker thread '3') - Exception tossed: Repeated service interruptions - failure processing document: missing CR
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Repeated service interruptions - failure processing document: missing CR
> 	at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:586)
> Caused by: java.io.IOException: missing CR
> 	at sun.net.www.http.ChunkedInputStream.processRaw(Unknown Source)
> 	at sun.net.www.http.ChunkedInputStream.readAheadBlocking(Unknown Source)
> 	at sun.net.www.http.ChunkedInputStream.readAhead(Unknown Source)
> 	at sun.net.www.http.ChunkedInputStream.read(Unknown Source)
> 	at java.io.FilterInputStream.read(Unknown Source)
> 	at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(Unknown Source)
> 	at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(Unknown Source)
> 	at org.apache.http.entity.mime.content.InputStreamBody.writeTo(InputStreamBody.java:69)
> 	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpMultipart.doWriteTo(ModifiedHttpMultipart.java:211)
> 	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpMultipart.writeTo(ModifiedHttpMultipart.java:229)
> 	at org.apache.manifoldcf.agents.output.solr.ModifiedMultipartEntity.writeTo(ModifiedMultipartEntity.java:186)
> 	at org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:98)
> 	at org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:108)
> 	at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:122)
> 	at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:271)
> 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:197)
> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:257)
> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
> 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:715)
> 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:520)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
> 	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpSolrServer.request(ModifiedHttpSolrServer.java:291)
> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
> 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
> 	at org.apache.manifoldcf.agents.output.solr.HttpPoster$IngestThread.run(HttpPoster.java:919)
> Regards,
> Lalit.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)