You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by rahul <as...@gmail.com> on 2012/12/18 14:24:05 UTC

Solr - memory leak in calling application

Hi,

I am using Solr 3.5 and I try to index my files from my c++ application
using libcurl. I've used the following code to index the data. In error
cases, it seems to throw error messages and the memory usage get increased
more & more, even upto 4 GB (in my c++ application).

********************************************

char* encodedPath = curl_easy_escape(curlPtr, filepath.c_str(),
filepath.length());
string encodedPathStr = encodedPath;
curl_free(encodedPath);

string url = "http://localhost:8080/solr/documents/update/extract?";
url.append("stream.file=");
url.append(encodedPathStr);
url.append("&stream.contentType=text/html;charset=utf-8&");
url.append("&stream.type=text/html&");
url.append("literal.myuniqueid", uniqueidstr);
url.append("literal.mypath", pathstr);

curl_easy_setopt(curlPtr, CURLOPT_URL, url.c_str());

********************************************

In some error cases, it throws an error,

Request(RequestHandlers.java:241)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1372)
        at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
        at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
        at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
        at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
        at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
        at
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
        at java.lang.Thread.run(Unknown Source)
) qui l'a emp+¬ch+® de satisfaire la requ+¬te.</u></p><HR size="1"
noshade="noshade">
Apache Tomcat/6.0.35
</body></html><html><head><title>Apache Tomcat/6.0.35 - Rapport
d'erreur</title> </head><body>
Etat HTTP 500 - D:\MyTest\23\test¦ü_05.12.xls_K_0 (The system cannot find
the file specified)

java.io.FileNotFoundException: D:\MyTest\23\test¦ü_05.12.xls_K_0 (The system
cannot find the file specified)
        at java.io.FileInputStream.open(Native Method)
        at java.io.FileInputStream.&lt;init&gt;(Unknown Source)
        at
org.apache.solr.common.util.ContentStreamBase$FileStream.getStream(ContentStreamBase.java:109)
        at
org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:179)
        at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
        at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
        at
org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:241)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1372)
        at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
        at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
        at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
        at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
        at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
        at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
        at
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
        at java.lang.Thread.run(Unknown Source)
<HR size="1" noshade="noshade"><p>*type* Rapport d'+®tat</p><p>*message*
<u>D:\MyTest\23\test¦ü_05.12.xls_K_0 (The system cannot find the file
specified)

********************************************

Can you please any one let us know, anyone face this issues?? Or any way to
resolve this memory consumption issue.

Thanks in advance,




--
View this message in context: http://lucene.472066.n3.nabble.com/Solr-memory-leak-in-calling-application-tp4027750.html
Sent from the Solr - User mailing list archive at Nabble.com.