You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by rahul <as...@gmail.com> on 2012/12/18 14:24:05 UTC
Solr - memory leak in calling application
Hi,
I am using Solr 3.5 and I try to index my files from my c++ application
using libcurl. I've used the following code to index the data. In error
cases, it seems to throw error messages and the memory usage get increased
more & more, even upto 4 GB (in my c++ application).
********************************************
char* encodedPath = curl_easy_escape(curlPtr, filepath.c_str(),
filepath.length());
string encodedPathStr = encodedPath;
curl_free(encodedPath);
string url = "http://localhost:8080/solr/documents/update/extract?";
url.append("stream.file=");
url.append(encodedPathStr);
url.append("&stream.contentType=text/html;charset=utf-8&");
url.append("&stream.type=text/html&");
url.append("literal.myuniqueid", uniqueidstr);
url.append("literal.mypath", pathstr);
curl_easy_setopt(curlPtr, CURLOPT_URL, url.c_str());
********************************************
In some error cases, it throws an error,
Request(RequestHandlers.java:241)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1372)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
at
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Unknown Source)
) qui l'a emp+¬ch+® de satisfaire la requ+¬te.</u></p><HR size="1"
noshade="noshade">
Apache Tomcat/6.0.35
</body></html><html><head><title>Apache Tomcat/6.0.35 - Rapport
d'erreur</title> </head><body>
Etat HTTP 500 - D:\MyTest\23\test¦ü_05.12.xls_K_0 (The system cannot find
the file specified)
java.io.FileNotFoundException: D:\MyTest\23\test¦ü_05.12.xls_K_0 (The system
cannot find the file specified)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(Unknown Source)
at
org.apache.solr.common.util.ContentStreamBase$FileStream.getStream(ContentStreamBase.java:109)
at
org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:179)
at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at
org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:241)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1372)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
at
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Unknown Source)
<HR size="1" noshade="noshade"><p>*type* Rapport d'+®tat</p><p>*message*
<u>D:\MyTest\23\test¦ü_05.12.xls_K_0 (The system cannot find the file
specified)
********************************************
Can you please any one let us know, anyone face this issues?? Or any way to
resolve this memory consumption issue.
Thanks in advance,
--
View this message in context: http://lucene.472066.n3.nabble.com/Solr-memory-leak-in-calling-application-tp4027750.html
Sent from the Solr - User mailing list archive at Nabble.com.