Doc add limit problem, old issue

[Michael Imbeault <mi...@sympatico.ca>]

Old issue (see 
http://www.mail-archive.com/solr-user@lucene.apache.org/msg00651.html), 
but I'm experiencing the same exact thing on windows xp, latest tomcat. 
I noticed that the tomcat process gobbles memory (10 megs a second 
maybe) and then jams at 125 megs. Can't find a fix yet. I'm using a php 
interface and curl to post my xml, one document at a time, and commit 
every 100 document. Indexing 30000 docs, it hangs at maybe 5000. Anyone 
got an idea on this one? It would be helpful. I may try to switch to 
jetty tomorrow if nothing works :(

-- 
Michael Imbeault
CHUL Research Center (CHUQ)
2705 boul. Laurier
Ste-Foy, QC, Canada, G1V 4G2
Tel: (418) 654-2705, Fax: (418) 654-2212

Re: Doc add limit problem, old issue

[Michael Imbeault <mi...@sympatico.ca>]

Fixed my problem, the implementation of solPHP was faulty. It was 
sending one doc at a time (one curl per doc) and the system quickly ran 
out of resources. Now I modified it to send by batch (1000 at a time) 
and everything is #1!

Michael Imbeault wrote:
> Old issue (see 
> http://www.mail-archive.com/solr-user@lucene.apache.org/msg00651.html), 
> but I'm experiencing the same exact thing on windows xp, latest 
> tomcat. I noticed that the tomcat process gobbles memory (10 megs a 
> second maybe) and then jams at 125 megs. Can't find a fix yet. I'm 
> using a php interface and curl to post my xml, one document at a time, 
> and commit every 100 document. Indexing 30000 docs, it hangs at maybe 
> 5000. Anyone got an idea on this one? It would be helpful. I may try 
> to switch to jetty tomorrow if nothing works :(
>
-- 

Michael Imbeault
CHUL Research Center (CHUQ)
2705 boul. Laurier
Ste-Foy, QC, Canada, G1V 4G2
Tel: (418) 654-2705, Fax: (418) 654-2212