You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-dev@lucene.apache.org by "John Smith (JIRA)" <ji...@apache.org> on 2008/06/17 21:17:45 UTC
[jira] Issue Comment Edited: (SOLR-600) XML parser stops working
under heavy load
[ https://issues.apache.org/jira/browse/SOLR-600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605696#action_12605696 ]
wshs edited comment on SOLR-600 at 6/17/08 12:15 PM:
-----------------------------------------------------------
Java(TM) SE Runtime Environment (build pxa6460sr1-20080416_01(SR1))
IBM J9 VM (build 2.4, J2RE 1.6.0 IBM J9 2.4 Linux amd64-64 jvmxa6460-20080415_18762 (JIT enabled, AOT enabled)
J9VM - 20080415_018762_LHdSMr
JIT - r9_20080415_1520
GC - 20080415_AA)
JCL - 20080412_01
Only thing I can think of to test is to push 60,000 to 100,000 updates in the span of a few minutes onto a single machine. If I keep the updates under 30,000 per hour, it runs fine. Due to the sensitivity of the data, I cannot provide a copy of example data or schema, but I can provide analogs if needed. I can also provide scrubbed config files as well. I'm afraid I lack the knowledge to make use of the Jetty.
Edit: System has 8 cores, 32 gigs of memory. Tomcat is not explicitly configured to use multiple cores, however, since it's never been needed.
was (Author: wshs):
Java(TM) SE Runtime Environment (build pxa6460sr1-20080416_01(SR1))
IBM J9 VM (build 2.4, J2RE 1.6.0 IBM J9 2.4 Linux amd64-64 jvmxa6460-20080415_18762 (JIT enabled, AOT enabled)
J9VM - 20080415_018762_LHdSMr
JIT - r9_20080415_1520
GC - 20080415_AA)
JCL - 20080412_01
Only thing I can think of to test is to push 60,000 to 100,000 updates in the span of a few minutes onto a single machine. If I keep the updates under 30,000 per hour, it runs fine. Due to the sensitivity of the data, I cannot provide a copy of example data or schema, but I can provide analogs if needed. I can also provide scrubbed config files as well. I'm afraid I lack the knowledge to make use of the Jetty.
> XML parser stops working under heavy load
> -----------------------------------------
>
> Key: SOLR-600
> URL: https://issues.apache.org/jira/browse/SOLR-600
> Project: Solr
> Issue Type: Bug
> Components: update
> Affects Versions: 1.3
> Environment: Linux 2.6.19.7-ss0 #4 SMP Wed Mar 12 02:56:42 GMT 2008 x86_64 Intel(R) Xeon(R) CPU X5450 @ 3.00GHz GenuineIntel GNU/Linux
> Tomcat 6.0.16
> SOLR nightly 16 Jun 2008, and versions prior
> JRE 1.6.0
> Reporter: John Smith
>
> Under heavy load, the following is spat out for every update:
> org.apache.solr.common.SolrException log
> SEVERE: java.lang.NullPointerException
> at java.util.AbstractList$SimpleListIterator.hasNext(Unknown Source)
> at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:225)
> at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:66)
> at org.apache.solr.handler.XmlUpdateRequestHandler.processUpdate(XmlUpdateRequestHandler.java:196)
> at org.apache.solr.handler.XmlUpdateRequestHandler.handleRequestBody(XmlUpdateRequestHandler.java:123)
> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:125)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:965)
> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:272)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
> at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
> at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
> at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
> at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
> at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
> at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
> at java.lang.Thread.run(Thread.java:735)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.