You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Markus Jelsma <ma...@openindex.io> on 2014/01/22 17:13:26 UTC

AIOOBException on trunk since 21st or 22nd build

Hi - this likely belongs to an existing open issue. We're seeing the stuff below on a build of the 22nd. Until just now we used builds of the 20th and didn't have the issue. This is either a bug or did some data format in Zookeeper change? Until now only two cores of the same shard through the error, all other nodes in the cluster are clean.

2014-01-22 15:32:48,826 ERROR [solr.core.SolrCore] - [http-8080-exec-5] - : java.lang.ArrayIndexOutOfBoundsException: 1
        at org.apache.solr.common.cloud.CompositeIdRouter$KeyParser.getHash(CompositeIdRouter.java:291)
        at org.apache.solr.common.cloud.CompositeIdRouter.sliceHash(CompositeIdRouter.java:58)
        at org.apache.solr.common.cloud.HashBasedRouter.getTargetSlice(HashBasedRouter.java:33)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:218)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:961)
        at org.apache.solr.update.processor.UpdateRequestProcessor.processDelete(UpdateRequestProcessor.java:55)
        at org.apache.solr.handler.loader.XMLLoader.processDelete(XMLLoader.java:347)
        at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:278)
        at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
        at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1915)
        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:785)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:203)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
        at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
        at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744)
        at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2282)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)

RE: AIOOBException on trunk since 21st or 22nd build

Posted by Markus Jelsma <ma...@openindex.io>.
Ignore or throw proper error message for bad delete containing bad composite ID
https://issues.apache.org/jira/browse/SOLR-5659

 
 
-----Original message-----
> From:Markus Jelsma <ma...@openindex.io>
> Sent: Thursday 23rd January 2014 12:16
> To: solr-user@lucene.apache.org
> Subject: RE: AIOOBException on trunk since 21st or 22nd build
> 
> Yeah, i can now also reproduce the problem with a build of the 20th! Again the same nodes leader and replica. The problem seems to be in the data we're sending to Solr. I'll check it out an file an issue.
> Cheers
> 
> -----Original message-----
> > From:Mark Miller <ma...@gmail.com>
> > Sent: Wednesday 22nd January 2014 18:56
> > To: solr-user <so...@lucene.apache.org>
> > Subject: Re: AIOOBException on trunk since 21st or 22nd build
> > 
> > Looking at the list of changes on the 21st and 22nd, I don’t see a smoking gun.
> > 
> > - Mark  
> > 
> > 
> > 
> > On Jan 22, 2014, 11:13:26 AM, Markus Jelsma <ma...@openindex.io> wrote: Hi - this likely belongs to an existing open issue. We're seeing the stuff below on a build of the 22nd. Until just now we used builds of the 20th and didn't have the issue. This is either a bug or did some data format in Zookeeper change? Until now only two cores of the same shard through the error, all other nodes in the cluster are clean.
> > 
> > 2014-01-22 15:32:48,826 ERROR [solr.core.SolrCore] - [http-8080-exec-5] - : java.lang.ArrayIndexOutOfBoundsException: 1
> > at org.apache.solr.common.cloud.CompositeIdRouter$KeyParser.getHash(CompositeIdRouter.java:291)
> > at org.apache.solr.common.cloud.CompositeIdRouter.sliceHash(CompositeIdRouter.java:58)
> > at org.apache.solr.common.cloud.HashBasedRouter.getTargetSlice(HashBasedRouter.java:33)
> > at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:218)
> > at org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:961)
> > at org.apache.solr.update.processor.UpdateRequestProcessor.processDelete(UpdateRequestProcessor.java:55)
> > at org.apache.solr.handler.loader.XMLLoader.processDelete(XMLLoader.java:347)
> > at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:278)
> > at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
> > at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
> > at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
> > at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
> > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1915)
> > at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:785)
> > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418)
> > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:203)
> > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
> > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
> > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
> > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
> > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
> > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
> > at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
> > at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744)
> > at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2282)
> > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:724)
> > 
>

RE: AIOOBException on trunk since 21st or 22nd build

Posted by Markus Jelsma <ma...@openindex.io>.
Yeah, i can now also reproduce the problem with a build of the 20th! Again the same nodes leader and replica. The problem seems to be in the data we're sending to Solr. I'll check it out an file an issue.
Cheers

-----Original message-----
> From:Mark Miller <ma...@gmail.com>
> Sent: Wednesday 22nd January 2014 18:56
> To: solr-user <so...@lucene.apache.org>
> Subject: Re: AIOOBException on trunk since 21st or 22nd build
> 
> Looking at the list of changes on the 21st and 22nd, I don’t see a smoking gun.
> 
> - Mark  
> 
> 
> 
> On Jan 22, 2014, 11:13:26 AM, Markus Jelsma <ma...@openindex.io> wrote: Hi - this likely belongs to an existing open issue. We're seeing the stuff below on a build of the 22nd. Until just now we used builds of the 20th and didn't have the issue. This is either a bug or did some data format in Zookeeper change? Until now only two cores of the same shard through the error, all other nodes in the cluster are clean.
> 
> 2014-01-22 15:32:48,826 ERROR [solr.core.SolrCore] - [http-8080-exec-5] - : java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.solr.common.cloud.CompositeIdRouter$KeyParser.getHash(CompositeIdRouter.java:291)
> at org.apache.solr.common.cloud.CompositeIdRouter.sliceHash(CompositeIdRouter.java:58)
> at org.apache.solr.common.cloud.HashBasedRouter.getTargetSlice(HashBasedRouter.java:33)
> at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:218)
> at org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:961)
> at org.apache.solr.update.processor.UpdateRequestProcessor.processDelete(UpdateRequestProcessor.java:55)
> at org.apache.solr.handler.loader.XMLLoader.processDelete(XMLLoader.java:347)
> at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:278)
> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1915)
> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:785)
> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418)
> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:203)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
> at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
> at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
> at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
> at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
> at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744)
> at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2282)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
>

Re: AIOOBException on trunk since 21st or 22nd build

Posted by Mark Miller <ma...@gmail.com>.
Looking at the list of changes on the 21st and 22nd, I don’t see a smoking gun.

- Mark  



On Jan 22, 2014, 11:13:26 AM, Markus Jelsma <ma...@openindex.io> wrote: Hi - this likely belongs to an existing open issue. We're seeing the stuff below on a build of the 22nd. Until just now we used builds of the 20th and didn't have the issue. This is either a bug or did some data format in Zookeeper change? Until now only two cores of the same shard through the error, all other nodes in the cluster are clean.

2014-01-22 15:32:48,826 ERROR [solr.core.SolrCore] - [http-8080-exec-5] - : java.lang.ArrayIndexOutOfBoundsException: 1
at org.apache.solr.common.cloud.CompositeIdRouter$KeyParser.getHash(CompositeIdRouter.java:291)
at org.apache.solr.common.cloud.CompositeIdRouter.sliceHash(CompositeIdRouter.java:58)
at org.apache.solr.common.cloud.HashBasedRouter.getTargetSlice(HashBasedRouter.java:33)
at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:218)
at org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:961)
at org.apache.solr.update.processor.UpdateRequestProcessor.processDelete(UpdateRequestProcessor.java:55)
at org.apache.solr.handler.loader.XMLLoader.processDelete(XMLLoader.java:347)
at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:278)
at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1915)
at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:785)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:203)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2282)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)