You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Jamie Johnson <je...@gmail.com> on 2012/05/01 22:51:43 UTC

NPE when faceting

I had reported this issue a while back, hoping that it was something
with my environment, but that doesn't seem to be the case.  I am
getting the following stack trace on certain facet queries.
Previously when I did an optimize the error went away, does anyone
have any insight into why specifically this could be happening?

May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
SEVERE: java.lang.NullPointerException
	at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
	at org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
	at org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
	at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
	at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
	at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
	at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
	at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
	at org.eclipse.jetty.server.Server.handle(Server.java:351)
	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
	at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
	at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
	at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
	at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
	at java.lang.Thread.run(Thread.java:662)

Re: NPE when faceting

Posted by Jamie Johnson <je...@gmail.com>.
I don't have any more details than I provided here, but I created a
ticket with this information.  Thanks again

https://issues.apache.org/jira/browse/SOLR-3427

On Tue, May 1, 2012 at 5:20 PM, Yonik Seeley <yo...@lucidimagination.com> wrote:
> Darn... looks likely that it's another bug from when part of
> UnInvertedField was refactored into Lucene.
> We really need some random tests that can catch bugs like these though
> - I'll see if I can reproduce.
>
> Can you open a JIRA issue for this?
>
> -Yonik
> lucenerevolution.com - Lucene/Solr Open Source Search Conference.
> Boston May 7-10
>
>
> On Tue, May 1, 2012 at 4:51 PM, Jamie Johnson <je...@gmail.com> wrote:
>> I had reported this issue a while back, hoping that it was something
>> with my environment, but that doesn't seem to be the case.  I am
>> getting the following stack trace on certain facet queries.
>> Previously when I did an optimize the error went away, does anyone
>> have any insight into why specifically this could be happening?
>>
>> May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
>> SEVERE: java.lang.NullPointerException
>>        at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
>>        at org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
>>        at org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
>>        at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
>>        at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
>>        at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
>>        at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
>>        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
>>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
>>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
>>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
>>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
>>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
>>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>>        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
>>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>>        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
>>        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>>        at org.eclipse.jetty.server.Server.handle(Server.java:351)
>>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>>        at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
>>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
>>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
>>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
>>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>>        at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
>>        at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
>>        at java.lang.Thread.run(Thread.java:662)

Re: NPE when faceting

Posted by Yonik Seeley <yo...@lucidimagination.com>.
Darn... looks likely that it's another bug from when part of
UnInvertedField was refactored into Lucene.
We really need some random tests that can catch bugs like these though
- I'll see if I can reproduce.

Can you open a JIRA issue for this?

-Yonik
lucenerevolution.com - Lucene/Solr Open Source Search Conference.
Boston May 7-10


On Tue, May 1, 2012 at 4:51 PM, Jamie Johnson <je...@gmail.com> wrote:
> I had reported this issue a while back, hoping that it was something
> with my environment, but that doesn't seem to be the case.  I am
> getting the following stack trace on certain facet queries.
> Previously when I did an optimize the error went away, does anyone
> have any insight into why specifically this could be happening?
>
> May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
> SEVERE: java.lang.NullPointerException
>        at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
>        at org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
>        at org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
>        at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
>        at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
>        at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
>        at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
>        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
>        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>        at org.eclipse.jetty.server.Server.handle(Server.java:351)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>        at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>        at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
>        at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
>        at java.lang.Thread.run(Thread.java:662)

Re: NPE when faceting

Posted by Jamie Johnson <je...@gmail.com>.
it may be related this this

http://stackoverflow.com/questions/10124055/solr-faceted-search-throws-nullpointerexception-with-http-500-status

we are doing deletes from our index as well so it is possible that
we're running into the same issue.  I hope that sheds more light on
things.

On Tue, May 1, 2012 at 4:51 PM, Jamie Johnson <je...@gmail.com> wrote:
> I had reported this issue a while back, hoping that it was something
> with my environment, but that doesn't seem to be the case.  I am
> getting the following stack trace on certain facet queries.
> Previously when I did an optimize the error went away, does anyone
> have any insight into why specifically this could be happening?
>
> May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
> SEVERE: java.lang.NullPointerException
>        at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
>        at org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
>        at org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
>        at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
>        at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
>        at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
>        at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
>        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
>        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>        at org.eclipse.jetty.server.Server.handle(Server.java:351)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>        at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>        at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
>        at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
>        at java.lang.Thread.run(Thread.java:662)