Re: Solr exception while retrieving documents

[MUNENDRA S N <sn...@gmail.com>]

For real-time get, child doc transformer would need Real-time searcher and
I think this issue has been resolved in
https://issues.apache.org/jira/browse/SOLR-12722

Basically, needsSolrIndexSearcher should be set to true

public boolean needsSolrIndexSearcher() { return true; }


Regards,
Munendra S N


On Sat, Jun 1, 2019 at 4:01 AM Mandava, Rahul <ma...@upmc.edu> wrote:

> Hi,
>
>
> I am using SOLR 6.6.0 and real-time get to retrieve documents. Randomly I
> am seeing nullpointer exceptions in solr log files which in turn breaks the
> application workflow. Below is the stack trace
>
> I am thinking this could be related to real-time get, when transforming
> child documents during get, may be child elements are not available due to
> any pending / uncommitted transactions to SOLR index. The same retrieval
> works fine after some time, which makes me think that this could be related
> to committing the changes to index or may be a transaction issue. But
> couldn't figure out exactly where the bottle neck is. Has anyone faced
> similar issue or familiar with the exception ??
>
> The same exception is being logged by two different loggers HttpSolrCall
> and RequestHandlerBase in solr log file at the same time stamp.
>
>
>
> null:java.lang.NullPointerException at
> org.apache.solr.response.transform.ChildDocTransformer.transform(ChildDocTransformerFactory.java:136)
> at
> org.apache.solr.handler.component.RealTimeGetComponent.process(RealTimeGetComponent.java:253)
> at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:296)
> at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2477) at
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723) at
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529) at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:361)
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:305)
> at
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
> at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
> at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
> at
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
> at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
> at
> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
> at org.eclipse.jetty.server.Server.handle(Server.java:534) at
> org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95) at
> org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
> at
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
> at
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
> at
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
> at java.lang.Thread.run(Thread.java:748)
>
> NOTE: I added additional parameter of softCommit=true when I save / update
> documents to index, after this change the frequency and volume of these
> errors has decreased, but still seeing very few (1-2) errors, but still
> seeing the same exception in Solr log files. I am thinking that seeing
> error in log files doesn't hurt as long as the updates and get's work fine,
> but still would like to know how to eradicate these errors from happening.
>
>
> Thanks
> Rahul Mandava
>
>