You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by smock <ha...@gmail.com> on 2009/12/02 18:52:49 UTC

NullPointerException thrown during updates to index

Hi,
I'm running a distributed solr index (3 nodes) and have noticed frequent
exceptions thrown during updates.  The exception (see below for full trace)
occurs in the mergeIds function of QueryComponents, in this code block:
      Map<Object,ShardDoc> resultIds = new HashMap<Object,ShardDoc>();
      for (int i=resultSize-1; i>=0; i--) {
        ShardDoc shardDoc = (ShardDoc)queue.pop();
        shardDoc.positionInResponse = i;
        // Need the toString() for correlation with other lists that must
        // be strings (like keys in highlighting, explain, etc)
        resultIds.put(shardDoc.id.toString(), shardDoc);
      }


specifically, in the line:
        shardDoc.positionInResponse = i;


I really have no idea why this would be happening or how to begin debugging
this error.  Any ideas would be greatly appreciated.

Thanks,
-Harish




WebApp Error: <class 'o2.lib.searchlib.solrapi.SolrError'>: The server
encountered an internal error (null java.lang.NullPointerException at
org.apache.solr.handler.component.QueryComponent.mergeIds(QueryComponent.java:459)
at
org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:298)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:290)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1301) at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catali...ing this request.

-- 
View this message in context: http://old.nabble.com/NullPointerException-thrown-during-updates-to-index-tp26613309p26613309.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: NullPointerException thrown during updates to index

Posted by smock <ha...@gmail.com>.
Just to clarify, the error is being thrown FROM a search, DURING an update.

This error is making distributed SOLR close to unusable for me.  Any ideas? 
Does SOLR fail on searches if one node takes too long to respond?  



hossman wrote:
> 
> : Hi,
> : I'm running a distributed solr index (3 nodes) and have noticed frequent
> : exceptions thrown during updates.  The exception (see below for full
> trace)
> 
> what do you mean "during updates" ? ... QueryComponent isn't used at all 
> when updating hte index, so there may be a missunderstanding here.
> 
> I'm not very familiar with the code in question, but i opened a bug to 
> track it, please update with any new info you may have as you do more 
> testing...
> 
> https://issues.apache.org/jira/browse/SOLR-1631
> 
> 
> 
> 
> 
> -Hoss
> 
> 
> 

-- 
View this message in context: http://old.nabble.com/NullPointerException-thrown-during-updates-to-index-tp26613309p26819479.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: NullPointerException thrown during updates to index

Posted by Chris Hostetter <ho...@fucit.org>.
: Hi,
: I'm running a distributed solr index (3 nodes) and have noticed frequent
: exceptions thrown during updates.  The exception (see below for full trace)

what do you mean "during updates" ? ... QueryComponent isn't used at all 
when updating hte index, so there may be a missunderstanding here.

I'm not very familiar with the code in question, but i opened a bug to 
track it, please update with any new info you may have as you do more 
testing...

https://issues.apache.org/jira/browse/SOLR-1631





-Hoss


Re: NullPointerException thrown during updates to index

Posted by smock <ha...@gmail.com>.
I'm using a very slightly modified version of a nightly build from the middle
of September.  

It seems like this isn't the only report of problems of this sort:

http://markmail.org/message/zept5u3hv4ytunfv#query:solr%20commit%20connection%20reset%20mergeids+page:1+mid:aqzaaphbuow4sa5o+state:results




Erick Erickson wrote:
> 
> What version are you using? If a nightly build, from when?
> 
> Thanks
> Erick
> 
> On Wed, Dec 2, 2009 at 12:53 PM, smock <ha...@gmail.com> wrote:
> 
>>
>> Hi,
>> I'm running a distributed solr index (3 nodes) and have noticed frequent
>> exceptions thrown during updates.  The exception (see below for full
>> trace)
>> occurs in the mergeIds function of QueryComponents, in this code block:
>>      Map<Object,ShardDoc> resultIds = new HashMap<Object,ShardDoc>();
>>      for (int i=resultSize-1; i>=0; i--) {
>>        ShardDoc shardDoc = (ShardDoc)queue.pop();
>>        shardDoc.positionInResponse = i;
>>        // Need the toString() for correlation with other lists that must
>>        // be strings (like keys in highlighting, explain, etc)
>>        resultIds.put(shardDoc.id.toString(), shardDoc);
>>      }
>>
>>
>> specifically, in the line:
>>        shardDoc.positionInResponse = i;
>>
>>
>> I really have no idea why this would be happening or how to begin
>> debugging
>> this error.  Any ideas would be greatly appreciated.
>>
>> Thanks,
>> -Harish
>>
>>
>>
>>
>> The server encountered an internal error (null
>> java.lang.NullPointerException at
>>
>> org.apache.solr.handler.component.QueryComponent.mergeIds(QueryComponent.java:459)
>> at
>>
>> org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:298)
>> at
>>
>> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:290)
>> at
>>
>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
>> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1301) at
>>
>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
>> at
>>
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
>> at
>>
>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>> at
>>
>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> at
>>
>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>> at org.apache.catali...ing this request.
>>
>> --
>> View this message in context:
>> http://old.nabble.com/NullPointerException-thrown-during-updates-to-index-tp26613309p26613309.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
> 
> 

-- 
View this message in context: http://old.nabble.com/NullPointerException-thrown-during-updates-to-index-tp26613309p26615934.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: NullPointerException thrown during updates to index

Posted by Erick Erickson <er...@gmail.com>.
What version are you using? If a nightly build, from when?

Thanks
Erick

On Wed, Dec 2, 2009 at 12:53 PM, smock <ha...@gmail.com> wrote:

>
> Hi,
> I'm running a distributed solr index (3 nodes) and have noticed frequent
> exceptions thrown during updates.  The exception (see below for full trace)
> occurs in the mergeIds function of QueryComponents, in this code block:
>      Map<Object,ShardDoc> resultIds = new HashMap<Object,ShardDoc>();
>      for (int i=resultSize-1; i>=0; i--) {
>        ShardDoc shardDoc = (ShardDoc)queue.pop();
>        shardDoc.positionInResponse = i;
>        // Need the toString() for correlation with other lists that must
>        // be strings (like keys in highlighting, explain, etc)
>        resultIds.put(shardDoc.id.toString(), shardDoc);
>      }
>
>
> specifically, in the line:
>        shardDoc.positionInResponse = i;
>
>
> I really have no idea why this would be happening or how to begin debugging
> this error.  Any ideas would be greatly appreciated.
>
> Thanks,
> -Harish
>
>
>
>
> The server encountered an internal error (null
> java.lang.NullPointerException at
>
> org.apache.solr.handler.component.QueryComponent.mergeIds(QueryComponent.java:459)
> at
>
> org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:298)
> at
>
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:290)
> at
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1301) at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
> at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
> at
>
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
> at
>
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
> at
>
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
> at org.apache.catali...ing this request.
>
> --
> View this message in context:
> http://old.nabble.com/NullPointerException-thrown-during-updates-to-index-tp26613309p26613309.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>