[jira] [Created] (SOLR-4903) Solr sends all doc ids to all shards in the query counting facets

["Dmitry Kan (JIRA)" <ji...@apache.org>]

Dmitry Kan created SOLR-4903:
--------------------------------

             Summary: Solr sends all doc ids to all shards in the query counting facets
                 Key: SOLR-4903
                 URL: https://issues.apache.org/jira/browse/SOLR-4903
             Project: Solr
          Issue Type: Improvement
          Components: search
    Affects Versions: 3.4
            Reporter: Dmitry Kan


Setup: front end solr and shards.

Summary: solr frontend sends all doc ids received from QueryComponent to all shards which causes POST request buffer size overflow.

Symptoms:

The query is: http://pastebin.com/0DndK1Cs
I have omitted the shards parameter.

The router log: http://pastebin.com/FTVH1WF3
Notice the port of a shard, that is affected. That port changes all the time, even for the same request
The log entry is prepended with lines:

SEVERE: org.apache.solr.common.SolrException: Internal Server Error

Internal Server Error

(they are not in the pastebin link)

The shard log: http://pastebin.com/exwCx3LX

Suggestion: change the data structure in FacetComponent to send only doc ids that belong to a shard and not a concatenation of all doc ids.

Why is this important: for scaling. Adding more shards will result in overflowing the POST request buffer at some point anyway.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org