You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Timothy Potter (JIRA)" <ji...@apache.org> on 2014/08/29 03:15:08 UTC

[jira] [Created] (SOLR-6450) Option to send pre-analyzed documents from leader to replica instead of replicas re-running analysis.

Timothy Potter created SOLR-6450:
------------------------------------

             Summary: Option to send pre-analyzed documents from leader to replica instead of replicas re-running analysis.
                 Key: SOLR-6450
                 URL: https://issues.apache.org/jira/browse/SOLR-6450
             Project: Solr
          Issue Type: Improvement
          Components: SolrCloud
            Reporter: Timothy Potter


Given the leader has to run the full update processor chain on each document (text analysis, etc), it would be good to have it send a pre-analyzed document to replicas (to improve near realtime replication), allowing the replica to avoid re-doing expensive work.

Thought should be given about allowing the leader to accept pre-analyzed as well, so that you could off-load the document analysis to external processes. For instance, have 1000's of Storm workers doing the analysis and then sending pre-analyzed documents to Solr.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org