You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@solr.apache.org by "Ishan Chattopadhyaya (Jira)" <ji...@apache.org> on 2021/11/02 23:27:00 UTC
[jira] [Comment Edited] (SOLR-15715) Dedicated query aggregator
nodes in the solr cluster.
[ https://issues.apache.org/jira/browse/SOLR-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437664#comment-17437664 ]
Ishan Chattopadhyaya edited comment on SOLR-15715 at 11/2/21, 11:26 PM:
------------------------------------------------------------------------
I'd like to point out here that this feature is a donation from FullStory, where [~hiteshkhamesra] implemented this solution that has already brought immense benefits on large Solr clusters. As part of this JIRA, we plan to upstream that functionality so that broader Solr community can benefit. While we've seen substantial reduction of memory usage on data hosting nodes in production for FullStory's internal workloads, I shall publish benchmarks for this feature on publicly available datasets soon.
was (Author: ichattopadhyaya):
I'd like to point out here that this feature is a donation from FullStory, where [~hiteshkhamesra] implemented this solution that has already brought immense benefits on large Solr clusters. As part of this JIRA, we plan to upstream that functionality so that broader Solr community can benefit. While we've seen substantial reduction of memory usage on data hosting nodes in production at FullStory's internal workloads, I shall publish benchmarks for this feature on publicly available datasets soon.
> Dedicated query aggregator nodes in the solr cluster.
> ------------------------------------------------------
>
> Key: SOLR-15715
> URL: https://issues.apache.org/jira/browse/SOLR-15715
> Project: Solr
> Issue Type: New Feature
> Security Level: Public(Default Security Level. Issues are Public)
> Components: SearchComponents - other
> Affects Versions: 8.10.1
> Reporter: Hitesh Khamesra
> Priority: Major
>
> We have a large collection with 1000s of shards in the solr cluster. We have observed that distributed solr query takes many resources(thread, memory, etc.) on the solr data node(node which contains indexes). Thus we need dedicated query nodes to execute distributed queries on large solr collection. That would reduce the memory/cpu pressure from solr data nodes.
> Elastis search has similar functionality [here|https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-node.html#coordinating-node]
>
> [~noble.paul] [~ichattopadhyaya]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org