You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Furkan KAMACI <fu...@gmail.com> on 2013/04/16 13:48:55 UTC
SolrCloud Leader Response Mechanism
When a leader responses for a query, does it says that: "If I have the data
what I am looking for, I should build response with it, otherwise I should
find it anywhere. Because it may be long to search it?"
or
does it says I only index the data, I will tell it to other guys to build
up the response query?
Re: SolrCloud Leader Response Mechanism
Posted by Furkan KAMACI <fu...@gmail.com>.
Replica asks to Zookeper and Leader does not do anything. Thanks for your
answer Otis.
2013/4/17 Otis Gospodnetic <ot...@gmail.com>
> Oui, ZK holds "the map".
>
> Otis
> --
> Solr & ElasticSearch Support
> http://sematext.com/
>
>
>
>
>
> On Tue, Apr 16, 2013 at 6:33 PM, Furkan KAMACI <fu...@gmail.com>
> wrote:
> > Hi Otis;
> >
> > You said:
> >
> > "It can just do it because it knows where things are."
> >
> > Does it learn it from Zookeeper?
> >
> > 2013/4/17 Otis Gospodnetic <ot...@gmail.com>
> >
> >> If query comes to shard X on some node and this shard X is NOT a
> >> leader, but HAS data, it will just execute the query. If it needs to
> >> query shards on other nodes, it will have the info about which shards
> >> to query and will just do that and aggregate the results. It doesn't
> >> have to ask leader for permission, for info, etc. It can just do it
> >> because it knows where things are.
> >>
> >> Otis
> >> --
> >> Solr & ElasticSearch Support
> >> http://sematext.com/
> >>
> >>
> >>
> >>
> >>
> >> On Tue, Apr 16, 2013 at 5:23 PM, Furkan KAMACI <fu...@gmail.com>
> >> wrote:
> >> > Hi Mark;
> >> >
> >> > When I speak with proper terms I want to ask that: is there a data
> >> locality
> >> > of spatial locality (
> >> >
> >>
> http://www.roguewave.com/portals/0/products/threadspotter/docs/2011.2/manual_html_linux/manual_html/ch_intro_locality.html
> >> > - I mean if you have data on your machine, use it and don't search it
> >> > anywhere else, just search for remaining parts) at querying on a
> leader
> >> of
> >> > SolrCloud?
> >> >
> >> > 2013/4/16 Mark Miller <ma...@gmail.com>
> >> >
> >> >> Leaders don't have much to do with querying - the node that you query
> >> will
> >> >> determine what other nodes it has to query to search the whole index
> >> and do
> >> >> a scatter/gather for you. (Though in some cases that request can be
> >> proxied
> >> >> to another node)
> >> >>
> >> >> - Mark
> >> >>
> >> >> On Apr 16, 2013, at 7:48 AM, Furkan KAMACI <fu...@gmail.com>
> >> wrote:
> >> >>
> >> >> > When a leader responses for a query, does it says that: "If I have
> the
> >> >> data
> >> >> > what I am looking for, I should build response with it, otherwise I
> >> >> should
> >> >> > find it anywhere. Because it may be long to search it?"
> >> >> > or
> >> >> > does it says I only index the data, I will tell it to other guys to
> >> build
> >> >> > up the response query?
> >> >>
> >> >>
> >>
>
Re: SolrCloud Leader Response Mechanism
Posted by Otis Gospodnetic <ot...@gmail.com>.
Oui, ZK holds "the map".
Otis
--
Solr & ElasticSearch Support
http://sematext.com/
On Tue, Apr 16, 2013 at 6:33 PM, Furkan KAMACI <fu...@gmail.com> wrote:
> Hi Otis;
>
> You said:
>
> "It can just do it because it knows where things are."
>
> Does it learn it from Zookeeper?
>
> 2013/4/17 Otis Gospodnetic <ot...@gmail.com>
>
>> If query comes to shard X on some node and this shard X is NOT a
>> leader, but HAS data, it will just execute the query. If it needs to
>> query shards on other nodes, it will have the info about which shards
>> to query and will just do that and aggregate the results. It doesn't
>> have to ask leader for permission, for info, etc. It can just do it
>> because it knows where things are.
>>
>> Otis
>> --
>> Solr & ElasticSearch Support
>> http://sematext.com/
>>
>>
>>
>>
>>
>> On Tue, Apr 16, 2013 at 5:23 PM, Furkan KAMACI <fu...@gmail.com>
>> wrote:
>> > Hi Mark;
>> >
>> > When I speak with proper terms I want to ask that: is there a data
>> locality
>> > of spatial locality (
>> >
>> http://www.roguewave.com/portals/0/products/threadspotter/docs/2011.2/manual_html_linux/manual_html/ch_intro_locality.html
>> > - I mean if you have data on your machine, use it and don't search it
>> > anywhere else, just search for remaining parts) at querying on a leader
>> of
>> > SolrCloud?
>> >
>> > 2013/4/16 Mark Miller <ma...@gmail.com>
>> >
>> >> Leaders don't have much to do with querying - the node that you query
>> will
>> >> determine what other nodes it has to query to search the whole index
>> and do
>> >> a scatter/gather for you. (Though in some cases that request can be
>> proxied
>> >> to another node)
>> >>
>> >> - Mark
>> >>
>> >> On Apr 16, 2013, at 7:48 AM, Furkan KAMACI <fu...@gmail.com>
>> wrote:
>> >>
>> >> > When a leader responses for a query, does it says that: "If I have the
>> >> data
>> >> > what I am looking for, I should build response with it, otherwise I
>> >> should
>> >> > find it anywhere. Because it may be long to search it?"
>> >> > or
>> >> > does it says I only index the data, I will tell it to other guys to
>> build
>> >> > up the response query?
>> >>
>> >>
>>
Re: SolrCloud Leader Response Mechanism
Posted by Furkan KAMACI <fu...@gmail.com>.
Hi Otis;
You said:
"It can just do it because it knows where things are."
Does it learn it from Zookeeper?
2013/4/17 Otis Gospodnetic <ot...@gmail.com>
> If query comes to shard X on some node and this shard X is NOT a
> leader, but HAS data, it will just execute the query. If it needs to
> query shards on other nodes, it will have the info about which shards
> to query and will just do that and aggregate the results. It doesn't
> have to ask leader for permission, for info, etc. It can just do it
> because it knows where things are.
>
> Otis
> --
> Solr & ElasticSearch Support
> http://sematext.com/
>
>
>
>
>
> On Tue, Apr 16, 2013 at 5:23 PM, Furkan KAMACI <fu...@gmail.com>
> wrote:
> > Hi Mark;
> >
> > When I speak with proper terms I want to ask that: is there a data
> locality
> > of spatial locality (
> >
> http://www.roguewave.com/portals/0/products/threadspotter/docs/2011.2/manual_html_linux/manual_html/ch_intro_locality.html
> > - I mean if you have data on your machine, use it and don't search it
> > anywhere else, just search for remaining parts) at querying on a leader
> of
> > SolrCloud?
> >
> > 2013/4/16 Mark Miller <ma...@gmail.com>
> >
> >> Leaders don't have much to do with querying - the node that you query
> will
> >> determine what other nodes it has to query to search the whole index
> and do
> >> a scatter/gather for you. (Though in some cases that request can be
> proxied
> >> to another node)
> >>
> >> - Mark
> >>
> >> On Apr 16, 2013, at 7:48 AM, Furkan KAMACI <fu...@gmail.com>
> wrote:
> >>
> >> > When a leader responses for a query, does it says that: "If I have the
> >> data
> >> > what I am looking for, I should build response with it, otherwise I
> >> should
> >> > find it anywhere. Because it may be long to search it?"
> >> > or
> >> > does it says I only index the data, I will tell it to other guys to
> build
> >> > up the response query?
> >>
> >>
>
Re: SolrCloud Leader Response Mechanism
Posted by Otis Gospodnetic <ot...@gmail.com>.
If query comes to shard X on some node and this shard X is NOT a
leader, but HAS data, it will just execute the query. If it needs to
query shards on other nodes, it will have the info about which shards
to query and will just do that and aggregate the results. It doesn't
have to ask leader for permission, for info, etc. It can just do it
because it knows where things are.
Otis
--
Solr & ElasticSearch Support
http://sematext.com/
On Tue, Apr 16, 2013 at 5:23 PM, Furkan KAMACI <fu...@gmail.com> wrote:
> Hi Mark;
>
> When I speak with proper terms I want to ask that: is there a data locality
> of spatial locality (
> http://www.roguewave.com/portals/0/products/threadspotter/docs/2011.2/manual_html_linux/manual_html/ch_intro_locality.html
> - I mean if you have data on your machine, use it and don't search it
> anywhere else, just search for remaining parts) at querying on a leader of
> SolrCloud?
>
> 2013/4/16 Mark Miller <ma...@gmail.com>
>
>> Leaders don't have much to do with querying - the node that you query will
>> determine what other nodes it has to query to search the whole index and do
>> a scatter/gather for you. (Though in some cases that request can be proxied
>> to another node)
>>
>> - Mark
>>
>> On Apr 16, 2013, at 7:48 AM, Furkan KAMACI <fu...@gmail.com> wrote:
>>
>> > When a leader responses for a query, does it says that: "If I have the
>> data
>> > what I am looking for, I should build response with it, otherwise I
>> should
>> > find it anywhere. Because it may be long to search it?"
>> > or
>> > does it says I only index the data, I will tell it to other guys to build
>> > up the response query?
>>
>>
Re: SolrCloud Leader Response Mechanism
Posted by Furkan KAMACI <fu...@gmail.com>.
Hi Mark;
When I speak with proper terms I want to ask that: is there a data locality
of spatial locality (
http://www.roguewave.com/portals/0/products/threadspotter/docs/2011.2/manual_html_linux/manual_html/ch_intro_locality.html
- I mean if you have data on your machine, use it and don't search it
anywhere else, just search for remaining parts) at querying on a leader of
SolrCloud?
2013/4/16 Mark Miller <ma...@gmail.com>
> Leaders don't have much to do with querying - the node that you query will
> determine what other nodes it has to query to search the whole index and do
> a scatter/gather for you. (Though in some cases that request can be proxied
> to another node)
>
> - Mark
>
> On Apr 16, 2013, at 7:48 AM, Furkan KAMACI <fu...@gmail.com> wrote:
>
> > When a leader responses for a query, does it says that: "If I have the
> data
> > what I am looking for, I should build response with it, otherwise I
> should
> > find it anywhere. Because it may be long to search it?"
> > or
> > does it says I only index the data, I will tell it to other guys to build
> > up the response query?
>
>
Re: SolrCloud Leader Response Mechanism
Posted by Mark Miller <ma...@gmail.com>.
Leaders don't have much to do with querying - the node that you query will determine what other nodes it has to query to search the whole index and do a scatter/gather for you. (Though in some cases that request can be proxied to another node)
- Mark
On Apr 16, 2013, at 7:48 AM, Furkan KAMACI <fu...@gmail.com> wrote:
> When a leader responses for a query, does it says that: "If I have the data
> what I am looking for, I should build response with it, otherwise I should
> find it anywhere. Because it may be long to search it?"
> or
> does it says I only index the data, I will tell it to other guys to build
> up the response query?