More new solr cloud questions

[da...@ontrenet.com]

Hi,
  I have some questions about the 4.0 solr cloud implementation.

1. I want to have a large cloud of machines on a network. each machine
will
process data and write to its "local" solr server (node,shard or
whatever).
This is necessary because it won't be possible to have 100 machines with
100 threads
all writing to the same solr server URL (leader or whatever). It would
collapse.

2. I then want to do a distributed search from a single, well known solr
instance
and have all solr capabilities (MLT,IDF,facet,ranking, etc.) work as
intended -
but querying from all 100 solr instances in parallel.

Will this be possible?

thanks!
Darren

Re: More new solr cloud questions

[Darren Govoni <da...@ontrenet.com>]

Great! Thank you. I'm eager to test it on EC2 whenever its near beta ready.

On 10/13/2011 11:51 AM, Ted Dunning wrote:
> On Thu, Oct 13, 2011 at 1:37 PM,<da...@ontrenet.com>  wrote:
>
>> Hi,
>>   I have some questions about the 4.0 solr cloud implementation.
>>
>> 1. I want to have a large cloud of machines on a network. each machine
>> will process data and write to its "local" solr server (node,shard or
>> whatever). This is necessary because it won't be possible to have 100
>> machines with
>> 100 threads all writing to the same solr server URL (leader or whatever).
>> It would
>> collapse.
>>
> The update process will avoid writing everything everywhere, but will not
> allow simply writing to a single local server in all cases.
>
> Hopefully the final version will come very close to what you are talking
> about.
>
>
>
>> 2. I then want to do a distributed search from a single, well known solr
>> instance and have all solr capabilities (MLT,IDF,facet,ranking, etc.) work
>> as
>> intended - but querying from all 100 solr instances in parallel.
>>
> This is definitely the intent.
>

Re: More new solr cloud questions

[Ted Dunning <te...@gmail.com>]

On Thu, Oct 13, 2011 at 1:37 PM, <da...@ontrenet.com> wrote:

>
> Hi,
>  I have some questions about the 4.0 solr cloud implementation.
>
> 1. I want to have a large cloud of machines on a network. each machine
> will process data and write to its "local" solr server (node,shard or
> whatever). This is necessary because it won't be possible to have 100
> machines with
> 100 threads all writing to the same solr server URL (leader or whatever).
> It would
> collapse.
>

The update process will avoid writing everything everywhere, but will not
allow simply writing to a single local server in all cases.

Hopefully the final version will come very close to what you are talking
about.



> 2. I then want to do a distributed search from a single, well known solr
> instance and have all solr capabilities (MLT,IDF,facet,ranking, etc.) work
> as
> intended - but querying from all 100 solr instances in parallel.
>

This is definitely the intent.