Sharing indexes

["Henrique O. Santos" <he...@gmail.com>]

Hello everyone,

In our development efforts, we came into the necessity of sharing Solr 
indexes with some initial documents to be deployed alongside our 
application. For that, I just started copying the collection directory 
with its conf and data subdirs.

That worked for some time, but it now I am getting some random errors. 
One of them says:
"SolrIndexWriter was not closed prior to finalize(), indicates a bug -- 
POSSIBLE RESOURCE LEAK!!!"

and the other:
"Error creating core [users]: Error opening new searcher"

Errors show up when starting up Solr. And after multiples restarts, 
eventually the cores start.

So, is there any guidelines for sharing existing indexes?

Thank you.
Henrique.

Re: Sharing indexes

[Erick Erickson <er...@gmail.com>]

You should not be copying things into a Solr index unless
1> you absolutely and totally guarantee that no current Solr is running
2> you absolutely and totally guarantee that you replace it entirely


You're really just asking for maintenance issues with this approach. I'd do
one
of two things:
1> ship your product with a pre-existing index that holds your documents
or, preferably
2> use the MERGEINDEX core admin API command to get your required
docs in the "live" index.

<2> is robustly supported and has a far greater chance of not giving you
grief.

Best,
Erick

On Wed, Sep 23, 2015 at 7:52 AM, Henrique O. Santos <he...@gmail.com>
wrote:

> Hi Alessandro,
>
> The requirement is pretty simple. We have a product that makes use of Solr
> collections. Anyone can download the product and deploy it locally
> (alongside a local Solr instance) on their own machine and start using it.
> To make it clear, each installation of the product operates by itself and
> does not have knowledge of any other. It is meant to work on its own.
>
> For the product to work properly, the collections need to have some
> starting documents there, like an admin user for instance in the user
> collection.
>
> Thanks for the reply.
>
>
> On 09/23/2015 10:44 AM, Alessandro Benedetti wrote:
>
>> Honestly is highly discouraged to share an index, making N Solr nodes
>> using
>> it.
>>   Can you express better your requirement ? Why can't you replicate the
>> index ?
>>
>> Cheers
>>
>> 2015-09-23 15:37 GMT+01:00 Henrique O. Santos <he...@gmail.com>:
>>
>> Hello everyone,
>>>
>>> In our development efforts, we came into the necessity of sharing Solr
>>> indexes with some initial documents to be deployed alongside our
>>> application. For that, I just started copying the collection directory
>>> with
>>> its conf and data subdirs.
>>>
>>> That worked for some time, but it now I am getting some random errors.
>>> One
>>> of them says:
>>> "SolrIndexWriter was not closed prior to finalize(), indicates a bug --
>>> POSSIBLE RESOURCE LEAK!!!"
>>>
>>> and the other:
>>> "Error creating core [users]: Error opening new searcher"
>>>
>>> Errors show up when starting up Solr. And after multiples restarts,
>>> eventually the cores start.
>>>
>>> So, is there any guidelines for sharing existing indexes?
>>>
>>> Thank you.
>>> Henrique.
>>>
>>>
>>
>>
>

Re: Sharing indexes

["Henrique O. Santos" <he...@gmail.com>]

Hi Alessandro,

The requirement is pretty simple. We have a product that makes use of 
Solr collections. Anyone can download the product and deploy it locally 
(alongside a local Solr instance) on their own machine and start using 
it. To make it clear, each installation of the product operates by 
itself and does not have knowledge of any other. It is meant to work on 
its own.

For the product to work properly, the collections need to have some 
starting documents there, like an admin user for instance in the user 
collection.

Thanks for the reply.

On 09/23/2015 10:44 AM, Alessandro Benedetti wrote:
> Honestly is highly discouraged to share an index, making N Solr nodes using
> it.
>   Can you express better your requirement ? Why can't you replicate the
> index ?
>
> Cheers
>
> 2015-09-23 15:37 GMT+01:00 Henrique O. Santos <he...@gmail.com>:
>
>> Hello everyone,
>>
>> In our development efforts, we came into the necessity of sharing Solr
>> indexes with some initial documents to be deployed alongside our
>> application. For that, I just started copying the collection directory with
>> its conf and data subdirs.
>>
>> That worked for some time, but it now I am getting some random errors. One
>> of them says:
>> "SolrIndexWriter was not closed prior to finalize(), indicates a bug --
>> POSSIBLE RESOURCE LEAK!!!"
>>
>> and the other:
>> "Error creating core [users]: Error opening new searcher"
>>
>> Errors show up when starting up Solr. And after multiples restarts,
>> eventually the cores start.
>>
>> So, is there any guidelines for sharing existing indexes?
>>
>> Thank you.
>> Henrique.
>>
>
>

Re: Sharing indexes

[Alessandro Benedetti <be...@gmail.com>]

Honestly is highly discouraged to share an index, making N Solr nodes using
it.
 Can you express better your requirement ? Why can't you replicate the
index ?

Cheers

2015-09-23 15:37 GMT+01:00 Henrique O. Santos <he...@gmail.com>:

> Hello everyone,
>
> In our development efforts, we came into the necessity of sharing Solr
> indexes with some initial documents to be deployed alongside our
> application. For that, I just started copying the collection directory with
> its conf and data subdirs.
>
> That worked for some time, but it now I am getting some random errors. One
> of them says:
> "SolrIndexWriter was not closed prior to finalize(), indicates a bug --
> POSSIBLE RESOURCE LEAK!!!"
>
> and the other:
> "Error creating core [users]: Error opening new searcher"
>
> Errors show up when starting up Solr. And after multiples restarts,
> eventually the cores start.
>
> So, is there any guidelines for sharing existing indexes?
>
> Thank you.
> Henrique.
>



-- 
--------------------------

Benedetti Alessandro
Visiting card - http://about.me/alessandro_benedetti
Blog - http://alexbenedetti.blogspot.co.uk

"Tyger, tyger burning bright
In the forests of the night,
What immortal hand or eye
Could frame thy fearful symmetry?"

William Blake - Songs of Experience -1794 England