DataImportHandler on multi core - limiting concurrent runs on more than N cores

[Patrice Monroe Pustavrh <pa...@bisnode.si>]

Hi,
I am currently run Solr with 10 cores. It works fine with me, until "I" try
to run update on too may cores (each core uses more than enough CPU and
memory so machine becomes really slow). I've googled around and tried to
find whether there is an option in SOLR to prevent to many simultaneous data
imports at once, and so far, I found nothing. Is there any way to limit (and
possibly, enqueue) to many dataimports at once on multi core ? 

P.S. I am aware one can run only one dataimport per core, but this is not
the issue here.

Regards
Patrice Monroe Pustavrh

Re: DataImportHandler on multi core - limiting concurrent runs on more than N cores

[Shalin Shekhar Mangar <sh...@gmail.com>]

No, there is no synchronisation between data import handlers on
different cores. You will have to implement this sort of queuing logic
on your application's side.

On Wed, Nov 20, 2013 at 2:23 PM, Patrice Monroe Pustavrh
<pa...@bisnode.si> wrote:
> Hi,
> I am currently run Solr with 10 cores. It works fine with me, until "I" try
> to run update on too may cores (each core uses more than enough CPU and
> memory so machine becomes really slow). I've googled around and tried to
> find whether there is an option in SOLR to prevent to many simultaneous data
> imports at once, and so far, I found nothing. Is there any way to limit (and
> possibly, enqueue) to many dataimports at once on multi core ?
>
> P.S. I am aware one can run only one dataimport per core, but this is not
> the issue here.
>
> Regards
> Patrice Monroe Pustavrh
>



-- 
Regards,
Shalin Shekhar Mangar.