You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Minh <mi...@gmail.com> on 2017/02/12 17:30:44 UTC
Solr Data Import Handler
Hi everyone,
How can i run multithreads of DIH in a cluster for a collection?
Re: Solr Data Import Handler
Posted by Alexandre Rafalovitch <ar...@gmail.com>.
They don't have to wait because they are not synchronized on anything
AFAIK. I do believe they need to be registered as different request
handler names in solrconfig.xml
But you need to be careful if they both/all wipe out data before
indexing new one. Those calls could overlap.
Regards,
Alex.
----
http://www.solr-start.com/ - Resources for Solr users, new and experienced
On 12 February 2017 at 16:14, Dave <ha...@gmail.com> wrote:
> That sounds pretty much like a hack. So if two imports happen at the same time they have to wait for each other?
>
>> On Feb 12, 2017, at 4:01 PM, Shawn Heisey <ap...@elyograg.org> wrote:
>>
>>> On 2/12/2017 10:30 AM, Minh wrote:
>>> Hi everyone,
>>> How can i run multithreads of DIH in a cluster for a collection?
>>
>> The DIH handler is single-threaded. It used to have a config option for
>> multiple threads, but it was removed since it didn't actually work.
>>
>> If you create multiple DIH handlers and start an import on them all at
>> the same time, then you'll have multiple threads.
>>
>> Thanks,
>> Shawn
>>
Re: Solr Data Import Handler
Posted by Dave <ha...@gmail.com>.
That sounds pretty much like a hack. So if two imports happen at the same time they have to wait for each other?
> On Feb 12, 2017, at 4:01 PM, Shawn Heisey <ap...@elyograg.org> wrote:
>
>> On 2/12/2017 10:30 AM, Minh wrote:
>> Hi everyone,
>> How can i run multithreads of DIH in a cluster for a collection?
>
> The DIH handler is single-threaded. It used to have a config option for
> multiple threads, but it was removed since it didn't actually work.
>
> If you create multiple DIH handlers and start an import on them all at
> the same time, then you'll have multiple threads.
>
> Thanks,
> Shawn
>
Re: Solr Data Import Handler
Posted by Shawn Heisey <ap...@elyograg.org>.
On 2/12/2017 10:30 AM, Minh wrote:
> Hi everyone,
> How can i run multithreads of DIH in a cluster for a collection?
The DIH handler is single-threaded. It used to have a config option for
multiple threads, but it was removed since it didn't actually work.
If you create multiple DIH handlers and start an import on them all at
the same time, then you'll have multiple threads.
Thanks,
Shawn