You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Juan Manuel Alvarez <na...@gmail.com> on 2010/12/09 20:10:38 UTC

Concurrent DIH calls

Hello!!! I am working with Solr on my first project and I am really
happy so far, both with the product and with the community.

I am having some doubts about how DIH works.

How  does DIH handles concurrent requests from different users? Does
it queue them? Or if an import is in progress it rejects new requests?

I would also like to know if the "commit=true" flag. Does it enqueue a
commit call in Solr? Or if another commit is in progress it blocks
until is finished?

Cheers!
Juan M.

Re: Concurrent DIH calls

Posted by Stefan Matheis <ma...@googlemail.com>.
I don't know if this is helpful .. but there is
http://wiki.apache.org/solr/DataImportHandler#EventListeners which would
trigger on 'onImportEnd'

Re: Concurrent DIH calls

Posted by Juan Manuel Alvarez <na...@gmail.com>.
Thanks for the answer Barani!
I was doing the same thing (queuing requests and querying solr
status), but I was hoping some flag/configuration would do the trick.
I will continue with that approach then! =o)

Thanks!
Juan M.

On Sat, Dec 11, 2010 at 3:50 AM, bbarani <bb...@gmail.com> wrote:
>
> Hi,
>
> As far as I know there is no queuing mechanism in SOLR for concurrent
> indexing request. It would simple ignore the concurrent request (first come
> first serve basis).. Solr experts, please correct me if I am wrong..
>
> To achieve concurrency,  we have implemented a queue using JMS and we send
> the data one by one for indexing (for performing push indexing / real time
> indexing)..
>
> We have also written a simple java program with SOLRj which will check if
> the status is idle or busy before it starts indexing next batch (This is for
> batch indexing program)..
>
> I would say the same thing applies for commit also.. As far as I know there
> is not inbuilt queuing system in SOLR for indexing.
>
> Thanks,
> Barani
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Concurrent-DIH-calls-tp2059517p2067937.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: Concurrent DIH calls

Posted by bbarani <bb...@gmail.com>.
Hi,

As far as I know there is no queuing mechanism in SOLR for concurrent
indexing request. It would simple ignore the concurrent request (first come
first serve basis).. Solr experts, please correct me if I am wrong..

To achieve concurrency,  we have implemented a queue using JMS and we send
the data one by one for indexing (for performing push indexing / real time
indexing)..

We have also written a simple java program with SOLRj which will check if
the status is idle or busy before it starts indexing next batch (This is for
batch indexing program)..

I would say the same thing applies for commit also.. As far as I know there
is not inbuilt queuing system in SOLR for indexing.

Thanks,
Barani


-- 
View this message in context: http://lucene.472066.n3.nabble.com/Concurrent-DIH-calls-tp2059517p2067937.html
Sent from the Solr - User mailing list archive at Nabble.com.