Paging a delete query?

[Koen De Groote <kd...@gmail.com>]

I'm looking to delete a big set of documents, based on a list of ids I have.

Testing this in a test environment has caused the VM to be unresponsive for
several minutes, which isn't ideal.

Are there options to paginate a delete query?

Also, are there options to ask solr about a specific query it was asked to
process, if it's still handling it, and all that?

Regards,
Koen De Groote

Re: Paging a delete query?

[Chris Hostetter <ho...@fucit.org>]

If you want to "delete by query" but you don't care about the atomicity of 
the "delete by query" (ie: queries and or other updates may process in the 
middle of the delete) then that is exactly what the delete() streaming 
expression decorator was designed for...

https://solr.apache.org/guide/solr/latest/query-guide/stream-decorator-reference.html#delete


-Hoss
http://www.lucidworks.com/

Re: Paging a delete query?

[Koen De Groote <kd...@gmail.com>]

Hello Thomas,

Thanks for the reply. Using nodejs here, but thanks for the information, it
does help.

Kind regards,
Koen

On Mon, Oct 23, 2023 at 11:22 AM Thomas Corthals <th...@klascement.net>
wrote:

> Hi Koen,
>
> You'll have to implement that on the client side.
>
> If you happen to use PHP, the Solarium PHP client has a plugin that does
> just that:
> https://solarium.readthedocs.io/en/stable/plugins/#buffereddelete-plugin
>
> (Full disclosure: I wrote the plugin.)
>
> Thomas
>
> Op ma 23 okt 2023 om 10:47 schreef Koen De Groote <kd...@gmail.com>:
>
> > I'm looking to delete a big set of documents, based on a list of ids I
> > have.
> >
> > Testing this in a test environment has caused the VM to be unresponsive
> for
> > several minutes, which isn't ideal.
> >
> > Are there options to paginate a delete query?
> >
> > Also, are there options to ask solr about a specific query it was asked
> to
> > process, if it's still handling it, and all that?
> >
> > Regards,
> > Koen De Groote
> >
>

Re: Paging a delete query?

[Thomas Corthals <th...@klascement.net>]

Hi Koen,

You'll have to implement that on the client side.

If you happen to use PHP, the Solarium PHP client has a plugin that does
just that:
https://solarium.readthedocs.io/en/stable/plugins/#buffereddelete-plugin

(Full disclosure: I wrote the plugin.)

Thomas

Op ma 23 okt 2023 om 10:47 schreef Koen De Groote <kd...@gmail.com>:

> I'm looking to delete a big set of documents, based on a list of ids I
> have.
>
> Testing this in a test environment has caused the VM to be unresponsive for
> several minutes, which isn't ideal.
>
> Are there options to paginate a delete query?
>
> Also, are there options to ask solr about a specific query it was asked to
> process, if it's still handling it, and all that?
>
> Regards,
> Koen De Groote
>